-- Logs begin at Tue 2022-05-31 13:52:02 UTC, end at Tue 2022-05-31 15:07:11 UTC. -- May 31 14:28:30.788329 dv-cinder-839793-14-smb systemd[1]: Starting Devstack devstack@keystone.service... May 31 14:28:30.800065 dv-cinder-839793-14-smb devstack@keystone.service[80488]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 31 14:28:30.800065 dv-cinder-839793-14-smb devstack@keystone.service[80488]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue May 31 14:28:30 2022] *** May 31 14:28:30.800065 dv-cinder-839793-14-smb devstack@keystone.service[80488]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 31 14:28:30.800065 dv-cinder-839793-14-smb devstack@keystone.service[80488]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 31 14:28:30.800065 dv-cinder-839793-14-smb devstack@keystone.service[80488]: nodename: dv-cinder-839793-14-smb May 31 14:28:30.800065 dv-cinder-839793-14-smb devstack@keystone.service[80488]: machine: x86_64 May 31 14:28:30.800065 dv-cinder-839793-14-smb devstack@keystone.service[80488]: clock source: unix May 31 14:28:30.800065 dv-cinder-839793-14-smb devstack@keystone.service[80488]: pcre jit disabled May 31 14:28:30.800065 dv-cinder-839793-14-smb devstack@keystone.service[80488]: detected number of CPU cores: 4 May 31 14:28:30.800065 dv-cinder-839793-14-smb devstack@keystone.service[80488]: current working directory: / May 31 14:28:30.800065 dv-cinder-839793-14-smb devstack@keystone.service[80488]: detected binary path: /usr/bin/uwsgi-core May 31 14:28:30.800065 dv-cinder-839793-14-smb devstack@keystone.service[80488]: your processes number limit is 47680 May 31 14:28:30.800065 dv-cinder-839793-14-smb devstack@keystone.service[80488]: your memory page size is 4096 bytes May 31 14:28:30.800065 dv-cinder-839793-14-smb devstack@keystone.service[80488]: detected max file descriptor number: 2048 May 31 14:28:30.800065 dv-cinder-839793-14-smb devstack@keystone.service[80488]: lock engine: pthread robust mutexes May 31 14:28:30.800065 dv-cinder-839793-14-smb devstack@keystone.service[80488]: thunder lock: enabled May 31 14:28:30.800065 dv-cinder-839793-14-smb devstack@keystone.service[80488]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 31 14:28:30.800065 dv-cinder-839793-14-smb devstack@keystone.service[80488]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 31 14:28:30.844540 dv-cinder-839793-14-smb devstack@keystone.service[80488]: Python main interpreter initialized at 0x55be159889c0 May 31 14:28:30.844540 dv-cinder-839793-14-smb devstack@keystone.service[80488]: python threads support enabled May 31 14:28:30.844540 dv-cinder-839793-14-smb devstack@keystone.service[80488]: your server socket listen backlog is limited to 100 connections May 31 14:28:30.844540 dv-cinder-839793-14-smb devstack@keystone.service[80488]: your mercy for graceful operations on workers is 90 seconds May 31 14:28:30.844910 dv-cinder-839793-14-smb devstack@keystone.service[80488]: mapped 403077 bytes (393 KB) for 2 cores May 31 14:28:30.844987 dv-cinder-839793-14-smb devstack@keystone.service[80488]: *** Operational MODE: preforking *** May 31 14:28:30.845252 dv-cinder-839793-14-smb devstack@keystone.service[80488]: *** uWSGI is running in multiple interpreter mode *** May 31 14:28:30.845252 dv-cinder-839793-14-smb devstack@keystone.service[80488]: spawned uWSGI master process (pid: 80488) May 31 14:28:30.845459 dv-cinder-839793-14-smb systemd[1]: Started Devstack devstack@keystone.service. May 31 14:28:30.850591 dv-cinder-839793-14-smb devstack@keystone.service[80488]: spawned uWSGI worker 1 (pid: 80502, cores: 1) May 31 14:28:30.850591 dv-cinder-839793-14-smb devstack@keystone.service[80488]: spawned uWSGI worker 2 (pid: 80503, cores: 1) May 31 14:28:30.850591 dv-cinder-839793-14-smb devstack@keystone.service[80488]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 31 14:28:36.548099 dv-cinder-839793-14-smb devstack@keystone.service[80503]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 31 14:28:36.548099 dv-cinder-839793-14-smb devstack@keystone.service[80503]: from cryptography.utils import int_from_bytes May 31 14:28:36.548878 dv-cinder-839793-14-smb devstack@keystone.service[80503]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 31 14:28:36.548878 dv-cinder-839793-14-smb devstack@keystone.service[80503]: from cryptography.utils import int_from_bytes May 31 14:28:36.549589 dv-cinder-839793-14-smb devstack@keystone.service[80502]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 31 14:28:36.549589 dv-cinder-839793-14-smb devstack@keystone.service[80502]: from cryptography.utils import int_from_bytes May 31 14:28:36.550046 dv-cinder-839793-14-smb devstack@keystone.service[80502]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 31 14:28:36.550046 dv-cinder-839793-14-smb devstack@keystone.service[80502]: from cryptography.utils import int_from_bytes May 31 14:28:36.599937 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 31 14:28:36.600098 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 31 14:28:36.600176 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 31 14:28:36.600255 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 31 14:28:36.600316 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] command line args: [] {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 31 14:28:36.600382 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] command line args: [] {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 31 14:28:36.600574 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 31 14:28:36.600668 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 31 14:28:36.600747 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ================================================================================ {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 31 14:28:36.600823 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ================================================================================ {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 31 14:28:36.600996 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] admin_token = **** {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:28:36.601084 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] admin_token = **** {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:28:36.601242 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] config_dir = [] {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:28:36.601327 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] config_dir = [] {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:28:36.601431 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:28:36.601509 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:28:36.601611 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] config_source = [] {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:28:36.601699 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] config_source = [] {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:28:36.601793 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] debug = True {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:28:36.601870 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] debug = True {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:28:36.601990 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:28:36.602231 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:28:36.602380 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:28:36.602492 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:28:36.602615 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:28:36.602737 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:28:36.602835 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:28:36.602938 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:28:36.603040 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:28:36.603142 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:28:36.603251 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] list_limit = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:28:36.603355 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] list_limit = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:28:36.603457 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] log_config_append = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:28:36.603565 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] log_config_append = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:28:36.603668 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:28:36.603776 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:28:36.603873 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] log_dir = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:28:36.603974 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] log_dir = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:28:36.604076 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] log_file = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:28:36.604190 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] log_file = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:28:36.604296 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:28:36.604383 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:28:36.604514 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:28:36.604596 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:28:36.604674 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:28:36.604802 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:28:36.604885 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:28:36.604967 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:28:36.605093 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:28:36.605171 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:28:36.605300 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:28:36.605384 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:28:36.605503 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:28:36.605580 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:28:36.605696 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:28:36.605778 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:28:36.605902 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:28:36.605976 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:28:36.606097 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:28:36.606180 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:28:36.606312 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:28:36.606397 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:28:36.606572 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:28:36.606655 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:28:36.606816 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:28:36.606909 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:28:36.607065 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:28:36.607153 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:28:36.607340 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:28:36.607414 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:28:36.607834 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.15/identity {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:28:36.607912 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.15/identity {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:28:36.608018 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] publish_errors = False {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:28:36.608095 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] publish_errors = False {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:28:36.608249 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:28:36.608381 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:28:36.608504 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:28:36.608619 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:28:36.608739 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:28:36.608854 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:28:36.608968 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:28:36.609102 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:28:36.609293 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:28:36.609411 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:28:36.609411 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] standard_threads = False {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:28:36.609632 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] standard_threads = False {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:28:36.609758 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:28:36.609881 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:28:36.610002 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:28:36.610117 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:28:36.610238 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:28:36.610353 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:28:36.610476 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] use_journal = False {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:28:36.610622 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] use_journal = False {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:28:36.610740 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] use_json = False {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:28:36.610865 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] use_json = False {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:28:36.610982 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] use_stderr = False {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:28:36.611097 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] use_stderr = False {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:28:36.611219 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] use_syslog = False {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:28:36.611336 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] use_syslog = False {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:28:36.611456 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:28:36.611572 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 14:28:36.611688 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.611802 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.611929 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.612046 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.612167 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.612288 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.612403 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.612517 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.612640 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.612763 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.613462 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.613580 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.613701 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.613818 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.613943 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.614059 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.614174 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.614288 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.614409 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.614525 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.614673 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.614797 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.614919 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.615041 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.615158 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.615272 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.615468 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.615602 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.615725 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.615841 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.615963 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.616088 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.616206 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.616321 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.616436 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.616557 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.616679 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.616838 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.616959 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.617080 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.617196 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.617310 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.617425 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.617551 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.617668 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.617783 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.617904 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.618032 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.618149 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.618273 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.618396 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.618513 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.618653 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.618770 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.618885 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.619009 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.619132 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.619248 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.619369 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.619486 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.619604 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.619732 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.619848 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.619969 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.620092 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.620214 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.620329 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.620453 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.620569 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.620684 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.620783 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.620878 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.620973 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.621077 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.621210 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.621318 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.621417 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.621527 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.621632 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.621738 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.621846 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.621961 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.622076 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.622193 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.622308 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.622431 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.622539 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.622712 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.622839 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.622958 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.623072 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.623199 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.623322 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.623448 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.623565 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.623680 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.623797 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.623912 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.624037 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.624154 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.624260 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.624373 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.624489 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.624489 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.624695 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.624811 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.624927 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.625042 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.625165 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.625278 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.625403 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.625520 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.625642 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.625765 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.625884 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.626000 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.626123 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.626241 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.626358 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.626474 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.626602 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.626733 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.626858 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.626981 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.627099 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.627227 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.627350 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.627545 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.627676 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.627794 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.627910 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.628026 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.628141 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.628263 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.628389 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.628508 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.628624 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.628740 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.628861 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.628978 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.629103 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.629220 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.629337 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.629452 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.629573 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.629690 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.629815 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.629933 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.630048 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.630166 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.630288 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.630411 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.630541 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.630703 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.630822 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.630938 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.631054 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.631176 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.631293 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.631418 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.631535 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.631652 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.631768 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.631884 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.632006 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.632132 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.632249 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.632367 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.632483 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.632599 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.632717 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.632844 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.632962 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.633078 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.633194 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.633319 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.633443 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.633569 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.633688 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.633805 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.633921 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.634038 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.634154 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.634279 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.634279 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.634498 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.634642 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.634760 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.634876 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.635005 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.635123 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.635245 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.635362 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.635479 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.635595 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.635719 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.635719 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.635940 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.636056 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.636172 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.636287 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.636411 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.636529 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.636651 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.636758 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.636874 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.636874 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] auth.external = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.637100 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.637217 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.637333 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.637333 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] auth.external = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.637558 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.637685 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.637835 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.637835 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] auth.password = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.638076 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.638202 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] auth.token = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.638320 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.638443 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.638602 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] auth.password = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.638723 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.638855 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] auth.token = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.638976 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.639093 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.639210 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.639327 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.639444 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.639573 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.639692 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.639809 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.639925 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.640043 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.640161 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] credential.caching = True {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.640285 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.640404 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.640521 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.640645 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.640765 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] credential.caching = True {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.640882 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.641072 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.641236 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.641356 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.641483 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.641602 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.641719 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.641844 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.641963 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.642081 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.642205 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.642324 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.642449 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.642590 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.642712 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.642830 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.642947 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.643064 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.643195 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.643315 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.643432 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.643549 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.643666 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.643666 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.643893 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.644012 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] federation.caching = True {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.644128 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.644246 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.644363 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.644480 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.644605 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.644724 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.644841 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] federation.caching = True {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.644957 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.645075 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.645191 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.645317 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.645436 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.645553 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.645679 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.645798 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.645916 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.646041 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.646161 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.646279 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.646396 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.646513 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.646685 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.646816 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.646936 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] identity.caching = True {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.647053 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.647170 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.647287 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.647411 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.647538 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.647657 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.647773 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] identity.caching = True {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.647890 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.648007 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.648124 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.648249 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.648369 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.648486 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.648603 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.648720 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.648843 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.648988 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.649108 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.649226 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.649343 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.649461 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.649582 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.649582 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.649816 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.649934 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.650051 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.650174 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.650293 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.650418 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.650538 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.650538 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.650780 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.650898 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.651014 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.651143 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.651263 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.651386 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.651505 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.651622 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.651749 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.651749 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.651970 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.652087 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.652203 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.652320 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.652445 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.652565 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.652682 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.652799 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.652915 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.653032 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.653158 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.653277 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.653400 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.653518 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.653636 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.653753 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.653878 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.653997 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.654113 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.654230 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.654347 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.654464 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.654877 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.654998 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.655115 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.655232 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.655349 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.655466 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.655591 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.655711 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.655828 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.655945 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.656061 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.656178 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.656303 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.656422 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.656539 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.656656 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.656774 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.656891 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.657020 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.657139 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.657256 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.657372 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.657489 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.657605 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.657729 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.657850 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.657967 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.658084 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.658207 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.658325 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.658451 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.658599 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.658719 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.658837 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.658955 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.659071 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.659199 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.659319 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ldap.user = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.659435 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.659552 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.660156 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.660156 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.660390 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.660509 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.660626 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.660626 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.660843 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ldap.user = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.660961 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.661090 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.661210 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.661327 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.661443 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.661568 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.661687 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.661812 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.661930 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.662048 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.662165 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.662165 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.662383 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.662509 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.662643 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.662761 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.662878 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.662995 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.663113 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.663242 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.663361 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.663478 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.663594 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.663711 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.663828 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.663953 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.664071 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.664190 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.664306 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.664423 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.664540 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.664728 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.664848 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.664965 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.665081 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.665199 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.665315 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.665440 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.665558 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.665675 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.665791 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.665908 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.666024 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.666150 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.666270 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.666387 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.666504 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.666664 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.666782 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.666914 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.667033 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.667150 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.667268 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.667385 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.667385 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.667615 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.667615 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.667834 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.667834 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.668052 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.668178 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.668298 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.668415 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] resource.caching = True {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.668531 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.668648 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.668764 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.668890 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.669009 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.669126 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.669242 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.669360 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.669477 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.669606 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.669726 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.669843 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.669959 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] resource.caching = True {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.670076 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.670192 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.670317 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.670437 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.670572 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.670692 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.670809 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] role.caching = True {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.670926 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.671056 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] role.driver = sql {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.671176 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.671293 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.671410 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.671529 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.671645 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.671771 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.671890 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.672007 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.672124 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.672241 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.672357 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] role.caching = True {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.672483 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.672609 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] role.driver = sql {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.672734 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.672852 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.672969 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.673085 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.673210 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.673330 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.673447 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.673565 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.673682 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.673799 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.673925 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.674044 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.674161 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.674278 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.674395 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.674512 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.674703 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.674823 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.674947 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.675066 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.675183 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.675405 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.676042 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.676164 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.676305 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.676494 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.676683 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.676883 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.677042 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.677162 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.677281 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.677399 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.677517 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.677643 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.677765 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.677882 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.677999 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.678115 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.678232 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.678358 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.678477 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.678609 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.678727 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.678727 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.678947 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.679077 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.679197 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.679313 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.679430 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.679547 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.679674 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.679802 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.679921 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.680038 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] token.caching = True {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.680155 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.680272 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.680388 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.680513 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.680631 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.680747 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.680864 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.680981 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.681097 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.681222 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.681340 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.681457 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.681572 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.681696 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.681813 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] token.caching = True {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.681941 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.682059 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.682176 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.682292 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.682409 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.682524 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.682669 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.682788 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.682905 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.683023 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.683139 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.683255 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.683380 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.683498 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.683615 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.683731 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.683847 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.683964 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.684090 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.684208 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.684325 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] database.connection = **** {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.684451 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.684578 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.684696 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.684813 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.684938 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.685057 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.685174 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.685291 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.685408 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.685525 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.685650 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.685768 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.685885 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.686002 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.686120 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] database.connection = **** {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.686245 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.686372 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.686491 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.686658 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.686779 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.686902 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.687020 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.687137 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.687255 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.687380 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.687498 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.687498 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.687718 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.687835 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.687961 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.688080 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.688080 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.688299 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.688417 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.688533 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.688658 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 31 14:28:36.688783 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.688783 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.688783 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.688783 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.688783 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.688783 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.688783 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.688783 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.688783 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 14:28:36.689728 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 31 14:28:36.714921 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 14:28:36.715149 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 14:28:36.715383 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 14:28:36.719419 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80503) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 14:28:36.719654 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80503) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 14:28:36.719882 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80503) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 14:28:36.724508 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 14:28:36.729878 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80503) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 14:28:36.753446 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 14:28:36.753678 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 14:28:36.757129 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80503) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 14:28:36.757363 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80503) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 14:28:36.809898 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 14:28:36.811456 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80503) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 14:28:36.859311 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 14:28:36.859545 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 14:28:36.861271 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80503) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 14:28:36.861509 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80503) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 14:28:36.926502 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 14:28:36.926747 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 14:28:36.926973 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 14:28:36.927192 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 14:28:36.927341 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80503) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 14:28:36.927432 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 14:28:36.927541 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80503) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 14:28:36.927627 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 14:28:36.927769 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80503) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 14:28:36.927992 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80503) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 14:28:36.928211 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80503) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 14:28:36.928428 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80503) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 14:28:36.950842 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 14:28:36.950952 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80503) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 14:28:36.951101 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 14:28:36.951184 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80503) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 14:28:36.951258 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 14:28:36.951371 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80503) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 14:28:36.951481 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 14:28:36.951593 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80503) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 14:28:36.951686 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 14:28:36.951810 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80503) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 14:28:36.951893 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 14:28:36.952024 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80503) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 14:28:36.952107 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 14:28:36.952238 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80503) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 14:28:36.963932 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 14:28:36.964550 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80503) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 14:28:36.976971 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 14:28:36.977205 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 14:28:36.977312 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80503) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 14:28:36.977426 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 14:28:36.977510 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80503) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 14:28:36.977648 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 14:28:36.977730 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80503) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 14:28:36.977865 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 14:28:36.977957 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80503) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 14:28:36.978082 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 14:28:36.978164 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80503) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 14:28:36.978296 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80502) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 14:28:36.978377 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80503) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 14:28:36.978512 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80503) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 31 14:28:36.995402 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:36.995617 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 31 14:28:36.995810 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:36.995949 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:36.996045 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 31 14:28:36.996148 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 31 14:28:36.996348 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:36.996430 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:36.996554 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 31 14:28:36.996659 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:36.996825 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:36.996912 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:36.997085 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:36.997166 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:36.997342 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:36.997597 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.008208 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.008486 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.008755 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.008838 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.009035 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.009130 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.009306 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.009589 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.017113 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80502) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 31 14:28:37.017723 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80503) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 31 14:28:37.021570 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80503) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 31 14:28:37.021701 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80502) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 31 14:28:37.021853 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.021935 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.022128 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.022223 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.022402 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.022485 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.022702 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.022787 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.023073 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.023169 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.023344 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.023425 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.023616 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.023697 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.023885 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.023976 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.024158 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.024238 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.024422 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.024510 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.051682 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.053397 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80502) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 31 14:28:37.053682 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.055148 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.056933 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80503) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 31 14:28:37.057218 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.058975 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80502) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 31 14:28:37.059257 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.059534 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.063195 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80503) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 31 14:28:37.063444 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.063729 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.066837 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80502) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 31 14:28:37.067118 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.071285 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80503) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 31 14:28:37.071621 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.071706 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80502) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 31 14:28:37.072020 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.072302 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.072580 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.072850 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.073120 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.073386 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.073651 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.076251 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80503) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 31 14:28:37.076655 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.076939 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.077222 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.077499 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.077783 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.078116 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.078405 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.095990 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.096264 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.098475 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.098778 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.101484 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80502) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 31 14:28:37.103486 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80503) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 31 14:28:37.105165 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.105457 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.107203 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.107501 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.110611 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80502) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 31 14:28:37.112627 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80503) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 31 14:28:37.114240 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80502) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 31 14:28:37.116292 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80503) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 31 14:28:37.119450 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.119748 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.120031 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.120314 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.120590 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.120866 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.121516 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.121821 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.122117 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.122407 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.122710 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.122993 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.139978 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80502) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 31 14:28:37.140260 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.140526 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.140798 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.142374 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80503) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 31 14:28:37.142698 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.142971 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.143250 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.149318 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.151080 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.151354 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.151910 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.153650 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.153929 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.154369 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80502) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 31 14:28:37.154930 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.155213 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.155505 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.155798 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.157274 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80503) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 31 14:28:37.157555 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.157835 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.158125 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.158416 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.169786 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80502) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 31 14:28:37.170062 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.170339 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.170642 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.170923 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.171193 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.171462 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.172627 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80503) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 31 14:28:37.172909 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.173192 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.173475 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.173833 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.174126 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.174405 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.189598 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80502) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 31 14:28:37.193093 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80503) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 31 14:28:37.193402 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80502) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 31 14:28:37.196486 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80503) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 31 14:28:37.196737 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.198343 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.199865 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.200036 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80502) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 31 14:28:37.200313 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.200589 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.201466 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.203162 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80503) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 31 14:28:37.203445 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.203727 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.208552 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.210183 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80502) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 31 14:28:37.211793 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.213401 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.213501 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80503) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 31 14:28:37.213688 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.213966 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.214236 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.216694 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.216989 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.217277 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.217553 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.223402 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80502) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 31 14:28:37.223689 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.224068 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.226857 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80503) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 31 14:28:37.227144 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.227532 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.231974 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80502) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 31 14:28:37.232254 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.232532 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.232807 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.233077 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.233383 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.233655 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.233929 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.234203 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.234472 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.234764 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.235036 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.235303 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.235458 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80503) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 31 14:28:37.235541 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80502) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.235741 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.236061 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.236369 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.236643 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.236946 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.237244 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.237521 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.237846 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.238145 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.238600 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.238893 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.239171 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.239432 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80503) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 31 14:28:37.274274 dv-cinder-839793-14-smb devstack@keystone.service[80502]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55be159889c0 pid: 80502 (default app) May 31 14:28:37.277580 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4bc8f4-1281-403e-9b89-b7a5acbf359d None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:28:37.277885 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4bc8f4-1281-403e-9b89-b7a5acbf359d None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:28:37.278173 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4bc8f4-1281-403e-9b89-b7a5acbf359d None None] PATH_INFO: `/v3` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:28:37.278569 dv-cinder-839793-14-smb devstack@keystone.service[80503]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55be159889c0 pid: 80503 (default app) May 31 14:28:37.282695 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1/1] 10.222.0.15 () {50 vars in 791 bytes} [Tue May 31 14:28:37 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:28:45.951614 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff62b9-422d-425f-ae49-374a5a2d413c None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:28:45.952187 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff62b9-422d-425f-ae49-374a5a2d413c None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:28:45.952187 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfff62b9-422d-425f-ae49-374a5a2d413c None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:28:45.957012 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1/2] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:28:45 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 31 14:28:45.962275 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a631c858-161e-450f-89ab-de4eed5c48e0 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:28:45.962701 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a631c858-161e-450f-89ab-de4eed5c48e0 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:28:45.962865 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a631c858-161e-450f-89ab-de4eed5c48e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:28:46.030609 dv-cinder-839793-14-smb devstack@keystone.service[80502]: INFO dbcounter [None req-a631c858-161e-450f-89ab-de4eed5c48e0 None None] Registered counter for database keystone May 31 14:28:46.051910 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG oslo_db.sqlalchemy.engines [None req-a631c858-161e-450f-89ab-de4eed5c48e0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80502) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 31 14:28:46.058007 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writer thread running {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 31 14:28:46.341864 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG passlib.handlers.bcrypt [None req-a631c858-161e-450f-89ab-de4eed5c48e0 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80502) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 31 14:28:46.342282 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG passlib.handlers.bcrypt [None req-a631c858-161e-450f-89ab-de4eed5c48e0 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80502) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 31 14:28:46.398653 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-a631c858-161e-450f-89ab-de4eed5c48e0 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:28:46.400276 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-a631c858-161e-450f-89ab-de4eed5c48e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:28:46.523149 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 2/3] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:28:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 562 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 31 14:28:46.679851 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfff62b9-422d-425f-ae49-374a5a2d413c None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:28:46.748251 dv-cinder-839793-14-smb devstack@keystone.service[80503]: INFO dbcounter [None req-dfff62b9-422d-425f-ae49-374a5a2d413c None None] Registered counter for database keystone May 31 14:28:46.767794 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG oslo_db.sqlalchemy.engines [None req-dfff62b9-422d-425f-ae49-374a5a2d413c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80503) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 31 14:28:46.773882 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writer thread running {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 31 14:28:46.997577 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfff62b9-422d-425f-ae49-374a5a2d413c None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:28:47.001797 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efebc8cd-5b03-4a87-8ae3-1d42fca256a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:28:47.002456 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efebc8cd-5b03-4a87-8ae3-1d42fca256a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:28:47.002772 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efebc8cd-5b03-4a87-8ae3-1d42fca256a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:28:47.003056 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efebc8cd-5b03-4a87-8ae3-1d42fca256a0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:28:47.011167 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efebc8cd-5b03-4a87-8ae3-1d42fca256a0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:28:47.063375 dv-cinder-839793-14-smb devstack@keystone.service[80503]: WARNING keystone.common.rbac_enforcer.enforcer [None req-efebc8cd-5b03-4a87-8ae3-1d42fca256a0 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 31 14:28:47.063719 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efebc8cd-5b03-4a87-8ae3-1d42fca256a0 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:28:47.073141 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 2/4] 10.222.0.15 () {58 vars in 1324 bytes} [Tue May 31 14:28:46 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 31 14:28:47.079302 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a631c858-161e-450f-89ab-de4eed5c48e0 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:28:47.095463 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a631c858-161e-450f-89ab-de4eed5c48e0 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:28:47.100325 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b953cc-1cad-4dfa-a4d8-936408f0d698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:28:47.101442 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b953cc-1cad-4dfa-a4d8-936408f0d698 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:28:47.101729 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b953cc-1cad-4dfa-a4d8-936408f0d698 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:28:47.102012 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b953cc-1cad-4dfa-a4d8-936408f0d698 admin admin] PATH_INFO: `/v3/projects/b38704b3ca584f7ab2bbb66117ff153b` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:28:47.103529 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b953cc-1cad-4dfa-a4d8-936408f0d698 admin admin] RBAC: Authorizing `identity:get_project(project_id=b38704b3ca584f7ab2bbb66117ff153b)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:28:47.154766 dv-cinder-839793-14-smb devstack@keystone.service[80502]: WARNING keystone.common.rbac_enforcer.enforcer [None req-a8b953cc-1cad-4dfa-a4d8-936408f0d698 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 31 14:28:47.155367 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b953cc-1cad-4dfa-a4d8-936408f0d698 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:28:47.160455 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 3/5] 10.222.0.15 () {56 vars in 1207 bytes} [Tue May 31 14:28:47 2022] GET /identity/v3/projects/b38704b3ca584f7ab2bbb66117ff153b => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:28:49.373443 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430f9611-e5cc-409a-94ba-d339f440bd81 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:28:49.373947 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430f9611-e5cc-409a-94ba-d339f440bd81 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:28:49.374039 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430f9611-e5cc-409a-94ba-d339f440bd81 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:28:49.378092 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 3/6] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:28:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:28:49.383776 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f264d4-6f35-4d3f-9146-77083cfe57fe None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:28:49.384162 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f264d4-6f35-4d3f-9146-77083cfe57fe None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:28:49.384349 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f264d4-6f35-4d3f-9146-77083cfe57fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:28:49.403335 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-95f264d4-6f35-4d3f-9146-77083cfe57fe None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:28:49.404856 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-95f264d4-6f35-4d3f-9146-77083cfe57fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:28:49.413432 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 4/7] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:28:49 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 31 14:28:49.435908 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430f9611-e5cc-409a-94ba-d339f440bd81 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:28:49.448054 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430f9611-e5cc-409a-94ba-d339f440bd81 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:28:49.452286 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cbe56a-831f-4549-9fa5-70b293cacaf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:28:49.452911 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cbe56a-831f-4549-9fa5-70b293cacaf2 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:28:49.453199 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cbe56a-831f-4549-9fa5-70b293cacaf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:28:49.453481 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cbe56a-831f-4549-9fa5-70b293cacaf2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:28:49.461144 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cbe56a-831f-4549-9fa5-70b293cacaf2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:28:49.462932 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cbe56a-831f-4549-9fa5-70b293cacaf2 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:28:49.471574 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 4/8] 10.222.0.15 () {58 vars in 1324 bytes} [Tue May 31 14:28:49 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 31 14:28:49.477260 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f264d4-6f35-4d3f-9146-77083cfe57fe None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:28:49.486068 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f264d4-6f35-4d3f-9146-77083cfe57fe None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:28:49.491203 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c53b26-c467-4af6-871a-8c6ed80e8d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:28:49.492069 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c53b26-c467-4af6-871a-8c6ed80e8d33 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:28:49.492351 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c53b26-c467-4af6-871a-8c6ed80e8d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:28:49.492624 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c53b26-c467-4af6-871a-8c6ed80e8d33 admin admin] PATH_INFO: `/v3/users/98fe85f6eb3a42f89b20a9a8c17c5432` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:28:49.494000 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c53b26-c467-4af6-871a-8c6ed80e8d33 admin admin] RBAC: Authorizing `identity:get_user(user_id=98fe85f6eb3a42f89b20a9a8c17c5432)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:28:49.495860 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c53b26-c467-4af6-871a-8c6ed80e8d33 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:28:49.497396 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 5/9] 10.222.0.15 () {56 vars in 1198 bytes} [Tue May 31 14:28:49 2022] GET /identity/v3/users/98fe85f6eb3a42f89b20a9a8c17c5432 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:28:51.775535 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a696d-1fe6-460d-b278-0bc5524b1de0 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:28:51.776050 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a696d-1fe6-460d-b278-0bc5524b1de0 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:28:51.776050 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a696d-1fe6-460d-b278-0bc5524b1de0 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:28:51.777352 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 5/10] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:28:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 31 14:28:51.782903 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fcadb5-85a8-49f7-a713-f962298af630 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:28:51.783273 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fcadb5-85a8-49f7-a713-f962298af630 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:28:51.783469 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fcadb5-85a8-49f7-a713-f962298af630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:28:51.799828 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-f4fcadb5-85a8-49f7-a713-f962298af630 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:28:51.801521 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-f4fcadb5-85a8-49f7-a713-f962298af630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:28:51.837170 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811e28db-7da8-445d-9eff-3c2cda0146ab None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:28:51.837467 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811e28db-7da8-445d-9eff-3c2cda0146ab None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:28:51.837765 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811e28db-7da8-445d-9eff-3c2cda0146ab None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:28:51.839138 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 6/11] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:28:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 31 14:28:51.844122 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23cb663-78ac-4e16-a96f-ebd893320be4 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:28:51.844417 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23cb663-78ac-4e16-a96f-ebd893320be4 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:28:51.844699 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23cb663-78ac-4e16-a96f-ebd893320be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:28:51.880461 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 6/12] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:28:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 14:28:51.885632 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG passlib.handlers.bcrypt [None req-c23cb663-78ac-4e16-a96f-ebd893320be4 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80503) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 31 14:28:51.886062 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG passlib.handlers.bcrypt [None req-c23cb663-78ac-4e16-a96f-ebd893320be4 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80503) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 31 14:28:51.903386 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fcadb5-85a8-49f7-a713-f962298af630 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:28:51.926536 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:28:51.932933 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-c23cb663-78ac-4e16-a96f-ebd893320be4 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:28:51.934503 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-c23cb663-78ac-4e16-a96f-ebd893320be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:28:52.005515 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fcadb5-85a8-49f7-a713-f962298af630 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:28:52.032427 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 7/13] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:28:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 31 14:28:52.038153 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2e3d4c-3854-4ef5-8f0d-1e9b1b621499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:28:52.038995 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e3d4c-3854-4ef5-8f0d-1e9b1b621499 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:28:52.039283 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e3d4c-3854-4ef5-8f0d-1e9b1b621499 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:28:52.039564 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e3d4c-3854-4ef5-8f0d-1e9b1b621499 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:28:52.050934 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2e3d4c-3854-4ef5-8f0d-1e9b1b621499 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 14:28:52.054738 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23cb663-78ac-4e16-a96f-ebd893320be4 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:28:52.062503 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-fe2e3d4c-3854-4ef5-8f0d-1e9b1b621499 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 31 14:28:52.062503 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:28:52.062503 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:28:52.062503 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:28:52.062503 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:28:52.062503 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:28:52.062503 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:28:52.062503 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:28:52.062503 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:28:52.062503 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:28:52.062503 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:28:52.062503 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:28:52.062503 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 14:28:52.062503 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 14:28:52.062503 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 14:28:52.062503 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 14:28:52.063719 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 14:28:52.063719 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 14:28:52.063719 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 14:28:52.063719 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 14:28:52.063719 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:28:52.063719 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:28:52.063719 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:28:52.063719 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:28:52.063719 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:28:52.063719 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:28:52.063719 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:28:52.063719 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:28:52.063719 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:28:52.063719 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:28:52.063719 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:28:52.063719 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:28:52.069952 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:28:52.069952 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:28:52.069952 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:28:52.069952 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:28:52.069952 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 14:28:52.069952 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 14:28:52.069952 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 14:28:52.069952 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 14:28:52.069952 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 14:28:52.069952 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 14:28:52.069952 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 31 14:28:52.069952 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:28:52.069952 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 7/14] 10.222.0.15 () {56 vars in 1096 bytes} [Tue May 31 14:28:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 14:28:52.070793 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2e3d4c-3854-4ef5-8f0d-1e9b1b621499 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:28:52.153787 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23cb663-78ac-4e16-a96f-ebd893320be4 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:28:52.153994 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:28:52.156511 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:28:52.176224 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2e3d4c-3854-4ef5-8f0d-1e9b1b621499 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:28:52.195071 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b41540c-c813-4393-9532-b525410aedaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:28:52.195976 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b41540c-c813-4393-9532-b525410aedaf None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:28:52.196263 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b41540c-c813-4393-9532-b525410aedaf None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:28:52.196543 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b41540c-c813-4393-9532-b525410aedaf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:28:52.210023 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f933bd-83f8-41bf-b6e6-e393b71e6c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:28:52.210724 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f933bd-83f8-41bf-b6e6-e393b71e6c51 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:28:52.211019 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f933bd-83f8-41bf-b6e6-e393b71e6c51 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:28:52.211293 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f933bd-83f8-41bf-b6e6-e393b71e6c51 None admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:28:52.212038 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f933bd-83f8-41bf-b6e6-e393b71e6c51 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:28:52.212347 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f933bd-83f8-41bf-b6e6-e393b71e6c51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:28:52.213748 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f933bd-83f8-41bf-b6e6-e393b71e6c51 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:28:52.226888 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 8/15] 10.222.0.15 () {56 vars in 1099 bytes} [Tue May 31 14:28:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 14:28:52.232367 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f933bd-83f8-41bf-b6e6-e393b71e6c51 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:28:52.265257 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b41540c-c813-4393-9532-b525410aedaf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:28:52.266809 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b41540c-c813-4393-9532-b525410aedaf None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:28:52.329123 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f933bd-83f8-41bf-b6e6-e393b71e6c51 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:28:52.365922 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 8/16] 10.222.0.15 () {58 vars in 1282 bytes} [Tue May 31 14:28:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 31 14:28:52.366881 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bd7565-6d69-4b12-9c40-46f443ea29d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:28:52.367772 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bd7565-6d69-4b12-9c40-46f443ea29d5 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:28:52.368060 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bd7565-6d69-4b12-9c40-46f443ea29d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:28:52.368341 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bd7565-6d69-4b12-9c40-46f443ea29d5 None admin] PATH_INFO: `/v3/users/98fe85f6eb3a42f89b20a9a8c17c5432` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:28:52.369569 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bd7565-6d69-4b12-9c40-46f443ea29d5 None admin] RBAC: Authorizing `identity:get_user(user_id=98fe85f6eb3a42f89b20a9a8c17c5432)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:28:52.371085 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bd7565-6d69-4b12-9c40-46f443ea29d5 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:28:52.371238 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b41540c-c813-4393-9532-b525410aedaf None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:28:52.376705 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 9/17] 10.222.0.15 () {56 vars in 1177 bytes} [Tue May 31 14:28:52 2022] GET /identity/v3/users/98fe85f6eb3a42f89b20a9a8c17c5432 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 14:28:52.376868 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:28:52.379462 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bd7565-6d69-4b12-9c40-46f443ea29d5 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:28:52.393440 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:28:52.470198 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b41540c-c813-4393-9532-b525410aedaf None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:28:52.479613 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bd7565-6d69-4b12-9c40-46f443ea29d5 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:28:52.507154 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b4e6f9-a001-4d94-8b10-74017023c98f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:28:52.508355 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b4e6f9-a001-4d94-8b10-74017023c98f None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:28:52.508797 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b4e6f9-a001-4d94-8b10-74017023c98f None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:28:52.509079 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b4e6f9-a001-4d94-8b10-74017023c98f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:28:52.515637 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823b98bb-5ad2-4f35-9d95-6887e5ea1dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:28:52.516437 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b98bb-5ad2-4f35-9d95-6887e5ea1dfc None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:28:52.516726 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b98bb-5ad2-4f35-9d95-6887e5ea1dfc None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:28:52.517006 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b98bb-5ad2-4f35-9d95-6887e5ea1dfc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:28:52.518386 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823b98bb-5ad2-4f35-9d95-6887e5ea1dfc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:28:52.519918 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823b98bb-5ad2-4f35-9d95-6887e5ea1dfc None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:28:52.521521 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 10/18] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:28:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:28:52.527152 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823b98bb-5ad2-4f35-9d95-6887e5ea1dfc None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:28:52.529159 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b4e6f9-a001-4d94-8b10-74017023c98f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:28:52.530981 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b4e6f9-a001-4d94-8b10-74017023c98f None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:28:52.552630 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-79b4e6f9-a001-4d94-8b10-74017023c98f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:28:52.552630 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:28:52.552630 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:28:52.552630 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:28:52.552630 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:28:52.552630 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:28:52.552630 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:28:52.552630 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:28:52.552630 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:28:52.552630 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:28:52.552630 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:28:52.552630 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:28:52.552630 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 14:28:52.552630 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 14:28:52.552630 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 14:28:52.553476 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 14:28:52.553476 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:28:52.553476 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:28:52.553476 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:28:52.553476 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:28:52.553476 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:28:52.553476 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:28:52.553476 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:28:52.553476 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:28:52.553476 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:28:52.553476 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:28:52.553476 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:28:52.553476 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:28:52.553476 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:28:52.553476 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:28:52.553476 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:28:52.553476 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:28:52.554267 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 14:28:52.554267 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 14:28:52.554267 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:28:52.554267 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:28:52.554267 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 9/19] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:28:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 14:28:52.559549 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b4e6f9-a001-4d94-8b10-74017023c98f None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:28:52.607193 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:28:52.614695 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:28:52.625610 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823b98bb-5ad2-4f35-9d95-6887e5ea1dfc None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:28:52.657132 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b4e6f9-a001-4d94-8b10-74017023c98f None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:28:52.659023 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c827760-2d86-4f8f-b8fb-0c8f843cbede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:28:52.659741 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c827760-2d86-4f8f-b8fb-0c8f843cbede None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:28:52.660510 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c827760-2d86-4f8f-b8fb-0c8f843cbede None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:28:52.660795 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c827760-2d86-4f8f-b8fb-0c8f843cbede None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:28:52.661634 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c827760-2d86-4f8f-b8fb-0c8f843cbede None admin] RBAC: Adding query filter params (role.id=76c53e2c353644f885028a0226c06146, scope.domain.id=default, user.id=98fe85f6eb3a42f89b20a9a8c17c5432) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:28:52.661949 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c827760-2d86-4f8f-b8fb-0c8f843cbede None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:28:52.663435 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c827760-2d86-4f8f-b8fb-0c8f843cbede None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:28:52.670200 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 11/20] 10.222.0.15 () {56 vars in 1322 bytes} [Tue May 31 14:28:52 2022] GET /identity/v3/role_assignments?user.id=98fe85f6eb3a42f89b20a9a8c17c5432&scope.domain.id=default&role.id=76c53e2c353644f885028a0226c06146 => generated 233 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 14:28:52.694333 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd4c359-8415-4bb9-be0d-e1778dba6372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:28:52.695065 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd4c359-8415-4bb9-be0d-e1778dba6372 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:28:52.695355 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd4c359-8415-4bb9-be0d-e1778dba6372 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:28:52.695635 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd4c359-8415-4bb9-be0d-e1778dba6372 None admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:28:52.696387 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd4c359-8415-4bb9-be0d-e1778dba6372 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:28:52.696706 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd4c359-8415-4bb9-be0d-e1778dba6372 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:28:52.698175 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd4c359-8415-4bb9-be0d-e1778dba6372 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:28:52.718193 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 10/21] 10.222.0.15 () {56 vars in 1109 bytes} [Tue May 31 14:28:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 14:28:55.320281 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5f9433-ca1b-4d44-aea5-ab89bf213c81 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:28:55.320817 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5f9433-ca1b-4d44-aea5-ab89bf213c81 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:28:55.320817 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5f9433-ca1b-4d44-aea5-ab89bf213c81 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:28:55.322202 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 12/22] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:28:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:28:55.327561 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4bef79-3871-4733-985b-897eb09ea5a1 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:28:55.327966 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4bef79-3871-4733-985b-897eb09ea5a1 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:28:55.328153 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4bef79-3871-4733-985b-897eb09ea5a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:28:55.352978 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-9e4bef79-3871-4733-985b-897eb09ea5a1 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:28:55.358262 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-9e4bef79-3871-4733-985b-897eb09ea5a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:28:55.427585 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4646a711-fafa-4fd7-8568-dd0901586e0a None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:28:55.427895 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4646a711-fafa-4fd7-8568-dd0901586e0a None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:28:55.428158 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4646a711-fafa-4fd7-8568-dd0901586e0a None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:28:55.429527 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 13/23] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:28:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 31 14:28:55.437609 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd5990-25f1-4039-9e3e-a18639122e64 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:28:55.437907 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd5990-25f1-4039-9e3e-a18639122e64 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:28:55.438195 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd5990-25f1-4039-9e3e-a18639122e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:28:55.463677 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-85dd5990-25f1-4039-9e3e-a18639122e64 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:28:55.464879 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-85dd5990-25f1-4039-9e3e-a18639122e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:28:55.481125 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 11/24] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:28:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 14:28:55.520275 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4bef79-3871-4733-985b-897eb09ea5a1 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:28:55.616962 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 14/25] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:28:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 31 14:28:55.618902 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:28:55.656556 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e0c3e9-a6be-43ec-908b-e966f80e251b None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:28:55.656855 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e0c3e9-a6be-43ec-908b-e966f80e251b None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:28:55.657126 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e0c3e9-a6be-43ec-908b-e966f80e251b None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:28:55.658679 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 15/26] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:28:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:28:55.669687 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687f017c-aaed-4e5d-83e0-c62b8b84b022 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:28:55.669985 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687f017c-aaed-4e5d-83e0-c62b8b84b022 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:28:55.670265 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687f017c-aaed-4e5d-83e0-c62b8b84b022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:28:55.696887 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-687f017c-aaed-4e5d-83e0-c62b8b84b022 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:28:55.698099 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-687f017c-aaed-4e5d-83e0-c62b8b84b022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:28:55.718509 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4bef79-3871-4733-985b-897eb09ea5a1 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:28:55.758767 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d24af9-6bf7-402f-b02a-463d818951f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:28:55.759856 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d24af9-6bf7-402f-b02a-463d818951f6 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:28:55.760302 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d24af9-6bf7-402f-b02a-463d818951f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:28:55.760723 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d24af9-6bf7-402f-b02a-463d818951f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:28:55.772151 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d24af9-6bf7-402f-b02a-463d818951f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:28:55.773886 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d24af9-6bf7-402f-b02a-463d818951f6 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:28:55.795804 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-63d24af9-6bf7-402f-b02a-463d818951f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:28:55.795804 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:28:55.795804 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:28:55.795804 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:28:55.795804 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:28:55.795804 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:28:55.795804 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:28:55.795804 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:28:55.795804 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:28:55.795804 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:28:55.795804 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:28:55.795804 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:28:55.795804 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 14:28:55.795804 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 14:28:55.795804 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 14:28:55.796871 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 14:28:55.796871 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:28:55.796871 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:28:55.796871 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:28:55.796871 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:28:55.796871 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:28:55.796871 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:28:55.796871 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:28:55.796871 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:28:55.796871 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:28:55.796871 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:28:55.796871 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:28:55.796871 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:28:55.796871 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:28:55.796871 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:28:55.796871 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:28:55.796871 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:28:55.797891 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 14:28:55.797891 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 14:28:55.797891 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:28:55.797891 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:28:55.799530 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 12/27] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:28:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 14:28:55.802712 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d24af9-6bf7-402f-b02a-463d818951f6 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:28:55.848293 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 16/28] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:28:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 31 14:28:55.849373 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687f017c-aaed-4e5d-83e0-c62b8b84b022 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:28:55.857453 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:28:55.933228 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d24af9-6bf7-402f-b02a-463d818951f6 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:28:55.952530 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:28:55.977380 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95da4d28-85f8-4034-872a-222b94698362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:28:55.978489 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da4d28-85f8-4034-872a-222b94698362 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:28:55.979028 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da4d28-85f8-4034-872a-222b94698362 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:28:55.979506 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da4d28-85f8-4034-872a-222b94698362 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:28:56.000486 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95da4d28-85f8-4034-872a-222b94698362 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 14:28:56.013700 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-95da4d28-85f8-4034-872a-222b94698362 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 31 14:28:56.013700 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:28:56.013700 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:28:56.013700 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:28:56.013700 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:28:56.013700 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:28:56.013700 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:28:56.013700 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:28:56.013700 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:28:56.013700 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:28:56.013700 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:28:56.013700 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:28:56.013700 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 14:28:56.013700 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 14:28:56.013700 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 14:28:56.013700 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 14:28:56.014603 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 14:28:56.014603 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 14:28:56.014603 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 14:28:56.014603 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 14:28:56.014603 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:28:56.014603 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:28:56.014603 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:28:56.014603 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:28:56.014603 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:28:56.014603 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:28:56.014603 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:28:56.014603 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:28:56.014603 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:28:56.014603 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:28:56.014603 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:28:56.014603 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:28:56.015441 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:28:56.015441 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:28:56.015441 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:28:56.015441 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:28:56.015441 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 14:28:56.015441 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 14:28:56.015441 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 14:28:56.015441 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 14:28:56.015441 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 14:28:56.015441 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 14:28:56.015441 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 31 14:28:56.015441 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:28:56.023752 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 13/29] 10.222.0.15 () {56 vars in 1096 bytes} [Tue May 31 14:28:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:28:56.025470 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95da4d28-85f8-4034-872a-222b94698362 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:28:56.033291 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687f017c-aaed-4e5d-83e0-c62b8b84b022 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:28:56.101151 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf410c5-ae79-4f7d-8f8e-ab23bc4e5265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:28:56.101826 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf410c5-ae79-4f7d-8f8e-ab23bc4e5265 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:28:56.102108 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf410c5-ae79-4f7d-8f8e-ab23bc4e5265 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:28:56.102382 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf410c5-ae79-4f7d-8f8e-ab23bc4e5265 None admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:28:56.103671 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf410c5-ae79-4f7d-8f8e-ab23bc4e5265 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:28:56.103984 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf410c5-ae79-4f7d-8f8e-ab23bc4e5265 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:28:56.105432 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf410c5-ae79-4f7d-8f8e-ab23bc4e5265 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:28:56.140207 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 17/30] 10.222.0.15 () {56 vars in 1109 bytes} [Tue May 31 14:28:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:28:56.141114 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf410c5-ae79-4f7d-8f8e-ab23bc4e5265 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:28:56.203682 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95da4d28-85f8-4034-872a-222b94698362 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:28:56.220897 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:28:56.244251 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce33e272-89c6-4b81-8ee2-132352693422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:28:56.244934 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce33e272-89c6-4b81-8ee2-132352693422 None admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:28:56.245224 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce33e272-89c6-4b81-8ee2-132352693422 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:28:56.245506 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce33e272-89c6-4b81-8ee2-132352693422 None admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:28:56.246264 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce33e272-89c6-4b81-8ee2-132352693422 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:28:56.247696 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce33e272-89c6-4b81-8ee2-132352693422 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:28:56.264691 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf410c5-ae79-4f7d-8f8e-ab23bc4e5265 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:28:56.307499 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2fe7b0-3081-4ebe-a942-3dd1036f8261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:28:56.308257 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2fe7b0-3081-4ebe-a942-3dd1036f8261 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:28:56.308605 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2fe7b0-3081-4ebe-a942-3dd1036f8261 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:28:56.309019 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2fe7b0-3081-4ebe-a942-3dd1036f8261 None admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:28:56.309838 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2fe7b0-3081-4ebe-a942-3dd1036f8261 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:28:56.310215 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2fe7b0-3081-4ebe-a942-3dd1036f8261 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:28:56.311696 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2fe7b0-3081-4ebe-a942-3dd1036f8261 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:28:56.326532 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 18/31] 10.222.0.15 () {56 vars in 1099 bytes} [Tue May 31 14:28:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:28:56.327539 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2fe7b0-3081-4ebe-a942-3dd1036f8261 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:28:56.441445 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2fe7b0-3081-4ebe-a942-3dd1036f8261 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:28:56.449179 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 14/32] 10.222.0.15 () {60 vars in 1131 bytes} [Tue May 31 14:28:56 2022] POST /identity/v3/roles => generated 219 bytes in 424 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:28:56.450783 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6c24ad-ce4f-4b30-b85a-0b56385b5644 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:28:56.451077 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6c24ad-ce4f-4b30-b85a-0b56385b5644 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:28:56.451363 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6c24ad-ce4f-4b30-b85a-0b56385b5644 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:28:56.452830 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 15/33] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:28:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:28:56.458326 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6c24ad-ce4f-4b30-b85a-0b56385b5644 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:28:56.481153 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:28:56.486689 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:28:56.499395 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5570a77e-ed47-4b74-8e3f-a75050d9a307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:28:56.501152 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5570a77e-ed47-4b74-8e3f-a75050d9a307 None admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:28:56.501778 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5570a77e-ed47-4b74-8e3f-a75050d9a307 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:28:56.502083 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5570a77e-ed47-4b74-8e3f-a75050d9a307 None admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:28:56.502877 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5570a77e-ed47-4b74-8e3f-a75050d9a307 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:28:56.504461 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5570a77e-ed47-4b74-8e3f-a75050d9a307 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:28:56.589466 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6c24ad-ce4f-4b30-b85a-0b56385b5644 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:28:56.629514 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4784ea0-0cc3-43a5-8631-57cb7018a669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:28:56.630880 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4784ea0-0cc3-43a5-8631-57cb7018a669 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:28:56.631344 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4784ea0-0cc3-43a5-8631-57cb7018a669 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:28:56.631792 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4784ea0-0cc3-43a5-8631-57cb7018a669 None admin] PATH_INFO: `/v3/users/98fe85f6eb3a42f89b20a9a8c17c5432` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:28:56.633988 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4784ea0-0cc3-43a5-8631-57cb7018a669 None admin] RBAC: Authorizing `identity:get_user(user_id=98fe85f6eb3a42f89b20a9a8c17c5432)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:28:56.635935 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4784ea0-0cc3-43a5-8631-57cb7018a669 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:28:56.638403 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 16/34] 10.222.0.15 () {56 vars in 1177 bytes} [Tue May 31 14:28:56 2022] GET /identity/v3/users/98fe85f6eb3a42f89b20a9a8c17c5432 => generated 247 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:28:56.640010 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1efd964-1196-419a-b906-0bac829d8f62 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:28:56.644535 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1efd964-1196-419a-b906-0bac829d8f62 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:28:56.645744 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1efd964-1196-419a-b906-0bac829d8f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:28:56.673865 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-f1efd964-1196-419a-b906-0bac829d8f62 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:28:56.675953 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-f1efd964-1196-419a-b906-0bac829d8f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:28:56.748892 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 17/35] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:28:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 14:28:56.750187 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1efd964-1196-419a-b906-0bac829d8f62 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:28:56.768975 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:28:56.779871 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 19/36] 10.222.0.15 () {60 vars in 1141 bytes} [Tue May 31 14:28:56 2022] POST /identity/v3/projects => generated 301 bytes in 453 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:28:56.783044 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5570a77e-ed47-4b74-8e3f-a75050d9a307 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:28:56.916647 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1efd964-1196-419a-b906-0bac829d8f62 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:28:56.944753 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5570a77e-ed47-4b74-8e3f-a75050d9a307 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:28:56.982375 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d33b6a8-1e90-4cf8-a9b1-7499b655b07e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:28:56.983744 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d33b6a8-1e90-4cf8-a9b1-7499b655b07e None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:28:56.984039 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d33b6a8-1e90-4cf8-a9b1-7499b655b07e None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:28:56.984320 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d33b6a8-1e90-4cf8-a9b1-7499b655b07e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:28:56.985611 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d33b6a8-1e90-4cf8-a9b1-7499b655b07e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:28:56.987269 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d33b6a8-1e90-4cf8-a9b1-7499b655b07e None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:28:56.988984 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 18/37] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:28:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:28:56.989658 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df7b436-6e44-4f9e-85fb-b660fea982b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:28:56.990241 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100e0431-0d60-4126-8f48-1b525ddff275 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:28:56.990530 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100e0431-0d60-4126-8f48-1b525ddff275 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:28:56.991056 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df7b436-6e44-4f9e-85fb-b660fea982b2 None admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:28:56.991582 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df7b436-6e44-4f9e-85fb-b660fea982b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:28:56.992071 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df7b436-6e44-4f9e-85fb-b660fea982b2 None admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:28:56.993016 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df7b436-6e44-4f9e-85fb-b660fea982b2 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:28:56.994837 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df7b436-6e44-4f9e-85fb-b660fea982b2 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:28:56.995412 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100e0431-0d60-4126-8f48-1b525ddff275 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:28:56.996966 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 19/38] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:28:56 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:28:56.998661 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100e0431-0d60-4126-8f48-1b525ddff275 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:28:57.060825 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 20/39] 10.222.0.15 () {60 vars in 1131 bytes} [Tue May 31 14:28:56 2022] POST /identity/v3/roles => generated 225 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:28:57.062236 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c11f5-7e2f-4011-aefe-8276c3020178 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:28:57.062527 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c11f5-7e2f-4011-aefe-8276c3020178 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:28:57.062842 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c11f5-7e2f-4011-aefe-8276c3020178 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:28:57.064153 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 21/40] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:28:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:28:57.068176 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583c9652-4d4f-43f4-acd8-ba5b83355785 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:28:57.068176 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583c9652-4d4f-43f4-acd8-ba5b83355785 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:28:57.068176 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583c9652-4d4f-43f4-acd8-ba5b83355785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:28:57.088108 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-583c9652-4d4f-43f4-acd8-ba5b83355785 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:28:57.090020 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-583c9652-4d4f-43f4-acd8-ba5b83355785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:28:57.095100 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:28:57.112150 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100e0431-0d60-4126-8f48-1b525ddff275 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:28:57.130937 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:28:57.153155 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb90875-dcfe-4ae6-87ce-0e4eaba7a84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:28:57.154055 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb90875-dcfe-4ae6-87ce-0e4eaba7a84f None admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:28:57.154347 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb90875-dcfe-4ae6-87ce-0e4eaba7a84f None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:28:57.154677 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb90875-dcfe-4ae6-87ce-0e4eaba7a84f None admin] PATH_INFO: `/v3/domains/default/users/98fe85f6eb3a42f89b20a9a8c17c5432/roles/76c53e2c353644f885028a0226c06146` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:28:57.157277 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb90875-dcfe-4ae6-87ce-0e4eaba7a84f None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=98fe85f6eb3a42f89b20a9a8c17c5432, role_id=76c53e2c353644f885028a0226c06146)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:28:57.159922 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb90875-dcfe-4ae6-87ce-0e4eaba7a84f None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:28:57.171114 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 22/41] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:28:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 14:28:57.172525 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4402b24-b0ce-4781-9256-5685495b1e96 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:28:57.172822 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4402b24-b0ce-4781-9256-5685495b1e96 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:28:57.173096 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4402b24-b0ce-4781-9256-5685495b1e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:28:57.192764 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-b4402b24-b0ce-4781-9256-5685495b1e96 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:28:57.193990 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-b4402b24-b0ce-4781-9256-5685495b1e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:28:57.231798 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 20/42] 10.222.0.15 () {58 vars in 1361 bytes} [Tue May 31 14:28:56 2022] PUT /identity/v3/domains/default/users/98fe85f6eb3a42f89b20a9a8c17c5432/roles/76c53e2c353644f885028a0226c06146 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:28:57.232611 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb90875-dcfe-4ae6-87ce-0e4eaba7a84f None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:28:57.276930 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 23/43] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:28:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 14:28:57.302490 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4402b24-b0ce-4781-9256-5685495b1e96 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:28:57.383285 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb90875-dcfe-4ae6-87ce-0e4eaba7a84f None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:28:57.420533 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71dcf16-47e7-43a9-b520-240f73d3fd90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:28:57.421351 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71dcf16-47e7-43a9-b520-240f73d3fd90 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:28:57.421643 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71dcf16-47e7-43a9-b520-240f73d3fd90 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:28:57.421929 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71dcf16-47e7-43a9-b520-240f73d3fd90 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:28:57.423193 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71dcf16-47e7-43a9-b520-240f73d3fd90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:28:57.424687 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71dcf16-47e7-43a9-b520-240f73d3fd90 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:28:57.426978 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 21/44] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:28:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:28:57.430798 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:28:57.433207 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71dcf16-47e7-43a9-b520-240f73d3fd90 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:28:57.435488 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4402b24-b0ce-4781-9256-5685495b1e96 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:28:57.454285 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:28:57.474722 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a81175c-f0b5-4ca7-8394-13af9acf0c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:28:57.475409 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a81175c-f0b5-4ca7-8394-13af9acf0c27 None admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:28:57.475700 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a81175c-f0b5-4ca7-8394-13af9acf0c27 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:28:57.475984 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a81175c-f0b5-4ca7-8394-13af9acf0c27 None admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:28:57.476745 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a81175c-f0b5-4ca7-8394-13af9acf0c27 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:28:57.478175 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a81175c-f0b5-4ca7-8394-13af9acf0c27 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:28:57.541625 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71dcf16-47e7-43a9-b520-240f73d3fd90 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:28:57.551199 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 24/45] 10.222.0.15 () {60 vars in 1131 bytes} [Tue May 31 14:28:57 2022] POST /identity/v3/roles => generated 223 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:28:57.579421 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4767acd4-a2e7-415b-8ccd-ca6ed9a9fd7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:28:57.580118 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767acd4-a2e7-415b-8ccd-ca6ed9a9fd7e None admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:28:57.580408 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767acd4-a2e7-415b-8ccd-ca6ed9a9fd7e None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:28:57.580686 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767acd4-a2e7-415b-8ccd-ca6ed9a9fd7e None admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:28:57.581427 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4767acd4-a2e7-415b-8ccd-ca6ed9a9fd7e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:28:57.583114 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4767acd4-a2e7-415b-8ccd-ca6ed9a9fd7e None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:28:57.696616 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 22/46] 10.222.0.15 () {60 vars in 1141 bytes} [Tue May 31 14:28:57 2022] POST /identity/v3/projects => generated 312 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 14:28:59.505267 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661646ed-54b6-4fa2-8bc0-6a237587fac4 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:28:59.505841 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661646ed-54b6-4fa2-8bc0-6a237587fac4 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:28:59.505932 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661646ed-54b6-4fa2-8bc0-6a237587fac4 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:28:59.507314 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 25/47] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:28:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:28:59.512574 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c835c3a3-8218-4dfb-b851-d719ae669159 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:28:59.513012 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c835c3a3-8218-4dfb-b851-d719ae669159 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:28:59.513257 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c835c3a3-8218-4dfb-b851-d719ae669159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:28:59.534653 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-c835c3a3-8218-4dfb-b851-d719ae669159 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:28:59.536414 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-c835c3a3-8218-4dfb-b851-d719ae669159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:28:59.593031 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:28:59.601654 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 23/48] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:28:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 31 14:28:59.625964 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661646ed-54b6-4fa2-8bc0-6a237587fac4 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:28:59.726919 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661646ed-54b6-4fa2-8bc0-6a237587fac4 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:28:59.758878 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613207c6-d707-464a-bf48-83c8b82d4c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:28:59.759661 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613207c6-d707-464a-bf48-83c8b82d4c7e None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:28:59.759946 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613207c6-d707-464a-bf48-83c8b82d4c7e None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:28:59.760224 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613207c6-d707-464a-bf48-83c8b82d4c7e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:28:59.770493 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613207c6-d707-464a-bf48-83c8b82d4c7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 14:28:59.778119 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-613207c6-d707-464a-bf48-83c8b82d4c7e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 31 14:28:59.778119 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:28:59.778119 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:28:59.778119 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:28:59.778119 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:28:59.778119 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:28:59.778119 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:28:59.778119 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:28:59.778119 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:28:59.778119 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:28:59.778119 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:28:59.778119 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:28:59.778119 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 14:28:59.778119 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 14:28:59.778119 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 14:28:59.778119 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 14:28:59.779177 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 14:28:59.779177 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 14:28:59.779177 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 14:28:59.779177 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 14:28:59.779177 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:28:59.779177 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:28:59.779177 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:28:59.779177 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:28:59.779177 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:28:59.779177 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:28:59.779177 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:28:59.779177 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:28:59.779177 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:28:59.779177 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:28:59.779177 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:28:59.779177 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:28:59.785011 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:28:59.785011 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:28:59.785011 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:28:59.785011 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:28:59.785011 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 14:28:59.785011 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 14:28:59.785011 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 14:28:59.785011 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 14:28:59.785011 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 14:28:59.785011 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 14:28:59.785011 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 31 14:28:59.785011 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:28:59.785011 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 26/49] 10.222.0.15 () {56 vars in 1096 bytes} [Tue May 31 14:28:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:28:59.785664 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c835c3a3-8218-4dfb-b851-d719ae669159 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:28:59.880129 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c835c3a3-8218-4dfb-b851-d719ae669159 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:28:59.912568 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d976d7ff-07dc-4818-9bef-b19de10fa7d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:28:59.913228 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d976d7ff-07dc-4818-9bef-b19de10fa7d9 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:28:59.913511 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d976d7ff-07dc-4818-9bef-b19de10fa7d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:28:59.913788 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d976d7ff-07dc-4818-9bef-b19de10fa7d9 None admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:28:59.914535 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d976d7ff-07dc-4818-9bef-b19de10fa7d9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:28:59.914871 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d976d7ff-07dc-4818-9bef-b19de10fa7d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:28:59.916253 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d976d7ff-07dc-4818-9bef-b19de10fa7d9 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:28:59.928337 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 24/50] 10.222.0.15 () {56 vars in 1099 bytes} [Tue May 31 14:28:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 14:28:59.933769 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613207c6-d707-464a-bf48-83c8b82d4c7e None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:28:59.952002 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d6231-9c4b-4719-8546-ab6516c9cfbc None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:28:59.952303 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d6231-9c4b-4719-8546-ab6516c9cfbc None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:28:59.952590 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d6231-9c4b-4719-8546-ab6516c9cfbc None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:28:59.953224 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:28:59.954051 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 25/51] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:28:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 31 14:28:59.959484 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ff5be-18da-4654-b322-b3eec9779083 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:28:59.959778 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ff5be-18da-4654-b322-b3eec9779083 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:28:59.960064 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ff5be-18da-4654-b322-b3eec9779083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:28:59.976248 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-9f1ff5be-18da-4654-b322-b3eec9779083 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:28:59.977451 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-9f1ff5be-18da-4654-b322-b3eec9779083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:29:00.027981 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:00.034823 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613207c6-d707-464a-bf48-83c8b82d4c7e None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:00.044143 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 26/52] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:28:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 31 14:29:00.068426 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1ff5be-18da-4654-b322-b3eec9779083 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:00.069077 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9151bdc2-05fd-4dff-b16f-a9cd3399ec40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:00.069957 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9151bdc2-05fd-4dff-b16f-a9cd3399ec40 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:00.070240 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9151bdc2-05fd-4dff-b16f-a9cd3399ec40 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:00.070656 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9151bdc2-05fd-4dff-b16f-a9cd3399ec40 None admin] PATH_INFO: `/v3/users/98fe85f6eb3a42f89b20a9a8c17c5432` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:00.071763 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9151bdc2-05fd-4dff-b16f-a9cd3399ec40 None admin] RBAC: Authorizing `identity:get_user(user_id=98fe85f6eb3a42f89b20a9a8c17c5432)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:00.073244 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9151bdc2-05fd-4dff-b16f-a9cd3399ec40 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:00.074922 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 27/53] 10.222.0.15 () {56 vars in 1177 bytes} [Tue May 31 14:28:59 2022] GET /identity/v3/users/98fe85f6eb3a42f89b20a9a8c17c5432 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:00.080027 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9151bdc2-05fd-4dff-b16f-a9cd3399ec40 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:00.163732 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:00.166503 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1ff5be-18da-4654-b322-b3eec9779083 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:00.178476 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9151bdc2-05fd-4dff-b16f-a9cd3399ec40 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:00.202381 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316fd6e2-aa48-4d3f-b751-11f96e6d4702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:00.203201 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316fd6e2-aa48-4d3f-b751-11f96e6d4702 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:00.203487 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316fd6e2-aa48-4d3f-b751-11f96e6d4702 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:00.203768 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316fd6e2-aa48-4d3f-b751-11f96e6d4702 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:00.204937 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316fd6e2-aa48-4d3f-b751-11f96e6d4702 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:00.206384 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316fd6e2-aa48-4d3f-b751-11f96e6d4702 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:00.208036 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 27/54] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:29:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 14:29:00.212216 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817598e1-cd38-4a1e-b50b-0bbbaa742863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:00.213011 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817598e1-cd38-4a1e-b50b-0bbbaa742863 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:00.213359 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817598e1-cd38-4a1e-b50b-0bbbaa742863 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:00.213506 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316fd6e2-aa48-4d3f-b751-11f96e6d4702 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:00.213642 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817598e1-cd38-4a1e-b50b-0bbbaa742863 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:00.214860 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817598e1-cd38-4a1e-b50b-0bbbaa742863 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:00.216354 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817598e1-cd38-4a1e-b50b-0bbbaa742863 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:00.217958 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 28/55] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:29:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 14:29:00.223422 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817598e1-cd38-4a1e-b50b-0bbbaa742863 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:00.266888 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:00.316979 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316fd6e2-aa48-4d3f-b751-11f96e6d4702 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:00.325713 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817598e1-cd38-4a1e-b50b-0bbbaa742863 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:00.356017 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad3320d-f0c9-4a1d-a6ef-6c2b9bc60d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:00.356692 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad3320d-f0c9-4a1d-a6ef-6c2b9bc60d5e None admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:00.356986 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad3320d-f0c9-4a1d-a6ef-6c2b9bc60d5e None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:00.357274 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad3320d-f0c9-4a1d-a6ef-6c2b9bc60d5e None admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:00.357982 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad3320d-f0c9-4a1d-a6ef-6c2b9bc60d5e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:00.359542 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad3320d-f0c9-4a1d-a6ef-6c2b9bc60d5e None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:00.364690 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68516324-8cf0-4a93-a2da-88481c9b789a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:00.365402 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68516324-8cf0-4a93-a2da-88481c9b789a None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:00.365708 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68516324-8cf0-4a93-a2da-88481c9b789a None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:00.365932 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68516324-8cf0-4a93-a2da-88481c9b789a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:00.366810 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68516324-8cf0-4a93-a2da-88481c9b789a None admin] RBAC: Adding query filter params (role.id=76c53e2c353644f885028a0226c06146, scope.domain.id=default, user.id=98fe85f6eb3a42f89b20a9a8c17c5432) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:29:00.367131 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68516324-8cf0-4a93-a2da-88481c9b789a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:00.368561 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68516324-8cf0-4a93-a2da-88481c9b789a None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:00.374284 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 29/56] 10.222.0.15 () {56 vars in 1322 bytes} [Tue May 31 14:29:00 2022] GET /identity/v3/role_assignments?user.id=98fe85f6eb3a42f89b20a9a8c17c5432&scope.domain.id=default&role.id=76c53e2c353644f885028a0226c06146 => generated 530 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 14:29:00.465893 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 28/57] 10.222.0.15 () {60 vars in 1140 bytes} [Tue May 31 14:29:00 2022] POST /identity/v3/projects => generated 298 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 14:29:02.732012 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ab71d-b4f7-4b88-92aa-87804ade0667 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:02.732516 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ab71d-b4f7-4b88-92aa-87804ade0667 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:02.732516 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ab71d-b4f7-4b88-92aa-87804ade0667 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:02.733893 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 30/58] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:29:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:29:02.739265 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982372d0-8fcf-412e-b20b-19201920c3ab None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:02.739675 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982372d0-8fcf-412e-b20b-19201920c3ab None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:02.739822 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982372d0-8fcf-412e-b20b-19201920c3ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:02.756375 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-982372d0-8fcf-412e-b20b-19201920c3ab None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:29:02.757537 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-982372d0-8fcf-412e-b20b-19201920c3ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:29:02.821492 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 29/59] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:29:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 14:29:02.845775 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756ab71d-b4f7-4b88-92aa-87804ade0667 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:02.864059 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:02.943606 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756ab71d-b4f7-4b88-92aa-87804ade0667 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:02.975464 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b4391c-d9f8-448f-816f-2e5c5259972a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:02.976243 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b4391c-d9f8-448f-816f-2e5c5259972a None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:02.976528 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b4391c-d9f8-448f-816f-2e5c5259972a None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:02.976806 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b4391c-d9f8-448f-816f-2e5c5259972a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:02.977963 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b4391c-d9f8-448f-816f-2e5c5259972a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:02.979431 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b4391c-d9f8-448f-816f-2e5c5259972a None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:02.980998 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 31/60] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:29:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:02.986453 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982372d0-8fcf-412e-b20b-19201920c3ab None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:03.020447 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:03.082541 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982372d0-8fcf-412e-b20b-19201920c3ab None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:03.114762 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d4d514-84d8-4abd-94da-9265755f57e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:03.115420 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d4d514-84d8-4abd-94da-9265755f57e1 None admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:03.115708 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d4d514-84d8-4abd-94da-9265755f57e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:03.115989 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d4d514-84d8-4abd-94da-9265755f57e1 None admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:03.116699 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d4d514-84d8-4abd-94da-9265755f57e1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:03.118152 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d4d514-84d8-4abd-94da-9265755f57e1 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:03.190571 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 30/61] 10.222.0.15 () {60 vars in 1132 bytes} [Tue May 31 14:29:02 2022] POST /identity/v3/users => generated 275 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:29:06.738315 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b516b2-175d-4853-8db5-412c126bf2c9 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:06.739167 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b516b2-175d-4853-8db5-412c126bf2c9 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:06.739631 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b516b2-175d-4853-8db5-412c126bf2c9 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:06.741753 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 32/62] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:29:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:29:06.747583 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b09499-bee7-45c2-b13d-96bb8ae695e8 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:06.748359 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b09499-bee7-45c2-b13d-96bb8ae695e8 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:06.748786 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b09499-bee7-45c2-b13d-96bb8ae695e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:06.771811 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-b7b09499-bee7-45c2-b13d-96bb8ae695e8 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:29:06.773329 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-b7b09499-bee7-45c2-b13d-96bb8ae695e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:29:06.860909 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 31/63] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:29:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 14:29:06.873324 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88564d66-762e-4a64-91d3-81040f3187e1 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:06.873484 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e747458-67f3-4c12-a8c9-2e973f38d4d0 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:06.873700 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e747458-67f3-4c12-a8c9-2e973f38d4d0 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:06.873900 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e747458-67f3-4c12-a8c9-2e973f38d4d0 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:06.874384 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88564d66-762e-4a64-91d3-81040f3187e1 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:06.874907 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88564d66-762e-4a64-91d3-81040f3187e1 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:06.875293 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 33/64] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:29:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:29:06.876680 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 32/65] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:29:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:29:06.881432 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b6be8-7f7e-4990-9e11-67371c726644 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:06.881968 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b6be8-7f7e-4990-9e11-67371c726644 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:06.882464 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b6be8-7f7e-4990-9e11-67371c726644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:06.882605 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ac6d7c-9f92-42c0-895a-c9324af3c9ec None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:06.882969 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ac6d7c-9f92-42c0-895a-c9324af3c9ec None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:06.883265 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ac6d7c-9f92-42c0-895a-c9324af3c9ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:06.903497 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-371b6be8-7f7e-4990-9e11-67371c726644 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:29:06.904257 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-16ac6d7c-9f92-42c0-895a-c9324af3c9ec None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:29:06.905288 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-371b6be8-7f7e-4990-9e11-67371c726644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:29:06.905406 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-16ac6d7c-9f92-42c0-895a-c9324af3c9ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:29:06.923235 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:06.982576 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 33/66] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:29:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 31 14:29:06.982576 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ac6d7c-9f92-42c0-895a-c9324af3c9ec None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:06.983301 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 34/67] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:29:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 14:29:07.004265 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b6be8-7f7e-4990-9e11-67371c726644 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:07.027077 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:07.096674 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ac6d7c-9f92-42c0-895a-c9324af3c9ec None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:07.109775 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b6be8-7f7e-4990-9e11-67371c726644 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:07.130091 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa27f7a-9ae2-4237-839e-8b750340f0f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:07.131634 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa27f7a-9ae2-4237-839e-8b750340f0f9 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:07.131927 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa27f7a-9ae2-4237-839e-8b750340f0f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:07.132213 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa27f7a-9ae2-4237-839e-8b750340f0f9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:07.142302 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa27f7a-9ae2-4237-839e-8b750340f0f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 14:29:07.142454 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74024cdd-4512-4e04-9523-53f27b99bf17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:07.143254 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74024cdd-4512-4e04-9523-53f27b99bf17 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:07.143548 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74024cdd-4512-4e04-9523-53f27b99bf17 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:07.143828 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74024cdd-4512-4e04-9523-53f27b99bf17 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:07.150564 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-7aa27f7a-9ae2-4237-839e-8b750340f0f9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 31 14:29:07.150564 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:29:07.150564 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:29:07.150564 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:29:07.150564 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:29:07.150564 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:29:07.150564 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:29:07.150564 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:29:07.150564 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:29:07.150564 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:29:07.150564 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:29:07.150564 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:29:07.150564 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 14:29:07.150564 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 14:29:07.150564 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 14:29:07.150564 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 14:29:07.151389 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 14:29:07.151389 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 14:29:07.151389 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 14:29:07.151389 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 14:29:07.151389 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:29:07.151389 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:29:07.151389 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:29:07.151389 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:29:07.151389 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:29:07.151389 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:29:07.151389 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:29:07.151389 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:29:07.151389 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:29:07.151389 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:29:07.151389 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:29:07.151389 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:29:07.157402 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:29:07.157402 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:29:07.157402 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:29:07.157402 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:29:07.157402 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 14:29:07.157402 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 14:29:07.157402 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 14:29:07.157402 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 14:29:07.157402 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 14:29:07.157402 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 14:29:07.157402 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 31 14:29:07.157402 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:29:07.157402 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 34/68] 10.222.0.15 () {56 vars in 1096 bytes} [Tue May 31 14:29:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:29:07.157402 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa27f7a-9ae2-4237-839e-8b750340f0f9 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:07.158270 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74024cdd-4512-4e04-9523-53f27b99bf17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 14:29:07.161722 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-74024cdd-4512-4e04-9523-53f27b99bf17 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 31 14:29:07.161722 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:29:07.161722 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:29:07.161722 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:29:07.161722 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:29:07.161722 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:29:07.161722 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:29:07.161722 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:29:07.161722 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:29:07.161722 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:29:07.161722 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:29:07.161722 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:29:07.161722 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 14:29:07.161722 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 14:29:07.161722 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 14:29:07.161722 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 14:29:07.163349 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 14:29:07.163349 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 14:29:07.163349 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 14:29:07.163349 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 14:29:07.163349 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:29:07.163349 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:29:07.163349 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:29:07.163349 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:29:07.163349 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:29:07.163349 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:29:07.163349 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:29:07.163349 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:29:07.163349 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:29:07.163349 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:29:07.163349 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:29:07.163349 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:29:07.164789 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:29:07.164789 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:29:07.164789 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:29:07.164789 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:29:07.164789 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 14:29:07.164789 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 14:29:07.164789 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 14:29:07.164789 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 14:29:07.164789 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 14:29:07.164789 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 14:29:07.164789 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 31 14:29:07.164789 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:29:07.164789 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 35/69] 10.222.0.15 () {56 vars in 1099 bytes} [Tue May 31 14:29:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:29:07.164789 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a0f2f1-7f91-4a78-b433-4301a947326f None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:07.166445 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a0f2f1-7f91-4a78-b433-4301a947326f None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:07.166445 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a0f2f1-7f91-4a78-b433-4301a947326f None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:07.166445 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 36/70] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:29:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:29:07.167464 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec95e0-3c03-4fa2-9c7c-5913dae90840 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:07.167772 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec95e0-3c03-4fa2-9c7c-5913dae90840 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:07.172443 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec95e0-3c03-4fa2-9c7c-5913dae90840 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:07.172443 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 37/71] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:29:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:29:07.172443 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdec95e0-3c03-4fa2-9c7c-5913dae90840 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:07.176183 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:07.245675 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:07.259932 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa27f7a-9ae2-4237-839e-8b750340f0f9 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:07.268286 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdec95e0-3c03-4fa2-9c7c-5913dae90840 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:07.300578 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8914eb6-a7b8-4180-94f9-343bee0280d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:07.301503 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8914eb6-a7b8-4180-94f9-343bee0280d7 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:07.301860 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8914eb6-a7b8-4180-94f9-343bee0280d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:07.302209 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8914eb6-a7b8-4180-94f9-343bee0280d7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:07.302936 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee85ab0-f48a-4355-b065-4280128aa911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:07.304097 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee85ab0-f48a-4355-b065-4280128aa911 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:07.304380 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee85ab0-f48a-4355-b065-4280128aa911 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:07.304656 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee85ab0-f48a-4355-b065-4280128aa911 None admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:07.307708 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee85ab0-f48a-4355-b065-4280128aa911 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:29:07.308028 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee85ab0-f48a-4355-b065-4280128aa911 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:07.309451 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee85ab0-f48a-4355-b065-4280128aa911 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:07.313671 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8914eb6-a7b8-4180-94f9-343bee0280d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 14:29:07.317955 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 38/72] 10.222.0.15 () {56 vars in 1099 bytes} [Tue May 31 14:29:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:07.318803 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee85ab0-f48a-4355-b065-4280128aa911 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:07.321914 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-c8914eb6-a7b8-4180-94f9-343bee0280d7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 31 14:29:07.321914 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:29:07.321914 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:29:07.321914 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:29:07.321914 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:29:07.321914 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:29:07.321914 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:29:07.321914 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:29:07.321914 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:29:07.321914 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:29:07.321914 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:29:07.321914 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:29:07.321914 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 14:29:07.321914 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 14:29:07.321914 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 14:29:07.321914 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 14:29:07.322815 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 14:29:07.322815 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 14:29:07.322815 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 14:29:07.322815 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 14:29:07.322815 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:29:07.322815 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:29:07.322815 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:29:07.322815 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:29:07.322815 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:29:07.322815 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:29:07.322815 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:29:07.322815 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:29:07.322815 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:29:07.322815 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:29:07.322815 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:29:07.322815 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:29:07.323577 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:29:07.323577 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:29:07.323577 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:29:07.323577 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:29:07.323577 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 14:29:07.323577 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 14:29:07.323577 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 14:29:07.323577 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 14:29:07.323577 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 14:29:07.323577 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 14:29:07.323577 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 31 14:29:07.323577 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:29:07.323577 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 35/73] 10.222.0.15 () {56 vars in 1114 bytes} [Tue May 31 14:29:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:29:07.324529 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8430dc5-cdcb-46ba-93d9-ecc3acc60189 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:07.324820 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8430dc5-cdcb-46ba-93d9-ecc3acc60189 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:07.325107 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8430dc5-cdcb-46ba-93d9-ecc3acc60189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:07.341316 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-f8430dc5-cdcb-46ba-93d9-ecc3acc60189 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:29:07.342506 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-f8430dc5-cdcb-46ba-93d9-ecc3acc60189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:29:07.411449 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 36/74] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:29:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 14:29:07.413257 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dcee73-e2d3-4375-85b3-c60561110771 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:07.413548 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dcee73-e2d3-4375-85b3-c60561110771 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:07.413827 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dcee73-e2d3-4375-85b3-c60561110771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:07.420819 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee85ab0-f48a-4355-b065-4280128aa911 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:07.427135 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:07.441776 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-00dcee73-e2d3-4375-85b3-c60561110771 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:29:07.442986 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-00dcee73-e2d3-4375-85b3-c60561110771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:29:07.453917 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e1236f-5c26-4d12-a7c2-4b6e213c8e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:07.454612 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e1236f-5c26-4d12-a7c2-4b6e213c8e2a None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:07.454901 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e1236f-5c26-4d12-a7c2-4b6e213c8e2a None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:07.455180 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e1236f-5c26-4d12-a7c2-4b6e213c8e2a None admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:07.455927 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e1236f-5c26-4d12-a7c2-4b6e213c8e2a None admin] RBAC: Adding query filter params (name=member) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:29:07.456234 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e1236f-5c26-4d12-a7c2-4b6e213c8e2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:07.457632 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e1236f-5c26-4d12-a7c2-4b6e213c8e2a None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:07.462682 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:07.466435 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 39/75] 10.222.0.15 () {56 vars in 1101 bytes} [Tue May 31 14:29:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:07.467242 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e1236f-5c26-4d12-a7c2-4b6e213c8e2a None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:07.508864 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 37/76] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:29:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 14:29:07.509555 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dcee73-e2d3-4375-85b3-c60561110771 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:07.566147 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e1236f-5c26-4d12-a7c2-4b6e213c8e2a None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:07.598904 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af0cb31-ee94-4760-91cb-cf12dd8029c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:07.599807 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af0cb31-ee94-4760-91cb-cf12dd8029c6 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:07.600090 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af0cb31-ee94-4760-91cb-cf12dd8029c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:07.600376 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af0cb31-ee94-4760-91cb-cf12dd8029c6 None admin] PATH_INFO: `/v3/users/98fe85f6eb3a42f89b20a9a8c17c5432` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:07.601566 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af0cb31-ee94-4760-91cb-cf12dd8029c6 None admin] RBAC: Authorizing `identity:get_user(user_id=98fe85f6eb3a42f89b20a9a8c17c5432)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:07.603034 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af0cb31-ee94-4760-91cb-cf12dd8029c6 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:07.604626 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 40/77] 10.222.0.15 () {56 vars in 1177 bytes} [Tue May 31 14:29:07 2022] GET /identity/v3/users/98fe85f6eb3a42f89b20a9a8c17c5432 => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:07.605377 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af0cb31-ee94-4760-91cb-cf12dd8029c6 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:07.606066 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dcee73-e2d3-4375-85b3-c60561110771 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:07.635852 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:07.640816 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e593077-6a72-4e43-8b02-3aa2da49170a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:07.641485 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e593077-6a72-4e43-8b02-3aa2da49170a None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:07.641775 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e593077-6a72-4e43-8b02-3aa2da49170a None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:07.642059 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e593077-6a72-4e43-8b02-3aa2da49170a None admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:07.643079 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e593077-6a72-4e43-8b02-3aa2da49170a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:29:07.643394 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e593077-6a72-4e43-8b02-3aa2da49170a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:07.644800 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e593077-6a72-4e43-8b02-3aa2da49170a None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:07.652649 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 38/78] 10.222.0.15 () {56 vars in 1111 bytes} [Tue May 31 14:29:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:07.653446 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e593077-6a72-4e43-8b02-3aa2da49170a None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:07.671750 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:07.705115 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af0cb31-ee94-4760-91cb-cf12dd8029c6 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:07.739048 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397436f6-4a93-4c0c-8a22-f7ec841f08a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:07.739825 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397436f6-4a93-4c0c-8a22-f7ec841f08a2 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:07.740628 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397436f6-4a93-4c0c-8a22-f7ec841f08a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:07.740915 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397436f6-4a93-4c0c-8a22-f7ec841f08a2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:07.750942 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397436f6-4a93-4c0c-8a22-f7ec841f08a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 14:29:07.757771 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e593077-6a72-4e43-8b02-3aa2da49170a None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:07.759330 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-397436f6-4a93-4c0c-8a22-f7ec841f08a2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 31 14:29:07.759330 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:29:07.759330 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:29:07.759330 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:29:07.759330 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:29:07.759330 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:29:07.759330 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:29:07.759330 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:29:07.759330 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:29:07.759330 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:29:07.759330 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:29:07.759330 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:29:07.759330 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 14:29:07.759330 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 14:29:07.759330 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 14:29:07.759330 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 14:29:07.760177 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 14:29:07.760177 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 14:29:07.760177 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 14:29:07.760177 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 14:29:07.760177 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:29:07.760177 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:29:07.760177 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:29:07.760177 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:29:07.760177 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:29:07.760177 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:29:07.760177 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:29:07.760177 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:29:07.760177 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:29:07.760177 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:29:07.760177 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:29:07.760177 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:29:07.760942 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:29:07.760942 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:29:07.760942 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:29:07.760942 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:29:07.760942 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 14:29:07.760942 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 14:29:07.760942 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 14:29:07.760942 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 14:29:07.760942 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 14:29:07.760942 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 14:29:07.760942 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 31 14:29:07.760942 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:29:07.760942 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 41/79] 10.222.0.15 () {56 vars in 1099 bytes} [Tue May 31 14:29:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:29:07.761582 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397436f6-4a93-4c0c-8a22-f7ec841f08a2 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:07.794857 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd9a7de-2678-40e8-9efd-9a4720024d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:07.796238 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd9a7de-2678-40e8-9efd-9a4720024d0b None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:07.796677 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd9a7de-2678-40e8-9efd-9a4720024d0b None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:07.797114 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd9a7de-2678-40e8-9efd-9a4720024d0b None admin] PATH_INFO: `/v3/users/6c51550d3d834029bb4659c457cb292f` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:07.813822 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd9a7de-2678-40e8-9efd-9a4720024d0b None admin] RBAC: Authorizing `identity:get_user(user_id=6c51550d3d834029bb4659c457cb292f)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:07.815324 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd9a7de-2678-40e8-9efd-9a4720024d0b None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:07.817053 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 39/80] 10.222.0.15 () {56 vars in 1177 bytes} [Tue May 31 14:29:07 2022] GET /identity/v3/users/6c51550d3d834029bb4659c457cb292f => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:07.817752 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd9a7de-2678-40e8-9efd-9a4720024d0b None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:07.859314 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397436f6-4a93-4c0c-8a22-f7ec841f08a2 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:07.871332 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:07.886904 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:07.894697 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c740d2-3122-485a-b036-8b8ef26b9189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:07.895480 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c740d2-3122-485a-b036-8b8ef26b9189 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:07.895764 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c740d2-3122-485a-b036-8b8ef26b9189 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:07.896039 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c740d2-3122-485a-b036-8b8ef26b9189 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:07.897328 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c740d2-3122-485a-b036-8b8ef26b9189 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:07.898834 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c740d2-3122-485a-b036-8b8ef26b9189 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:07.900449 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 42/81] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:29:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:07.901204 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c740d2-3122-485a-b036-8b8ef26b9189 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:07.920892 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd9a7de-2678-40e8-9efd-9a4720024d0b None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:07.953679 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93328a3d-32ca-49c2-84c9-699867491531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:07.954324 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93328a3d-32ca-49c2-84c9-699867491531 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:07.954638 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93328a3d-32ca-49c2-84c9-699867491531 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:07.954930 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93328a3d-32ca-49c2-84c9-699867491531 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:08.001112 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c740d2-3122-485a-b036-8b8ef26b9189 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:08.026409 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93328a3d-32ca-49c2-84c9-699867491531 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:08.027938 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93328a3d-32ca-49c2-84c9-699867491531 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:08.035725 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de923b7-0797-49e8-b4f4-25c54394fee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:08.036613 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de923b7-0797-49e8-b4f4-25c54394fee7 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:08.037380 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de923b7-0797-49e8-b4f4-25c54394fee7 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:08.037668 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de923b7-0797-49e8-b4f4-25c54394fee7 None admin] PATH_INFO: `/v3/users/6c51550d3d834029bb4659c457cb292f` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:08.038912 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de923b7-0797-49e8-b4f4-25c54394fee7 None admin] RBAC: Authorizing `identity:get_user(user_id=6c51550d3d834029bb4659c457cb292f)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:08.040372 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de923b7-0797-49e8-b4f4-25c54394fee7 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:08.041989 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 43/82] 10.222.0.15 () {56 vars in 1177 bytes} [Tue May 31 14:29:07 2022] GET /identity/v3/users/6c51550d3d834029bb4659c457cb292f => generated 275 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:08.042774 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de923b7-0797-49e8-b4f4-25c54394fee7 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:08.079489 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:08.104576 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:08.127587 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 40/83] 10.222.0.15 () {58 vars in 1282 bytes} [Tue May 31 14:29:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 31 14:29:08.128716 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93328a3d-32ca-49c2-84c9-699867491531 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:08.142504 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de923b7-0797-49e8-b4f4-25c54394fee7 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:08.175199 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337a649d-b0e4-43dc-8ee4-84dddefe7682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:08.175930 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a649d-b0e4-43dc-8ee4-84dddefe7682 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:08.176218 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a649d-b0e4-43dc-8ee4-84dddefe7682 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:08.176499 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a649d-b0e4-43dc-8ee4-84dddefe7682 None admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:08.177240 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337a649d-b0e4-43dc-8ee4-84dddefe7682 None admin] RBAC: Adding query filter params (name=member) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:29:08.177580 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337a649d-b0e4-43dc-8ee4-84dddefe7682 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:08.179011 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337a649d-b0e4-43dc-8ee4-84dddefe7682 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:08.186802 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 44/84] 10.222.0.15 () {56 vars in 1101 bytes} [Tue May 31 14:29:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:08.187552 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337a649d-b0e4-43dc-8ee4-84dddefe7682 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:08.228424 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93328a3d-32ca-49c2-84c9-699867491531 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:08.262516 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1553cf46-6325-4810-9903-2d18e8c5079f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:08.263200 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1553cf46-6325-4810-9903-2d18e8c5079f None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:08.263496 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1553cf46-6325-4810-9903-2d18e8c5079f None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:08.263787 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1553cf46-6325-4810-9903-2d18e8c5079f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:08.284369 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:08.289126 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337a649d-b0e4-43dc-8ee4-84dddefe7682 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:08.314977 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:08.324464 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa97033a-c582-44a0-a167-38c8508b34a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:08.325140 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa97033a-c582-44a0-a167-38c8508b34a2 None admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:08.327750 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa97033a-c582-44a0-a167-38c8508b34a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:08.327750 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa97033a-c582-44a0-a167-38c8508b34a2 None admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:08.327750 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa97033a-c582-44a0-a167-38c8508b34a2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:08.328425 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa97033a-c582-44a0-a167-38c8508b34a2 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:08.331492 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1553cf46-6325-4810-9903-2d18e8c5079f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:08.332911 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1553cf46-6325-4810-9903-2d18e8c5079f None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:08.427386 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 41/85] 10.222.0.15 () {58 vars in 1282 bytes} [Tue May 31 14:29:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 31 14:29:08.429068 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1553cf46-6325-4810-9903-2d18e8c5079f None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:08.437600 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 45/86] 10.222.0.15 () {60 vars in 1132 bytes} [Tue May 31 14:29:08 2022] POST /identity/v3/users => generated 289 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:29:08.438602 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa97033a-c582-44a0-a167-38c8508b34a2 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:08.501232 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:08.556914 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa97033a-c582-44a0-a167-38c8508b34a2 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:08.559459 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1553cf46-6325-4810-9903-2d18e8c5079f None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:08.595059 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176fc0f0-264a-4a1c-9a59-b4345f1be2be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:08.595246 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92441c2-868e-4b7d-a558-8ff464905e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:08.595638 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176fc0f0-264a-4a1c-9a59-b4345f1be2be None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:08.595935 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176fc0f0-264a-4a1c-9a59-b4345f1be2be None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:08.596087 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92441c2-868e-4b7d-a558-8ff464905e2b None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:08.596234 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176fc0f0-264a-4a1c-9a59-b4345f1be2be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:08.596376 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92441c2-868e-4b7d-a558-8ff464905e2b None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:08.596644 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92441c2-868e-4b7d-a558-8ff464905e2b None admin] PATH_INFO: `/v3/projects/6a0fafbf41854f8ab937e416e30b1892` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:08.597948 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92441c2-868e-4b7d-a558-8ff464905e2b None admin] RBAC: Authorizing `identity:get_project(project_id=6a0fafbf41854f8ab937e416e30b1892)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:08.599516 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92441c2-868e-4b7d-a558-8ff464905e2b None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:08.606324 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 46/87] 10.222.0.15 () {56 vars in 1186 bytes} [Tue May 31 14:29:08 2022] GET /identity/v3/projects/6a0fafbf41854f8ab937e416e30b1892 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:08.606324 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92441c2-868e-4b7d-a558-8ff464905e2b None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:08.668697 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:08.675846 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176fc0f0-264a-4a1c-9a59-b4345f1be2be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:08.677323 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176fc0f0-264a-4a1c-9a59-b4345f1be2be None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:08.726933 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92441c2-868e-4b7d-a558-8ff464905e2b None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:08.739596 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:08.769304 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3787d91c-5322-478e-8646-adcfc77f7597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:08.770195 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3787d91c-5322-478e-8646-adcfc77f7597 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:08.770479 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3787d91c-5322-478e-8646-adcfc77f7597 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:08.770791 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3787d91c-5322-478e-8646-adcfc77f7597 None admin] PATH_INFO: `/v3/users/6c51550d3d834029bb4659c457cb292f` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:08.772564 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3787d91c-5322-478e-8646-adcfc77f7597 None admin] RBAC: Authorizing `identity:get_user(user_id=6c51550d3d834029bb4659c457cb292f)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:08.774037 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3787d91c-5322-478e-8646-adcfc77f7597 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:08.775961 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 47/88] 10.222.0.15 () {56 vars in 1177 bytes} [Tue May 31 14:29:08 2022] GET /identity/v3/users/6c51550d3d834029bb4659c457cb292f => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:08.776571 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3787d91c-5322-478e-8646-adcfc77f7597 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:08.797808 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 42/89] 10.222.0.15 () {58 vars in 1282 bytes} [Tue May 31 14:29:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 31 14:29:08.799243 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176fc0f0-264a-4a1c-9a59-b4345f1be2be None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:08.900139 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3787d91c-5322-478e-8646-adcfc77f7597 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:08.911262 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176fc0f0-264a-4a1c-9a59-b4345f1be2be None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:08.925018 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:08.945796 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed9cac7-1650-4fef-b599-930cc7a58817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:08.947138 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed9cac7-1650-4fef-b599-930cc7a58817 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:08.947646 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed9cac7-1650-4fef-b599-930cc7a58817 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:08.947754 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce7ab93-ab7a-4335-9b9f-29630ae3dcb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:08.948171 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed9cac7-1650-4fef-b599-930cc7a58817 None admin] PATH_INFO: `/v3/projects/6a0fafbf41854f8ab937e416e30b1892` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:08.948338 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce7ab93-ab7a-4335-9b9f-29630ae3dcb5 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:08.948631 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce7ab93-ab7a-4335-9b9f-29630ae3dcb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:08.948912 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce7ab93-ab7a-4335-9b9f-29630ae3dcb5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:08.949741 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce7ab93-ab7a-4335-9b9f-29630ae3dcb5 None admin] RBAC: Adding query filter params (role.id=76c53e2c353644f885028a0226c06146, scope.project.id=6a0fafbf41854f8ab937e416e30b1892, user.id=98fe85f6eb3a42f89b20a9a8c17c5432) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:29:08.950052 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce7ab93-ab7a-4335-9b9f-29630ae3dcb5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:08.950245 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed9cac7-1650-4fef-b599-930cc7a58817 None admin] RBAC: Authorizing `identity:get_project(project_id=6a0fafbf41854f8ab937e416e30b1892)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:08.951561 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce7ab93-ab7a-4335-9b9f-29630ae3dcb5 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:08.952073 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed9cac7-1650-4fef-b599-930cc7a58817 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:08.954045 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 48/90] 10.222.0.15 () {56 vars in 1186 bytes} [Tue May 31 14:29:08 2022] GET /identity/v3/projects/6a0fafbf41854f8ab937e416e30b1892 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:08.954992 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed9cac7-1650-4fef-b599-930cc7a58817 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:08.963690 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 43/91] 10.222.0.15 () {56 vars in 1374 bytes} [Tue May 31 14:29:08 2022] GET /identity/v3/role_assignments?user.id=98fe85f6eb3a42f89b20a9a8c17c5432&scope.project.id=6a0fafbf41854f8ab937e416e30b1892&role.id=76c53e2c353644f885028a0226c06146 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:08.964909 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce7ab93-ab7a-4335-9b9f-29630ae3dcb5 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:08.999434 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:09.174276 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed9cac7-1650-4fef-b599-930cc7a58817 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:09.193555 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce7ab93-ab7a-4335-9b9f-29630ae3dcb5 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:09.223893 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e16368b-3413-4f14-96ee-b7803266edd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:09.225370 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e16368b-3413-4f14-96ee-b7803266edd4 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:09.226426 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e16368b-3413-4f14-96ee-b7803266edd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:09.226890 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e16368b-3413-4f14-96ee-b7803266edd4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:09.248956 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f53788-9b38-4760-aa5a-4c6d2833c434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:09.250092 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f53788-9b38-4760-aa5a-4c6d2833c434 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:09.250521 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f53788-9b38-4760-aa5a-4c6d2833c434 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:09.250964 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f53788-9b38-4760-aa5a-4c6d2833c434 None admin] PATH_INFO: `/v3/projects/6a0fafbf41854f8ab937e416e30b1892` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:09.253794 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f53788-9b38-4760-aa5a-4c6d2833c434 None admin] RBAC: Authorizing `identity:get_project(project_id=6a0fafbf41854f8ab937e416e30b1892)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:09.256253 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f53788-9b38-4760-aa5a-4c6d2833c434 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:09.259833 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 44/92] 10.222.0.15 () {56 vars in 1186 bytes} [Tue May 31 14:29:08 2022] GET /identity/v3/projects/6a0fafbf41854f8ab937e416e30b1892 => generated 298 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:09.262978 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f53788-9b38-4760-aa5a-4c6d2833c434 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:09.334914 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:09.358783 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e16368b-3413-4f14-96ee-b7803266edd4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:09.360301 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e16368b-3413-4f14-96ee-b7803266edd4 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:09.434424 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:09.464888 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f53788-9b38-4760-aa5a-4c6d2833c434 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:09.501657 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 49/93] 10.222.0.15 () {58 vars in 1282 bytes} [Tue May 31 14:29:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 547 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 31 14:29:09.504079 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e16368b-3413-4f14-96ee-b7803266edd4 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:09.523126 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792c83b1-791f-4fd8-818d-28d4a76e7e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:09.524136 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792c83b1-791f-4fd8-818d-28d4a76e7e26 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:09.524651 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792c83b1-791f-4fd8-818d-28d4a76e7e26 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:09.525148 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792c83b1-791f-4fd8-818d-28d4a76e7e26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:09.526190 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792c83b1-791f-4fd8-818d-28d4a76e7e26 None admin] RBAC: Adding query filter params (role.id=317f725e26bf43648d8235bb1f7c4cb3, scope.project.id=6a0fafbf41854f8ab937e416e30b1892, user.id=6c51550d3d834029bb4659c457cb292f) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:29:09.526747 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792c83b1-791f-4fd8-818d-28d4a76e7e26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:09.528456 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792c83b1-791f-4fd8-818d-28d4a76e7e26 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:09.541091 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 45/94] 10.222.0.15 () {56 vars in 1374 bytes} [Tue May 31 14:29:09 2022] GET /identity/v3/role_assignments?user.id=6c51550d3d834029bb4659c457cb292f&scope.project.id=6a0fafbf41854f8ab937e416e30b1892&role.id=317f725e26bf43648d8235bb1f7c4cb3 => generated 259 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:09.542619 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792c83b1-791f-4fd8-818d-28d4a76e7e26 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:09.650017 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:09.667061 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e16368b-3413-4f14-96ee-b7803266edd4 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:09.706067 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7183167-ca82-4fa9-a2ec-028661d7b638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:09.707115 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7183167-ca82-4fa9-a2ec-028661d7b638 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:09.707597 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7183167-ca82-4fa9-a2ec-028661d7b638 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:09.708053 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7183167-ca82-4fa9-a2ec-028661d7b638 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:09.709633 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7183167-ca82-4fa9-a2ec-028661d7b638 None admin] RBAC: Adding query filter params (role.id=86e29729720b4d53b2a375a337765a2d, scope.project.id=6a0fafbf41854f8ab937e416e30b1892, user.id=6c51550d3d834029bb4659c457cb292f) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:29:09.710129 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7183167-ca82-4fa9-a2ec-028661d7b638 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:09.711855 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7183167-ca82-4fa9-a2ec-028661d7b638 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:09.718911 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 50/95] 10.222.0.15 () {56 vars in 1374 bytes} [Tue May 31 14:29:09 2022] GET /identity/v3/role_assignments?user.id=6c51550d3d834029bb4659c457cb292f&scope.project.id=6a0fafbf41854f8ab937e416e30b1892&role.id=86e29729720b4d53b2a375a337765a2d => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:09.775392 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792c83b1-791f-4fd8-818d-28d4a76e7e26 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:09.825879 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c947f4-9917-4521-9c5e-5b02d8533c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:09.826777 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c947f4-9917-4521-9c5e-5b02d8533c79 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:09.827116 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c947f4-9917-4521-9c5e-5b02d8533c79 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:09.827400 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c947f4-9917-4521-9c5e-5b02d8533c79 None admin] PATH_INFO: `/v3/projects/629deba768dc4387b5a04362543efc3e` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:09.828805 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c947f4-9917-4521-9c5e-5b02d8533c79 None admin] RBAC: Authorizing `identity:get_project(project_id=629deba768dc4387b5a04362543efc3e)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:09.830300 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c947f4-9917-4521-9c5e-5b02d8533c79 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:09.832195 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 46/96] 10.222.0.15 () {56 vars in 1186 bytes} [Tue May 31 14:29:09 2022] GET /identity/v3/projects/629deba768dc4387b5a04362543efc3e => generated 312 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:09.838749 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7183167-ca82-4fa9-a2ec-028661d7b638 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:09.966252 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7183167-ca82-4fa9-a2ec-028661d7b638 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:10.018292 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfa91a7-e7e0-4948-95db-fb0493d5c74a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:10.018996 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfa91a7-e7e0-4948-95db-fb0493d5c74a None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:10.019286 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfa91a7-e7e0-4948-95db-fb0493d5c74a None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:10.019568 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfa91a7-e7e0-4948-95db-fb0493d5c74a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:10.020428 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfa91a7-e7e0-4948-95db-fb0493d5c74a None admin] RBAC: Adding query filter params (role.id=317f725e26bf43648d8235bb1f7c4cb3, scope.project.id=629deba768dc4387b5a04362543efc3e, user.id=6c51550d3d834029bb4659c457cb292f) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:29:10.020727 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfa91a7-e7e0-4948-95db-fb0493d5c74a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:10.022770 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfa91a7-e7e0-4948-95db-fb0493d5c74a None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:10.029286 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 51/97] 10.222.0.15 () {56 vars in 1374 bytes} [Tue May 31 14:29:09 2022] GET /identity/v3/role_assignments?user.id=6c51550d3d834029bb4659c457cb292f&scope.project.id=629deba768dc4387b5a04362543efc3e&role.id=317f725e26bf43648d8235bb1f7c4cb3 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:11.509800 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b56cc1-f1fc-4f6b-928e-bb92e7a6d948 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:11.510302 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b56cc1-f1fc-4f6b-928e-bb92e7a6d948 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:11.510374 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b56cc1-f1fc-4f6b-928e-bb92e7a6d948 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:11.511794 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 47/98] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:29:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:29:11.517223 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b37f8bb-4ea3-4f94-904e-b3bd3879c0ed None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:11.518062 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b37f8bb-4ea3-4f94-904e-b3bd3879c0ed None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:11.518539 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b37f8bb-4ea3-4f94-904e-b3bd3879c0ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:11.543566 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-9b37f8bb-4ea3-4f94-904e-b3bd3879c0ed None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:29:11.545185 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-9b37f8bb-4ea3-4f94-904e-b3bd3879c0ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:29:11.562644 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:11.591318 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f21256a-dbf3-487e-9d08-116bc5c837ab None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:11.591619 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f21256a-dbf3-487e-9d08-116bc5c837ab None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:11.591903 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f21256a-dbf3-487e-9d08-116bc5c837ab None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:11.593649 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 48/99] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:29:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:29:11.598478 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dffba7d-229f-4505-b309-661ee2ebc7b9 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:11.598860 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dffba7d-229f-4505-b309-661ee2ebc7b9 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:11.599156 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dffba7d-229f-4505-b309-661ee2ebc7b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:11.624569 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-3dffba7d-229f-4505-b309-661ee2ebc7b9 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:29:11.625814 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-3dffba7d-229f-4505-b309-661ee2ebc7b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:29:11.647432 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:11.673548 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 52/100] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:29:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 14:29:11.713702 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b37f8bb-4ea3-4f94-904e-b3bd3879c0ed None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:11.746602 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 49/101] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:29:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 14:29:11.798257 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dffba7d-229f-4505-b309-661ee2ebc7b9 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:11.914516 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b37f8bb-4ea3-4f94-904e-b3bd3879c0ed None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:12.003864 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fb6542-4d17-4303-b1b4-97cb01181c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:12.005025 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb6542-4d17-4303-b1b4-97cb01181c57 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:12.005510 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb6542-4d17-4303-b1b4-97cb01181c57 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:12.006584 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb6542-4d17-4303-b1b4-97cb01181c57 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:12.011296 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fb6542-4d17-4303-b1b4-97cb01181c57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:12.013087 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fb6542-4d17-4303-b1b4-97cb01181c57 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:12.015004 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 53/102] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:29:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 14:29:12.020720 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fb6542-4d17-4303-b1b4-97cb01181c57 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:12.022996 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dffba7d-229f-4505-b309-661ee2ebc7b9 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:12.044966 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:12.102857 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c029356c-e2c0-4264-9eb1-953a13fc043f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:12.103590 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c029356c-e2c0-4264-9eb1-953a13fc043f None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:12.103883 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c029356c-e2c0-4264-9eb1-953a13fc043f None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:12.104168 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c029356c-e2c0-4264-9eb1-953a13fc043f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:12.132007 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c029356c-e2c0-4264-9eb1-953a13fc043f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 14:29:12.134431 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fb6542-4d17-4303-b1b4-97cb01181c57 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:12.144083 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-c029356c-e2c0-4264-9eb1-953a13fc043f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 31 14:29:12.144083 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:29:12.144083 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:29:12.144083 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:29:12.144083 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:29:12.144083 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:29:12.144083 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:29:12.144083 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:29:12.144083 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:29:12.144083 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:29:12.144083 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:29:12.144083 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:29:12.144083 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 14:29:12.144083 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 14:29:12.144083 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 14:29:12.144083 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 14:29:12.144956 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 14:29:12.144956 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 14:29:12.144956 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 14:29:12.144956 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 14:29:12.144956 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:29:12.144956 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:29:12.144956 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:29:12.144956 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:29:12.144956 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:29:12.144956 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:29:12.144956 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:29:12.144956 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:29:12.144956 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:29:12.144956 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:29:12.144956 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:29:12.144956 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:29:12.145710 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:29:12.145710 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:29:12.145710 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:29:12.145710 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:29:12.145710 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 14:29:12.145710 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 14:29:12.145710 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 14:29:12.145710 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 14:29:12.145710 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 14:29:12.145710 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 14:29:12.145710 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 31 14:29:12.145710 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:29:12.145710 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 50/103] 10.222.0.15 () {56 vars in 1099 bytes} [Tue May 31 14:29:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:29:12.150668 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f487da9-2347-43bb-9ea1-f6ae1abdf826 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:12.150668 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f487da9-2347-43bb-9ea1-f6ae1abdf826 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:12.150668 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f487da9-2347-43bb-9ea1-f6ae1abdf826 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:12.150668 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 51/104] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:29:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:29:12.154814 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f487da9-2347-43bb-9ea1-f6ae1abdf826 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:12.175975 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:12.192258 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aa32fa-1fad-476f-9d17-fd5b8e00edc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:12.243907 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aa32fa-1fad-476f-9d17-fd5b8e00edc5 None admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:12.243907 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aa32fa-1fad-476f-9d17-fd5b8e00edc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:12.243907 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aa32fa-1fad-476f-9d17-fd5b8e00edc5 None admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:12.243907 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aa32fa-1fad-476f-9d17-fd5b8e00edc5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:12.243907 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aa32fa-1fad-476f-9d17-fd5b8e00edc5 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:12.299205 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f487da9-2347-43bb-9ea1-f6ae1abdf826 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:12.331981 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 54/105] 10.222.0.15 () {60 vars in 1141 bytes} [Tue May 31 14:29:12 2022] POST /identity/v3/projects => generated 302 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 14:29:12.333379 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f75cb3a-30c4-46cb-99bf-66fe5d8e1161 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:12.333676 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f75cb3a-30c4-46cb-99bf-66fe5d8e1161 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:12.334184 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f75cb3a-30c4-46cb-99bf-66fe5d8e1161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:12.342620 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532a67a7-836a-4f0b-8f59-af4d16fddf18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:12.346584 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532a67a7-836a-4f0b-8f59-af4d16fddf18 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:12.346584 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532a67a7-836a-4f0b-8f59-af4d16fddf18 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:12.346584 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532a67a7-836a-4f0b-8f59-af4d16fddf18 None admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:12.346584 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532a67a7-836a-4f0b-8f59-af4d16fddf18 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:29:12.346584 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532a67a7-836a-4f0b-8f59-af4d16fddf18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:12.347359 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532a67a7-836a-4f0b-8f59-af4d16fddf18 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:12.359487 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 52/106] 10.222.0.15 () {56 vars in 1101 bytes} [Tue May 31 14:29:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:12.366971 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532a67a7-836a-4f0b-8f59-af4d16fddf18 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:12.431930 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-2f75cb3a-30c4-46cb-99bf-66fe5d8e1161 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:29:12.433553 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-2f75cb3a-30c4-46cb-99bf-66fe5d8e1161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:29:12.625817 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:12.650461 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:12.670537 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 55/107] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:29:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 14:29:12.690204 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532a67a7-836a-4f0b-8f59-af4d16fddf18 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:12.731466 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bfc756-75a1-4f95-8321-a98c6338eaf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:12.732378 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bfc756-75a1-4f95-8321-a98c6338eaf2 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:12.732670 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bfc756-75a1-4f95-8321-a98c6338eaf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:12.732955 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bfc756-75a1-4f95-8321-a98c6338eaf2 None admin] PATH_INFO: `/v3/users/0e258f2690124146807af5c52f82b6bc` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:12.739063 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f75cb3a-30c4-46cb-99bf-66fe5d8e1161 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:12.765281 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bfc756-75a1-4f95-8321-a98c6338eaf2 None admin] RBAC: Authorizing `identity:get_user(user_id=0e258f2690124146807af5c52f82b6bc)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:12.766886 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bfc756-75a1-4f95-8321-a98c6338eaf2 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:12.769475 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 53/108] 10.222.0.15 () {56 vars in 1177 bytes} [Tue May 31 14:29:12 2022] GET /identity/v3/users/0e258f2690124146807af5c52f82b6bc => generated 289 bytes in 403 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:12.775687 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bfc756-75a1-4f95-8321-a98c6338eaf2 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:12.940766 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bfc756-75a1-4f95-8321-a98c6338eaf2 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:12.949589 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f75cb3a-30c4-46cb-99bf-66fe5d8e1161 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:12.992612 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:12.997257 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66d0752-62b1-4e5e-9509-daf813c235b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:12.998073 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d0752-62b1-4e5e-9509-daf813c235b1 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:12.998356 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d0752-62b1-4e5e-9509-daf813c235b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:12.998655 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d0752-62b1-4e5e-9509-daf813c235b1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:13.011447 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a46d2d4-07db-4550-ab89-d47b666e27fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:13.012110 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a46d2d4-07db-4550-ab89-d47b666e27fe None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:13.012396 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a46d2d4-07db-4550-ab89-d47b666e27fe None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:13.012674 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a46d2d4-07db-4550-ab89-d47b666e27fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:13.018058 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66d0752-62b1-4e5e-9509-daf813c235b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 14:29:13.026380 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-f66d0752-62b1-4e5e-9509-daf813c235b1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 31 14:29:13.026380 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:29:13.026380 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:29:13.026380 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:29:13.026380 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:29:13.026380 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:29:13.026380 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:29:13.026380 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:29:13.026380 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:29:13.026380 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:29:13.026380 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:29:13.026380 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:29:13.026380 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 14:29:13.026380 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 14:29:13.026380 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 14:29:13.026380 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 14:29:13.027310 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 14:29:13.027310 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 14:29:13.027310 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 14:29:13.027310 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 14:29:13.027310 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:29:13.027310 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:29:13.027310 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:29:13.027310 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:29:13.027310 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:29:13.027310 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:29:13.027310 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:29:13.027310 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:29:13.027310 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:29:13.027310 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:29:13.027310 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:29:13.027310 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:29:13.028095 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:29:13.028095 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:29:13.028095 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:29:13.028095 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:29:13.028095 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 14:29:13.028095 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 14:29:13.028095 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 14:29:13.028095 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 14:29:13.028095 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 14:29:13.028095 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 14:29:13.028095 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 31 14:29:13.028095 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:29:13.028694 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 56/109] 10.222.0.15 () {56 vars in 1096 bytes} [Tue May 31 14:29:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 14:29:13.029697 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dc5873-76dd-46ad-80fc-17e1f0299fef None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:13.029985 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dc5873-76dd-46ad-80fc-17e1f0299fef None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:13.030275 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dc5873-76dd-46ad-80fc-17e1f0299fef None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:13.040752 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 57/110] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:29:13 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:29:13.041587 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dc5873-76dd-46ad-80fc-17e1f0299fef None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:13.121688 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a46d2d4-07db-4550-ab89-d47b666e27fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:13.123836 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a46d2d4-07db-4550-ab89-d47b666e27fe None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:13.141101 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:13.190998 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dc5873-76dd-46ad-80fc-17e1f0299fef None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:13.234456 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 54/111] 10.222.0.15 () {58 vars in 1282 bytes} [Tue May 31 14:29:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 31 14:29:13.238337 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebc5baa-cd28-4d61-ac91-4de33af73be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:13.239391 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc5baa-cd28-4d61-ac91-4de33af73be7 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:13.239890 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc5baa-cd28-4d61-ac91-4de33af73be7 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:13.240356 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc5baa-cd28-4d61-ac91-4de33af73be7 None admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:13.241269 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fee4e9-aa78-46a3-b089-454257824f1e None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:13.241415 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebc5baa-cd28-4d61-ac91-4de33af73be7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:29:13.241829 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fee4e9-aa78-46a3-b089-454257824f1e None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:13.242006 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebc5baa-cd28-4d61-ac91-4de33af73be7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:13.242302 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fee4e9-aa78-46a3-b089-454257824f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:13.243828 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebc5baa-cd28-4d61-ac91-4de33af73be7 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:13.255411 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 58/112] 10.222.0.15 () {56 vars in 1099 bytes} [Tue May 31 14:29:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:13.260671 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd3885-4e4a-409e-b7bc-6a8afd9898ab None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:13.260671 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd3885-4e4a-409e-b7bc-6a8afd9898ab None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:13.260671 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd3885-4e4a-409e-b7bc-6a8afd9898ab None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:13.260671 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 59/113] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:29:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:29:13.262810 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bd3885-4e4a-409e-b7bc-6a8afd9898ab None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:13.268303 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-93fee4e9-aa78-46a3-b089-454257824f1e None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:29:13.269070 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-93fee4e9-aa78-46a3-b089-454257824f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:29:13.293015 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:13.348164 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 55/114] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:29:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 14:29:13.349369 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fee4e9-aa78-46a3-b089-454257824f1e None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:13.407456 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bd3885-4e4a-409e-b7bc-6a8afd9898ab None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:13.425997 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:13.445788 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dd7f68-121e-430d-afb4-b60bb8361d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:13.447008 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dd7f68-121e-430d-afb4-b60bb8361d94 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:13.447487 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dd7f68-121e-430d-afb4-b60bb8361d94 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:13.448057 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dd7f68-121e-430d-afb4-b60bb8361d94 None admin] PATH_INFO: `/v3/projects/6a0fafbf41854f8ab937e416e30b1892` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:13.449536 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dd7f68-121e-430d-afb4-b60bb8361d94 None admin] RBAC: Authorizing `identity:get_project(project_id=6a0fafbf41854f8ab937e416e30b1892)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:13.451462 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dd7f68-121e-430d-afb4-b60bb8361d94 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:13.453513 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 60/115] 10.222.0.15 () {56 vars in 1186 bytes} [Tue May 31 14:29:13 2022] GET /identity/v3/projects/6a0fafbf41854f8ab937e416e30b1892 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:13.455269 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cecb4f-71e3-4db3-9dd0-128836420600 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:13.455814 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cecb4f-71e3-4db3-9dd0-128836420600 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:13.456286 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cecb4f-71e3-4db3-9dd0-128836420600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:13.475827 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-a4cecb4f-71e3-4db3-9dd0-128836420600 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:29:13.477431 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-a4cecb4f-71e3-4db3-9dd0-128836420600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:29:13.491455 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fee4e9-aa78-46a3-b089-454257824f1e None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:13.528536 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a6b5a6-e34e-4ad6-91df-88220453c31f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:13.529779 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a6b5a6-e34e-4ad6-91df-88220453c31f None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:13.530261 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a6b5a6-e34e-4ad6-91df-88220453c31f None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:13.530776 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a6b5a6-e34e-4ad6-91df-88220453c31f None admin] PATH_INFO: `/v3/users/98fe85f6eb3a42f89b20a9a8c17c5432` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:13.532442 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a6b5a6-e34e-4ad6-91df-88220453c31f None admin] RBAC: Authorizing `identity:get_user(user_id=98fe85f6eb3a42f89b20a9a8c17c5432)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:13.534168 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a6b5a6-e34e-4ad6-91df-88220453c31f None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:13.536045 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 56/116] 10.222.0.15 () {56 vars in 1177 bytes} [Tue May 31 14:29:13 2022] GET /identity/v3/users/98fe85f6eb3a42f89b20a9a8c17c5432 => generated 247 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:13.537039 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a6b5a6-e34e-4ad6-91df-88220453c31f None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:13.564130 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:13.567919 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 61/117] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:29:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 14:29:13.569691 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cecb4f-71e3-4db3-9dd0-128836420600 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:13.645138 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a6b5a6-e34e-4ad6-91df-88220453c31f None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:13.673676 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cecb4f-71e3-4db3-9dd0-128836420600 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:13.680174 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2877edf-4c79-40c7-85de-3e46650622e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:13.680969 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2877edf-4c79-40c7-85de-3e46650622e6 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:13.681260 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2877edf-4c79-40c7-85de-3e46650622e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:13.681543 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2877edf-4c79-40c7-85de-3e46650622e6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:13.689911 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:13.691612 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2877edf-4c79-40c7-85de-3e46650622e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 14:29:13.699885 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-a2877edf-4c79-40c7-85de-3e46650622e6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 31 14:29:13.699885 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:29:13.699885 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:29:13.699885 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:29:13.699885 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:29:13.699885 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:29:13.699885 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:29:13.699885 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:29:13.699885 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:29:13.699885 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:29:13.699885 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:29:13.699885 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:29:13.699885 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 14:29:13.699885 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 14:29:13.699885 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 14:29:13.699885 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 14:29:13.700704 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 14:29:13.700704 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 14:29:13.700704 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 14:29:13.700704 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 14:29:13.700704 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:29:13.700704 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:29:13.700704 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:29:13.700704 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:29:13.700704 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:29:13.700704 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:29:13.700704 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:29:13.700704 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:29:13.700704 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:29:13.700704 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:29:13.700704 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:29:13.700704 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:29:13.701451 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:29:13.701451 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:29:13.701451 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:29:13.701451 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:29:13.701451 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 14:29:13.701451 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 14:29:13.701451 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 14:29:13.701451 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 14:29:13.701451 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 14:29:13.701451 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 14:29:13.701451 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 31 14:29:13.701451 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:29:13.701451 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 57/118] 10.222.0.15 () {56 vars in 1099 bytes} [Tue May 31 14:29:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:29:13.702098 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2877edf-4c79-40c7-85de-3e46650622e6 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:13.714602 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241af186-eb14-4ed7-8592-18014bbdb96c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:13.715267 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241af186-eb14-4ed7-8592-18014bbdb96c None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:13.715547 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241af186-eb14-4ed7-8592-18014bbdb96c None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:13.716184 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241af186-eb14-4ed7-8592-18014bbdb96c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:13.717294 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241af186-eb14-4ed7-8592-18014bbdb96c None admin] RBAC: Adding query filter params (role.id=7ac88acfdd6d4edaa12064f0d47e1bf9, scope.project.id=6a0fafbf41854f8ab937e416e30b1892, user.id=0e258f2690124146807af5c52f82b6bc) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:29:13.717632 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241af186-eb14-4ed7-8592-18014bbdb96c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:13.719127 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241af186-eb14-4ed7-8592-18014bbdb96c None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:13.730597 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 62/119] 10.222.0.15 () {56 vars in 1374 bytes} [Tue May 31 14:29:13 2022] GET /identity/v3/role_assignments?user.id=0e258f2690124146807af5c52f82b6bc&scope.project.id=6a0fafbf41854f8ab937e416e30b1892&role.id=7ac88acfdd6d4edaa12064f0d47e1bf9 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:13.730597 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fef01d-b607-47a8-8156-e8a3d9e74042 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:13.730597 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fef01d-b607-47a8-8156-e8a3d9e74042 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:13.730597 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fef01d-b607-47a8-8156-e8a3d9e74042 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:13.730597 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 63/120] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:29:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:29:13.730597 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fef01d-b607-47a8-8156-e8a3d9e74042 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:13.806857 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:13.826790 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2877edf-4c79-40c7-85de-3e46650622e6 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:13.860676 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fef01d-b607-47a8-8156-e8a3d9e74042 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:13.866736 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e909f6-bca4-4535-87a7-99e04d9fe17a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:13.867922 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e909f6-bca4-4535-87a7-99e04d9fe17a None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:13.868426 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e909f6-bca4-4535-87a7-99e04d9fe17a None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:13.868899 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e909f6-bca4-4535-87a7-99e04d9fe17a None admin] PATH_INFO: `/v3/projects/6a0fafbf41854f8ab937e416e30b1892` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:13.870390 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e909f6-bca4-4535-87a7-99e04d9fe17a None admin] RBAC: Authorizing `identity:get_project(project_id=6a0fafbf41854f8ab937e416e30b1892)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:13.872108 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e909f6-bca4-4535-87a7-99e04d9fe17a None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:13.874137 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 58/121] 10.222.0.15 () {56 vars in 1186 bytes} [Tue May 31 14:29:13 2022] GET /identity/v3/projects/6a0fafbf41854f8ab937e416e30b1892 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:13.875325 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e909f6-bca4-4535-87a7-99e04d9fe17a None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:13.902752 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e89808-a311-4ee1-a86f-96b1ad8233a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:13.903828 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e89808-a311-4ee1-a86f-96b1ad8233a2 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:13.904282 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e89808-a311-4ee1-a86f-96b1ad8233a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:13.904817 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e89808-a311-4ee1-a86f-96b1ad8233a2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:13.919194 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e89808-a311-4ee1-a86f-96b1ad8233a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 14:29:13.929043 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-b9e89808-a311-4ee1-a86f-96b1ad8233a2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 31 14:29:13.929043 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:29:13.929043 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:29:13.929043 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:29:13.929043 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:29:13.929043 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:29:13.929043 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:29:13.929043 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:29:13.929043 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:29:13.929043 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:29:13.929043 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:29:13.929043 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:29:13.929043 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 14:29:13.929043 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 14:29:13.929043 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 14:29:13.929043 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 14:29:13.930141 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 14:29:13.930141 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 14:29:13.930141 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 14:29:13.930141 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 14:29:13.930141 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:29:13.930141 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:29:13.930141 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:29:13.930141 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:29:13.930141 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:29:13.930141 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:29:13.930141 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:29:13.930141 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:29:13.930141 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:29:13.930141 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:29:13.930141 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:29:13.930141 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:29:13.931112 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:29:13.931112 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:29:13.931112 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:29:13.931112 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:29:13.931112 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 14:29:13.931112 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 14:29:13.931112 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 14:29:13.931112 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 14:29:13.931112 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 14:29:13.931112 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 14:29:13.931112 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 31 14:29:13.931112 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:29:13.933205 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 64/122] 10.222.0.15 () {56 vars in 1114 bytes} [Tue May 31 14:29:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:29:13.934600 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2a2c53-4ba0-4c1f-b8ff-f28c0512bf38 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:13.935049 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2a2c53-4ba0-4c1f-b8ff-f28c0512bf38 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:13.935499 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2a2c53-4ba0-4c1f-b8ff-f28c0512bf38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:13.955227 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-0c2a2c53-4ba0-4c1f-b8ff-f28c0512bf38 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:29:13.956392 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-0c2a2c53-4ba0-4c1f-b8ff-f28c0512bf38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:29:13.987076 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:13.999484 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e909f6-bca4-4535-87a7-99e04d9fe17a None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:14.028741 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 65/123] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:29:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 14:29:14.029658 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2a2c53-4ba0-4c1f-b8ff-f28c0512bf38 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:14.049531 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de03b23-6bb7-47dc-ae7c-3ffd0e5b131d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:14.050538 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de03b23-6bb7-47dc-ae7c-3ffd0e5b131d None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:14.051081 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de03b23-6bb7-47dc-ae7c-3ffd0e5b131d None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:14.051395 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de03b23-6bb7-47dc-ae7c-3ffd0e5b131d None admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:14.052182 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de03b23-6bb7-47dc-ae7c-3ffd0e5b131d None admin] RBAC: Adding query filter params (name=member) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:29:14.052496 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de03b23-6bb7-47dc-ae7c-3ffd0e5b131d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:14.053941 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de03b23-6bb7-47dc-ae7c-3ffd0e5b131d None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:14.062824 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 59/124] 10.222.0.15 () {56 vars in 1101 bytes} [Tue May 31 14:29:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:14.063651 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de03b23-6bb7-47dc-ae7c-3ffd0e5b131d None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:14.080063 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:14.137980 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2a2c53-4ba0-4c1f-b8ff-f28c0512bf38 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:14.165664 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de03b23-6bb7-47dc-ae7c-3ffd0e5b131d None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:14.175868 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea1e552-ad99-4285-bd1b-1a3811c65fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:14.176885 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea1e552-ad99-4285-bd1b-1a3811c65fdb None admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:14.177187 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea1e552-ad99-4285-bd1b-1a3811c65fdb None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:14.177470 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea1e552-ad99-4285-bd1b-1a3811c65fdb None admin] PATH_INFO: `/v3/projects/6a0fafbf41854f8ab937e416e30b1892/users/98fe85f6eb3a42f89b20a9a8c17c5432/roles/76c53e2c353644f885028a0226c06146` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:14.179629 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea1e552-ad99-4285-bd1b-1a3811c65fdb None admin] RBAC: Authorizing `identity:create_grant(project_id=6a0fafbf41854f8ab937e416e30b1892, user_id=98fe85f6eb3a42f89b20a9a8c17c5432, role_id=76c53e2c353644f885028a0226c06146)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:14.181188 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea1e552-ad99-4285-bd1b-1a3811c65fdb None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:14.200829 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56804818-4f3a-4733-9cd6-20b589d16ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:14.201518 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56804818-4f3a-4733-9cd6-20b589d16ffa None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:14.201856 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56804818-4f3a-4733-9cd6-20b589d16ffa None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:14.202134 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56804818-4f3a-4733-9cd6-20b589d16ffa None admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:14.202912 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56804818-4f3a-4733-9cd6-20b589d16ffa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:29:14.203221 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56804818-4f3a-4733-9cd6-20b589d16ffa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:14.204590 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56804818-4f3a-4733-9cd6-20b589d16ffa None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:14.213605 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 60/125] 10.222.0.15 () {56 vars in 1111 bytes} [Tue May 31 14:29:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:14.218678 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56804818-4f3a-4733-9cd6-20b589d16ffa None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:14.260316 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 66/126] 10.222.0.15 () {58 vars in 1439 bytes} [Tue May 31 14:29:14 2022] PUT /identity/v3/projects/6a0fafbf41854f8ab937e416e30b1892/users/98fe85f6eb3a42f89b20a9a8c17c5432/roles/76c53e2c353644f885028a0226c06146 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:29:14.261828 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea1e552-ad99-4285-bd1b-1a3811c65fdb None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:14.302582 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:14.372556 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:14.388158 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea1e552-ad99-4285-bd1b-1a3811c65fdb None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:14.416199 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56804818-4f3a-4733-9cd6-20b589d16ffa None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:14.425482 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a06b97-aa78-4c99-9777-e509ca2b384f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:14.426283 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a06b97-aa78-4c99-9777-e509ca2b384f None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:14.426599 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a06b97-aa78-4c99-9777-e509ca2b384f None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:14.428215 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a06b97-aa78-4c99-9777-e509ca2b384f None admin] PATH_INFO: `/v3/users/6c51550d3d834029bb4659c457cb292f` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:14.428803 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a06b97-aa78-4c99-9777-e509ca2b384f None admin] RBAC: Authorizing `identity:get_user(user_id=6c51550d3d834029bb4659c457cb292f)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:14.430379 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a06b97-aa78-4c99-9777-e509ca2b384f None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:14.432139 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 67/127] 10.222.0.15 () {56 vars in 1177 bytes} [Tue May 31 14:29:14 2022] GET /identity/v3/users/6c51550d3d834029bb4659c457cb292f => generated 275 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:14.436952 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a06b97-aa78-4c99-9777-e509ca2b384f None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:14.489749 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789dcdab-2531-4a2c-bcfd-31b445106ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:14.491163 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789dcdab-2531-4a2c-bcfd-31b445106ca2 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:14.491498 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789dcdab-2531-4a2c-bcfd-31b445106ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:14.491781 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789dcdab-2531-4a2c-bcfd-31b445106ca2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:14.508422 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789dcdab-2531-4a2c-bcfd-31b445106ca2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 14:29:14.520558 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-789dcdab-2531-4a2c-bcfd-31b445106ca2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 31 14:29:14.520558 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:29:14.520558 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:29:14.520558 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:29:14.520558 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:29:14.520558 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:29:14.520558 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:29:14.520558 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:29:14.520558 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:29:14.520558 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:29:14.520558 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:29:14.520558 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:29:14.520558 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 14:29:14.520558 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 14:29:14.520558 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 14:29:14.520558 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 14:29:14.521540 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 14:29:14.521540 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 14:29:14.521540 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 14:29:14.521540 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 14:29:14.521540 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:29:14.521540 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:29:14.521540 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:29:14.521540 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:29:14.521540 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:29:14.521540 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:29:14.521540 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:29:14.521540 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:29:14.521540 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:29:14.521540 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:29:14.521540 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:29:14.521540 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:29:14.522318 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:29:14.522318 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:29:14.522318 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:29:14.522318 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:29:14.522318 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 14:29:14.522318 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 14:29:14.522318 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 14:29:14.522318 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 14:29:14.522318 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 14:29:14.522318 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 14:29:14.522318 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 31 14:29:14.522318 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:29:14.522318 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 61/128] 10.222.0.15 () {56 vars in 1099 bytes} [Tue May 31 14:29:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:29:14.522986 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789dcdab-2531-4a2c-bcfd-31b445106ca2 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:14.549375 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:14.557501 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a06b97-aa78-4c99-9777-e509ca2b384f None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:14.597237 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedf6050-dfba-40b8-9216-89e122027da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:14.598619 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf6050-dfba-40b8-9216-89e122027da5 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:14.599111 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf6050-dfba-40b8-9216-89e122027da5 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:14.599698 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf6050-dfba-40b8-9216-89e122027da5 None admin] PATH_INFO: `/v3/users/6c51550d3d834029bb4659c457cb292f` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:14.601148 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedf6050-dfba-40b8-9216-89e122027da5 None admin] RBAC: Authorizing `identity:get_user(user_id=6c51550d3d834029bb4659c457cb292f)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:14.602873 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedf6050-dfba-40b8-9216-89e122027da5 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:14.604832 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 68/129] 10.222.0.15 () {56 vars in 1177 bytes} [Tue May 31 14:29:14 2022] GET /identity/v3/users/6c51550d3d834029bb4659c457cb292f => generated 275 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:14.605808 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedf6050-dfba-40b8-9216-89e122027da5 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:14.631409 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789dcdab-2531-4a2c-bcfd-31b445106ca2 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:14.665872 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63bd663-6c2d-40f9-9e8b-38f5467bdd0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:14.666670 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63bd663-6c2d-40f9-9e8b-38f5467bdd0a None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:14.666953 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63bd663-6c2d-40f9-9e8b-38f5467bdd0a None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:14.667234 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63bd663-6c2d-40f9-9e8b-38f5467bdd0a None admin] PATH_INFO: `/v3/projects/6a0fafbf41854f8ab937e416e30b1892` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:14.668444 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63bd663-6c2d-40f9-9e8b-38f5467bdd0a None admin] RBAC: Authorizing `identity:get_project(project_id=6a0fafbf41854f8ab937e416e30b1892)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:14.669945 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63bd663-6c2d-40f9-9e8b-38f5467bdd0a None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:14.671930 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 62/130] 10.222.0.15 () {56 vars in 1186 bytes} [Tue May 31 14:29:14 2022] GET /identity/v3/projects/6a0fafbf41854f8ab937e416e30b1892 => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:14.672779 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63bd663-6c2d-40f9-9e8b-38f5467bdd0a None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:14.676645 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:14.721814 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedf6050-dfba-40b8-9216-89e122027da5 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:14.761664 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bad1c8-be36-49a5-8af9-a6aedb68b489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:14.762811 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bad1c8-be36-49a5-8af9-a6aedb68b489 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:14.763323 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bad1c8-be36-49a5-8af9-a6aedb68b489 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:14.763805 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bad1c8-be36-49a5-8af9-a6aedb68b489 None admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:14.764764 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bad1c8-be36-49a5-8af9-a6aedb68b489 None admin] RBAC: Adding query filter params (name=member) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:29:14.765321 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bad1c8-be36-49a5-8af9-a6aedb68b489 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:14.767090 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bad1c8-be36-49a5-8af9-a6aedb68b489 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:14.774413 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63bd663-6c2d-40f9-9e8b-38f5467bdd0a None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:14.776812 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 69/131] 10.222.0.15 () {56 vars in 1101 bytes} [Tue May 31 14:29:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:14.777789 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bad1c8-be36-49a5-8af9-a6aedb68b489 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:14.809320 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:14.810381 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa2520e-782a-4d8e-9313-beb091e97e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:14.811424 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa2520e-782a-4d8e-9313-beb091e97e86 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:14.811542 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa2520e-782a-4d8e-9313-beb091e97e86 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:14.811837 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa2520e-782a-4d8e-9313-beb091e97e86 None admin] PATH_INFO: `/v3/projects/6a0fafbf41854f8ab937e416e30b1892` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:14.813036 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa2520e-782a-4d8e-9313-beb091e97e86 None admin] RBAC: Authorizing `identity:get_project(project_id=6a0fafbf41854f8ab937e416e30b1892)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:14.814500 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa2520e-782a-4d8e-9313-beb091e97e86 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:14.816217 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 63/132] 10.222.0.15 () {56 vars in 1186 bytes} [Tue May 31 14:29:14 2022] GET /identity/v3/projects/6a0fafbf41854f8ab937e416e30b1892 => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:14.816989 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa2520e-782a-4d8e-9313-beb091e97e86 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:14.887928 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:14.900992 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bad1c8-be36-49a5-8af9-a6aedb68b489 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:14.918615 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa2520e-782a-4d8e-9313-beb091e97e86 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:14.948418 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a470844f-8d75-4a76-a797-177ed47e24b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:14.949872 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a470844f-8d75-4a76-a797-177ed47e24b8 None admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:14.950475 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a470844f-8d75-4a76-a797-177ed47e24b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:14.951034 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a470844f-8d75-4a76-a797-177ed47e24b8 None admin] PATH_INFO: `/v3/projects/6a0fafbf41854f8ab937e416e30b1892/users/6c51550d3d834029bb4659c457cb292f/roles/317f725e26bf43648d8235bb1f7c4cb3` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:14.955330 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcefc234-ef8c-4ef9-9571-e6ef78e5e5cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:14.956219 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcefc234-ef8c-4ef9-9571-e6ef78e5e5cb None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:14.956508 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcefc234-ef8c-4ef9-9571-e6ef78e5e5cb None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:14.956708 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a470844f-8d75-4a76-a797-177ed47e24b8 None admin] RBAC: Authorizing `identity:create_grant(project_id=6a0fafbf41854f8ab937e416e30b1892, user_id=6c51550d3d834029bb4659c457cb292f, role_id=317f725e26bf43648d8235bb1f7c4cb3)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:14.956822 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcefc234-ef8c-4ef9-9571-e6ef78e5e5cb None admin] PATH_INFO: `/v3/users/6c51550d3d834029bb4659c457cb292f` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:14.958002 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcefc234-ef8c-4ef9-9571-e6ef78e5e5cb None admin] RBAC: Authorizing `identity:get_user(user_id=6c51550d3d834029bb4659c457cb292f)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:14.958729 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a470844f-8d75-4a76-a797-177ed47e24b8 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:14.959519 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcefc234-ef8c-4ef9-9571-e6ef78e5e5cb None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:14.961656 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 64/133] 10.222.0.15 () {56 vars in 1177 bytes} [Tue May 31 14:29:14 2022] GET /identity/v3/users/6c51550d3d834029bb4659c457cb292f => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:14.962231 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcefc234-ef8c-4ef9-9571-e6ef78e5e5cb None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:15.075471 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 70/134] 10.222.0.15 () {58 vars in 1439 bytes} [Tue May 31 14:29:14 2022] PUT /identity/v3/projects/6a0fafbf41854f8ab937e416e30b1892/users/6c51550d3d834029bb4659c457cb292f/roles/317f725e26bf43648d8235bb1f7c4cb3 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:29:15.078236 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a470844f-8d75-4a76-a797-177ed47e24b8 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:15.080797 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcefc234-ef8c-4ef9-9571-e6ef78e5e5cb None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:15.158508 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079109e7-2bbe-4896-878b-e79dc979dae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:15.159544 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079109e7-2bbe-4896-878b-e79dc979dae6 None admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:15.159914 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079109e7-2bbe-4896-878b-e79dc979dae6 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:15.160203 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079109e7-2bbe-4896-878b-e79dc979dae6 None admin] PATH_INFO: `/v3/projects/6a0fafbf41854f8ab937e416e30b1892/users/6c51550d3d834029bb4659c457cb292f/roles/86e29729720b4d53b2a375a337765a2d` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:15.166619 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079109e7-2bbe-4896-878b-e79dc979dae6 None admin] RBAC: Authorizing `identity:create_grant(project_id=6a0fafbf41854f8ab937e416e30b1892, user_id=6c51550d3d834029bb4659c457cb292f, role_id=86e29729720b4d53b2a375a337765a2d)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:15.168106 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079109e7-2bbe-4896-878b-e79dc979dae6 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:15.232848 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:15.249523 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:15.253914 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 65/135] 10.222.0.15 () {58 vars in 1439 bytes} [Tue May 31 14:29:14 2022] PUT /identity/v3/projects/6a0fafbf41854f8ab937e416e30b1892/users/6c51550d3d834029bb4659c457cb292f/roles/86e29729720b4d53b2a375a337765a2d => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:29:15.265506 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a470844f-8d75-4a76-a797-177ed47e24b8 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:15.324937 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd58aa2-c8f9-4f0b-b09e-5261ce9752d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:15.325906 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd58aa2-c8f9-4f0b-b09e-5261ce9752d6 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:15.326234 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd58aa2-c8f9-4f0b-b09e-5261ce9752d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:15.326518 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd58aa2-c8f9-4f0b-b09e-5261ce9752d6 None admin] PATH_INFO: `/v3/projects/629deba768dc4387b5a04362543efc3e` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:15.331449 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd58aa2-c8f9-4f0b-b09e-5261ce9752d6 None admin] RBAC: Authorizing `identity:get_project(project_id=629deba768dc4387b5a04362543efc3e)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:15.332973 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd58aa2-c8f9-4f0b-b09e-5261ce9752d6 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:15.335375 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 71/136] 10.222.0.15 () {56 vars in 1186 bytes} [Tue May 31 14:29:15 2022] GET /identity/v3/projects/629deba768dc4387b5a04362543efc3e => generated 312 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:15.341248 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079109e7-2bbe-4896-878b-e79dc979dae6 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:15.482879 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079109e7-2bbe-4896-878b-e79dc979dae6 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:15.522428 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab302d26-43db-49df-889f-283a6884225a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:15.523358 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab302d26-43db-49df-889f-283a6884225a None admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:15.523643 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab302d26-43db-49df-889f-283a6884225a None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:15.523924 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab302d26-43db-49df-889f-283a6884225a None admin] PATH_INFO: `/v3/projects/629deba768dc4387b5a04362543efc3e/users/6c51550d3d834029bb4659c457cb292f/roles/317f725e26bf43648d8235bb1f7c4cb3` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:15.525979 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab302d26-43db-49df-889f-283a6884225a None admin] RBAC: Authorizing `identity:create_grant(project_id=629deba768dc4387b5a04362543efc3e, user_id=6c51550d3d834029bb4659c457cb292f, role_id=317f725e26bf43648d8235bb1f7c4cb3)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:15.527673 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab302d26-43db-49df-889f-283a6884225a None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:15.563514 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292590f4-b966-452d-8f7a-8e2908e89b65 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:15.563823 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292590f4-b966-452d-8f7a-8e2908e89b65 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:15.564103 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292590f4-b966-452d-8f7a-8e2908e89b65 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:15.565485 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 72/137] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:29:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:29:15.572279 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853602a5-d98a-40d3-8c07-73a07e8520c3 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:15.576685 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853602a5-d98a-40d3-8c07-73a07e8520c3 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:15.576685 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853602a5-d98a-40d3-8c07-73a07e8520c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:15.593256 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-853602a5-d98a-40d3-8c07-73a07e8520c3 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:29:15.594444 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-853602a5-d98a-40d3-8c07-73a07e8520c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:29:15.608602 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 66/138] 10.222.0.15 () {58 vars in 1439 bytes} [Tue May 31 14:29:15 2022] PUT /identity/v3/projects/629deba768dc4387b5a04362543efc3e/users/6c51550d3d834029bb4659c457cb292f/roles/317f725e26bf43648d8235bb1f7c4cb3 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:29:15.675260 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 73/139] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:29:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 31 14:29:15.700831 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab302d26-43db-49df-889f-283a6884225a None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:15.778245 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:15.831220 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab302d26-43db-49df-889f-283a6884225a None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:15.877186 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424596f3-4d62-4dea-b5ba-a3011e9c67a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:15.877989 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424596f3-4d62-4dea-b5ba-a3011e9c67a5 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:15.878279 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424596f3-4d62-4dea-b5ba-a3011e9c67a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:15.878572 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424596f3-4d62-4dea-b5ba-a3011e9c67a5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:15.883141 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424596f3-4d62-4dea-b5ba-a3011e9c67a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:15.884704 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424596f3-4d62-4dea-b5ba-a3011e9c67a5 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:15.886416 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 67/140] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:29:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:15.892091 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853602a5-d98a-40d3-8c07-73a07e8520c3 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:16.009152 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:16.030226 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853602a5-d98a-40d3-8c07-73a07e8520c3 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:16.081363 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d96a90-1e8a-422e-ada2-4fd768a1741a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:16.081990 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d96a90-1e8a-422e-ada2-4fd768a1741a None admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:16.082279 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d96a90-1e8a-422e-ada2-4fd768a1741a None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:16.082586 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d96a90-1e8a-422e-ada2-4fd768a1741a None admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:16.083346 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d96a90-1e8a-422e-ada2-4fd768a1741a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:16.085414 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d96a90-1e8a-422e-ada2-4fd768a1741a None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:16.208302 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 74/141] 10.222.0.15 () {60 vars in 1132 bytes} [Tue May 31 14:29:15 2022] POST /identity/v3/users => generated 283 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:29:16.592178 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e535b-2334-466a-8bd1-de35739b5afc None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:16.592577 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e535b-2334-466a-8bd1-de35739b5afc None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:16.592751 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e535b-2334-466a-8bd1-de35739b5afc None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:16.594232 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 68/142] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:29:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:29:16.600357 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b1b453-bca1-409b-b167-d566512411b3 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:16.600653 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b1b453-bca1-409b-b167-d566512411b3 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:16.600929 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b1b453-bca1-409b-b167-d566512411b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:16.623799 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-e6b1b453-bca1-409b-b167-d566512411b3 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:29:16.624972 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-e6b1b453-bca1-409b-b167-d566512411b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:29:16.706890 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 75/143] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:29:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 14:29:16.744041 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605e535b-2334-466a-8bd1-de35739b5afc None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:16.862595 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605e535b-2334-466a-8bd1-de35739b5afc None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:16.890154 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:16.903792 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b720b0-fd1d-4a21-8249-a675293ebeac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:16.904601 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b720b0-fd1d-4a21-8249-a675293ebeac None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:16.908337 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b720b0-fd1d-4a21-8249-a675293ebeac None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:16.908337 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b720b0-fd1d-4a21-8249-a675293ebeac None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:16.918627 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b720b0-fd1d-4a21-8249-a675293ebeac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 14:29:16.926526 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-56b720b0-fd1d-4a21-8249-a675293ebeac None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 31 14:29:16.926526 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:29:16.926526 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:29:16.926526 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:29:16.926526 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:29:16.926526 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:29:16.926526 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:29:16.926526 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:29:16.926526 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:29:16.926526 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:29:16.926526 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:29:16.926526 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:29:16.926526 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 14:29:16.926526 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 14:29:16.926526 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 14:29:16.926526 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 14:29:16.927415 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 14:29:16.927415 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 14:29:16.927415 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 14:29:16.927415 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 14:29:16.927415 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:29:16.927415 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:29:16.927415 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:29:16.927415 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:29:16.927415 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:29:16.927415 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:29:16.927415 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:29:16.927415 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:29:16.927415 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:29:16.927415 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:29:16.927415 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:29:16.927415 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:29:16.928242 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:29:16.928242 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:29:16.928242 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:29:16.928242 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:29:16.928242 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 14:29:16.928242 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 14:29:16.928242 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 14:29:16.928242 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 14:29:16.928242 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 14:29:16.928242 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 14:29:16.928242 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 31 14:29:16.928242 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:29:16.928242 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 69/144] 10.222.0.15 () {56 vars in 1099 bytes} [Tue May 31 14:29:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:29:16.934188 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b1b453-bca1-409b-b167-d566512411b3 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:17.020735 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:17.056061 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b1b453-bca1-409b-b167-d566512411b3 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:17.099852 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dfa437-723d-456b-b3cd-6f6e2e874c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:17.100537 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dfa437-723d-456b-b3cd-6f6e2e874c85 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:17.100825 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dfa437-723d-456b-b3cd-6f6e2e874c85 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:17.101106 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dfa437-723d-456b-b3cd-6f6e2e874c85 None admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:17.101863 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dfa437-723d-456b-b3cd-6f6e2e874c85 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:29:17.102172 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dfa437-723d-456b-b3cd-6f6e2e874c85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:17.103617 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dfa437-723d-456b-b3cd-6f6e2e874c85 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:17.117047 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 76/145] 10.222.0.15 () {56 vars in 1101 bytes} [Tue May 31 14:29:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:17.122789 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b720b0-fd1d-4a21-8249-a675293ebeac None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:17.249607 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b720b0-fd1d-4a21-8249-a675293ebeac None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:17.294710 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9f3060-d4cf-447a-859b-bf0c65689f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:17.294984 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f3060-d4cf-447a-859b-bf0c65689f55 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:17.295345 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f3060-d4cf-447a-859b-bf0c65689f55 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:17.295512 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f3060-d4cf-447a-859b-bf0c65689f55 None admin] PATH_INFO: `/v3/users/0e258f2690124146807af5c52f82b6bc` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:17.297187 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9f3060-d4cf-447a-859b-bf0c65689f55 None admin] RBAC: Authorizing `identity:get_user(user_id=0e258f2690124146807af5c52f82b6bc)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:17.298154 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9f3060-d4cf-447a-859b-bf0c65689f55 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:17.299992 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 70/146] 10.222.0.15 () {56 vars in 1177 bytes} [Tue May 31 14:29:17 2022] GET /identity/v3/users/0e258f2690124146807af5c52f82b6bc => generated 289 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:17.306196 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dfa437-723d-456b-b3cd-6f6e2e874c85 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:17.420339 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dfa437-723d-456b-b3cd-6f6e2e874c85 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:17.454679 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:17.460857 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23572c2b-d879-430b-ae8f-d78334f9a280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:17.462010 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23572c2b-d879-430b-ae8f-d78334f9a280 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:17.462713 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23572c2b-d879-430b-ae8f-d78334f9a280 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:17.463220 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23572c2b-d879-430b-ae8f-d78334f9a280 None admin] PATH_INFO: `/v3/projects/6a0fafbf41854f8ab937e416e30b1892` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:17.464934 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23572c2b-d879-430b-ae8f-d78334f9a280 None admin] RBAC: Authorizing `identity:get_project(project_id=6a0fafbf41854f8ab937e416e30b1892)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:17.466636 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23572c2b-d879-430b-ae8f-d78334f9a280 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:17.471638 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 77/147] 10.222.0.15 () {56 vars in 1186 bytes} [Tue May 31 14:29:17 2022] GET /identity/v3/projects/6a0fafbf41854f8ab937e416e30b1892 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:17.474909 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9f3060-d4cf-447a-859b-bf0c65689f55 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:17.555507 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:17.610124 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9f3060-d4cf-447a-859b-bf0c65689f55 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:17.654067 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b2cfb2-2c30-494e-95c1-880a6242330e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:17.655016 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b2cfb2-2c30-494e-95c1-880a6242330e None admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:17.655308 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b2cfb2-2c30-494e-95c1-880a6242330e None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:17.655613 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b2cfb2-2c30-494e-95c1-880a6242330e None admin] PATH_INFO: `/v3/projects/6a0fafbf41854f8ab937e416e30b1892/users/0e258f2690124146807af5c52f82b6bc/roles/7ac88acfdd6d4edaa12064f0d47e1bf9` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:17.658002 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b2cfb2-2c30-494e-95c1-880a6242330e None admin] RBAC: Authorizing `identity:create_grant(project_id=6a0fafbf41854f8ab937e416e30b1892, user_id=0e258f2690124146807af5c52f82b6bc, role_id=7ac88acfdd6d4edaa12064f0d47e1bf9)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:17.659487 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b2cfb2-2c30-494e-95c1-880a6242330e None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:17.736512 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4e477c-4e73-427b-b56a-eee25a3faee7 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:17.737130 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4e477c-4e73-427b-b56a-eee25a3faee7 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:17.737706 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4e477c-4e73-427b-b56a-eee25a3faee7 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:17.739363 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 78/148] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:29:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:29:17.745338 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b34a0d9-cbc6-44f5-9227-8d22388b46cc None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:17.745903 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b34a0d9-cbc6-44f5-9227-8d22388b46cc None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:17.746538 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b34a0d9-cbc6-44f5-9227-8d22388b46cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:17.755471 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 71/149] 10.222.0.15 () {58 vars in 1439 bytes} [Tue May 31 14:29:17 2022] PUT /identity/v3/projects/6a0fafbf41854f8ab937e416e30b1892/users/0e258f2690124146807af5c52f82b6bc/roles/7ac88acfdd6d4edaa12064f0d47e1bf9 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:29:17.771892 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-9b34a0d9-cbc6-44f5-9227-8d22388b46cc None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:29:17.773558 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-9b34a0d9-cbc6-44f5-9227-8d22388b46cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:29:17.873170 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 79/150] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:29:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 31 14:29:17.900489 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b2cfb2-2c30-494e-95c1-880a6242330e None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:18.014021 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b2cfb2-2c30-494e-95c1-880a6242330e None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:18.032275 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:18.055527 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170e843d-183a-4736-9132-9880d38f783e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:18.056348 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170e843d-183a-4736-9132-9880d38f783e None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:18.056634 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170e843d-183a-4736-9132-9880d38f783e None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:18.056912 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170e843d-183a-4736-9132-9880d38f783e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:18.072628 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170e843d-183a-4736-9132-9880d38f783e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 14:29:18.080508 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-170e843d-183a-4736-9132-9880d38f783e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 31 14:29:18.080508 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:29:18.080508 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:29:18.080508 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:29:18.080508 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:29:18.080508 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:29:18.080508 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:29:18.080508 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:29:18.080508 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:29:18.080508 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:29:18.080508 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:29:18.080508 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:29:18.080508 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 14:29:18.080508 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 14:29:18.080508 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 14:29:18.080508 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 14:29:18.081406 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 14:29:18.081406 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 14:29:18.081406 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 14:29:18.081406 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 14:29:18.081406 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:29:18.081406 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:29:18.081406 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:29:18.081406 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:29:18.081406 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:29:18.081406 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:29:18.081406 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:29:18.081406 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:29:18.081406 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:29:18.081406 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:29:18.081406 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:29:18.081406 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:29:18.082205 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:29:18.082205 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:29:18.082205 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:29:18.082205 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:29:18.082205 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 14:29:18.082205 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 14:29:18.082205 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 14:29:18.082205 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 14:29:18.082205 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 14:29:18.082205 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 14:29:18.082205 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 31 14:29:18.082205 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:29:18.082205 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 72/151] 10.222.0.15 () {56 vars in 1096 bytes} [Tue May 31 14:29:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:29:18.088263 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b34a0d9-cbc6-44f5-9227-8d22388b46cc None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:18.243688 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b34a0d9-cbc6-44f5-9227-8d22388b46cc None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:18.295554 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:18.308646 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881548a2-8ae0-4d50-937b-5b73bd501161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:18.309341 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881548a2-8ae0-4d50-937b-5b73bd501161 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:18.309662 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881548a2-8ae0-4d50-937b-5b73bd501161 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:18.309896 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881548a2-8ae0-4d50-937b-5b73bd501161 None admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:18.310693 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881548a2-8ae0-4d50-937b-5b73bd501161 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:29:18.311002 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881548a2-8ae0-4d50-937b-5b73bd501161 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:18.319429 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881548a2-8ae0-4d50-937b-5b73bd501161 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:18.325286 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 80/152] 10.222.0.15 () {56 vars in 1099 bytes} [Tue May 31 14:29:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:18.330592 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170e843d-183a-4736-9132-9880d38f783e None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:18.384690 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e7a72-1793-4bb5-b5f0-21e21b682595 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:18.385008 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e7a72-1793-4bb5-b5f0-21e21b682595 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:18.385260 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e7a72-1793-4bb5-b5f0-21e21b682595 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:18.386801 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 81/153] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:29:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 31 14:29:18.391914 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e8bf5-5615-40a8-957c-8e973617edd0 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:18.392209 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e8bf5-5615-40a8-957c-8e973617edd0 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:18.392486 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e8bf5-5615-40a8-957c-8e973617edd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:18.423227 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-7d2e8bf5-5615-40a8-957c-8e973617edd0 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:29:18.424423 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-7d2e8bf5-5615-40a8-957c-8e973617edd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:29:18.503223 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170e843d-183a-4736-9132-9880d38f783e None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:18.556917 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac339f46-5d49-4447-8649-fb2705ede129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:18.557819 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac339f46-5d49-4447-8649-fb2705ede129 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:18.558009 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac339f46-5d49-4447-8649-fb2705ede129 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:18.558280 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac339f46-5d49-4447-8649-fb2705ede129 None admin] PATH_INFO: `/v3/users/98fe85f6eb3a42f89b20a9a8c17c5432` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:18.563315 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac339f46-5d49-4447-8649-fb2705ede129 None admin] RBAC: Authorizing `identity:get_user(user_id=98fe85f6eb3a42f89b20a9a8c17c5432)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:18.564804 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac339f46-5d49-4447-8649-fb2705ede129 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:18.566465 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 73/154] 10.222.0.15 () {56 vars in 1177 bytes} [Tue May 31 14:29:18 2022] GET /identity/v3/users/98fe85f6eb3a42f89b20a9a8c17c5432 => generated 247 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:18.572652 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac339f46-5d49-4447-8649-fb2705ede129 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:18.577351 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 82/155] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:29:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) May 31 14:29:18.623156 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2e8bf5-5615-40a8-957c-8e973617edd0 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:18.647547 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:18.766400 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac339f46-5d49-4447-8649-fb2705ede129 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:18.855374 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4885365e-2f0f-41a4-8d40-8db4a8f10672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:18.855966 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4885365e-2f0f-41a4-8d40-8db4a8f10672 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:18.856251 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4885365e-2f0f-41a4-8d40-8db4a8f10672 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:18.856526 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4885365e-2f0f-41a4-8d40-8db4a8f10672 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:18.890476 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2e8bf5-5615-40a8-957c-8e973617edd0 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:18.946007 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:18.983292 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d3af80-c777-495c-9a05-dc98bc39409e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:18.984209 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d3af80-c777-495c-9a05-dc98bc39409e None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:18.984497 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d3af80-c777-495c-9a05-dc98bc39409e None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:18.984788 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d3af80-c777-495c-9a05-dc98bc39409e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:19.015510 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d3af80-c777-495c-9a05-dc98bc39409e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 14:29:19.020142 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4885365e-2f0f-41a4-8d40-8db4a8f10672 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:19.021656 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4885365e-2f0f-41a4-8d40-8db4a8f10672 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:19.023886 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-e0d3af80-c777-495c-9a05-dc98bc39409e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 31 14:29:19.023886 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:29:19.023886 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:29:19.023886 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:29:19.023886 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:29:19.023886 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:29:19.023886 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:29:19.023886 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:29:19.023886 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:29:19.023886 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:29:19.023886 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:29:19.023886 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:29:19.023886 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 14:29:19.023886 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 14:29:19.023886 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 14:29:19.023886 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 14:29:19.024784 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 14:29:19.024784 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 14:29:19.024784 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 14:29:19.024784 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 14:29:19.024784 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:29:19.024784 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:29:19.024784 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:29:19.024784 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:29:19.024784 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:29:19.024784 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:29:19.024784 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:29:19.024784 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:29:19.024784 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:29:19.024784 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:29:19.024784 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:29:19.024784 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:29:19.025572 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:29:19.025572 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:29:19.025572 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:29:19.025572 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:29:19.025572 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 14:29:19.025572 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 14:29:19.025572 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 14:29:19.025572 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 14:29:19.025572 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 14:29:19.025572 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 14:29:19.025572 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 31 14:29:19.025572 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:29:19.025572 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 83/156] 10.222.0.15 () {56 vars in 1114 bytes} [Tue May 31 14:29:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 403 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 14:29:19.032012 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d3af80-c777-495c-9a05-dc98bc39409e None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:19.093518 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:19.155161 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 74/157] 10.222.0.15 () {58 vars in 1282 bytes} [Tue May 31 14:29:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 583 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 31 14:29:19.160896 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4885365e-2f0f-41a4-8d40-8db4a8f10672 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:19.297751 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4885365e-2f0f-41a4-8d40-8db4a8f10672 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:19.317926 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d3af80-c777-495c-9a05-dc98bc39409e None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:19.337327 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abac448d-2956-46f4-8ce3-ef6525b1cad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:19.338238 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac448d-2956-46f4-8ce3-ef6525b1cad8 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:19.338525 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac448d-2956-46f4-8ce3-ef6525b1cad8 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:19.338828 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac448d-2956-46f4-8ce3-ef6525b1cad8 None admin] PATH_INFO: `/v3/projects/6a0fafbf41854f8ab937e416e30b1892` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:19.340042 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abac448d-2956-46f4-8ce3-ef6525b1cad8 None admin] RBAC: Authorizing `identity:get_project(project_id=6a0fafbf41854f8ab937e416e30b1892)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:19.341525 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abac448d-2956-46f4-8ce3-ef6525b1cad8 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:19.348233 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 75/158] 10.222.0.15 () {56 vars in 1186 bytes} [Tue May 31 14:29:19 2022] GET /identity/v3/projects/6a0fafbf41854f8ab937e416e30b1892 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:19.350257 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a75289f-89b5-4afe-bd56-8989afeb196a None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:19.350571 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a75289f-89b5-4afe-bd56-8989afeb196a None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:19.350869 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a75289f-89b5-4afe-bd56-8989afeb196a None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:19.352194 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 76/159] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:29:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:29:19.352971 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a75289f-89b5-4afe-bd56-8989afeb196a None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:19.384035 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:19.399310 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a555688f-cc6f-4464-a12b-6b5a30c8b63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:19.400006 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a555688f-cc6f-4464-a12b-6b5a30c8b63c None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:19.400307 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a555688f-cc6f-4464-a12b-6b5a30c8b63c None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:19.400573 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a555688f-cc6f-4464-a12b-6b5a30c8b63c None admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:19.401338 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a555688f-cc6f-4464-a12b-6b5a30c8b63c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:29:19.401708 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a555688f-cc6f-4464-a12b-6b5a30c8b63c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:19.403102 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a555688f-cc6f-4464-a12b-6b5a30c8b63c None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:19.419127 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 84/160] 10.222.0.15 () {56 vars in 1111 bytes} [Tue May 31 14:29:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:19.420482 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4787ddc4-8a88-488d-908f-a03496013d1c None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:19.420780 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4787ddc4-8a88-488d-908f-a03496013d1c None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:19.421062 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4787ddc4-8a88-488d-908f-a03496013d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:19.454464 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-4787ddc4-8a88-488d-908f-a03496013d1c None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:29:19.455691 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-4787ddc4-8a88-488d-908f-a03496013d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:29:19.521484 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a75289f-89b5-4afe-bd56-8989afeb196a None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:19.572183 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:19.587607 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b750cfb-1fc0-4677-b207-3a494e663ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:19.588941 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b750cfb-1fc0-4677-b207-3a494e663ccc None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:19.589299 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b750cfb-1fc0-4677-b207-3a494e663ccc None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:19.589818 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b750cfb-1fc0-4677-b207-3a494e663ccc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:19.590908 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b750cfb-1fc0-4677-b207-3a494e663ccc None admin] RBAC: Adding query filter params (role.id=76c53e2c353644f885028a0226c06146, scope.project.id=6a0fafbf41854f8ab937e416e30b1892, user.id=98fe85f6eb3a42f89b20a9a8c17c5432) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:29:19.591476 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b750cfb-1fc0-4677-b207-3a494e663ccc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:19.593144 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b750cfb-1fc0-4677-b207-3a494e663ccc None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:19.607651 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 77/161] 10.222.0.15 () {56 vars in 1374 bytes} [Tue May 31 14:29:19 2022] GET /identity/v3/role_assignments?user.id=98fe85f6eb3a42f89b20a9a8c17c5432&scope.project.id=6a0fafbf41854f8ab937e416e30b1892&role.id=76c53e2c353644f885028a0226c06146 => generated 608 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:19.608832 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b750cfb-1fc0-4677-b207-3a494e663ccc None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:19.668072 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 85/162] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:29:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 14:29:19.704478 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4787ddc4-8a88-488d-908f-a03496013d1c None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:19.745172 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:19.786520 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b750cfb-1fc0-4677-b207-3a494e663ccc None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:19.860343 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17630b05-13e7-4eb5-aec8-e6bad05e9619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:19.861405 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17630b05-13e7-4eb5-aec8-e6bad05e9619 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:19.861706 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17630b05-13e7-4eb5-aec8-e6bad05e9619 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:19.861988 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17630b05-13e7-4eb5-aec8-e6bad05e9619 None admin] PATH_INFO: `/v3/users/6c51550d3d834029bb4659c457cb292f` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:19.864894 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17630b05-13e7-4eb5-aec8-e6bad05e9619 None admin] RBAC: Authorizing `identity:get_user(user_id=6c51550d3d834029bb4659c457cb292f)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:19.866985 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17630b05-13e7-4eb5-aec8-e6bad05e9619 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:19.869572 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 78/163] 10.222.0.15 () {56 vars in 1177 bytes} [Tue May 31 14:29:19 2022] GET /identity/v3/users/6c51550d3d834029bb4659c457cb292f => generated 275 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:19.875824 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17630b05-13e7-4eb5-aec8-e6bad05e9619 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:19.972600 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4787ddc4-8a88-488d-908f-a03496013d1c None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:20.042613 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154ca428-9665-4faf-918c-58a352e1e151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:20.043429 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154ca428-9665-4faf-918c-58a352e1e151 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:20.043724 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154ca428-9665-4faf-918c-58a352e1e151 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:20.044000 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154ca428-9665-4faf-918c-58a352e1e151 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:20.066703 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154ca428-9665-4faf-918c-58a352e1e151 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 14:29:20.069777 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17630b05-13e7-4eb5-aec8-e6bad05e9619 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:20.082215 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-154ca428-9665-4faf-918c-58a352e1e151 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 31 14:29:20.082215 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:29:20.082215 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:29:20.082215 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:29:20.082215 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:29:20.082215 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:29:20.082215 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:29:20.082215 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:29:20.082215 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:29:20.082215 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:29:20.082215 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:29:20.082215 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:29:20.082215 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 14:29:20.082215 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 14:29:20.082215 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 14:29:20.082215 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 14:29:20.083160 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 14:29:20.083160 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 14:29:20.083160 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 14:29:20.083160 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 14:29:20.083160 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:29:20.083160 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:29:20.083160 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:29:20.083160 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:29:20.083160 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:29:20.083160 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:29:20.083160 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:29:20.083160 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:29:20.083160 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:29:20.083160 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:29:20.083160 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:29:20.083160 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:29:20.083939 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:29:20.083939 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:29:20.083939 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:29:20.083939 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:29:20.083939 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 14:29:20.083939 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 14:29:20.083939 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 14:29:20.083939 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 14:29:20.083939 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 14:29:20.083939 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 14:29:20.083939 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 31 14:29:20.083939 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:29:20.087210 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 86/164] 10.222.0.15 () {56 vars in 1099 bytes} [Tue May 31 14:29:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 383 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 14:29:20.088811 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1d39f-1056-49f8-9b0b-9a856cb90a0d None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:20.089438 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1d39f-1056-49f8-9b0b-9a856cb90a0d None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:20.089992 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1d39f-1056-49f8-9b0b-9a856cb90a0d None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:20.091763 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 87/165] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:29:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:29:20.098674 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a1d39f-1056-49f8-9b0b-9a856cb90a0d None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:20.106134 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9fb367-fed9-4cdd-8d7b-cf6e3840cf14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:20.107710 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9fb367-fed9-4cdd-8d7b-cf6e3840cf14 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:20.108003 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9fb367-fed9-4cdd-8d7b-cf6e3840cf14 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:20.108284 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9fb367-fed9-4cdd-8d7b-cf6e3840cf14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:20.124189 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:20.153725 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:20.183718 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9fb367-fed9-4cdd-8d7b-cf6e3840cf14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:20.185368 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9fb367-fed9-4cdd-8d7b-cf6e3840cf14 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:20.294807 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 79/166] 10.222.0.15 () {58 vars in 1282 bytes} [Tue May 31 14:29:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 31 14:29:20.296242 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1204b4-8010-4656-bf90-1ef85a0b20f5 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:20.302593 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1204b4-8010-4656-bf90-1ef85a0b20f5 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:20.302593 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1204b4-8010-4656-bf90-1ef85a0b20f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:20.315848 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-3d1204b4-8010-4656-bf90-1ef85a0b20f5 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:29:20.317277 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-3d1204b4-8010-4656-bf90-1ef85a0b20f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:29:20.324117 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a1d39f-1056-49f8-9b0b-9a856cb90a0d None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:20.363147 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:20.393191 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 80/167] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:29:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 14:29:20.394334 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1204b4-8010-4656-bf90-1ef85a0b20f5 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:20.401380 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dbd235-f208-444c-aae7-b5ad19eda3f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:20.402078 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dbd235-f208-444c-aae7-b5ad19eda3f7 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:20.402474 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dbd235-f208-444c-aae7-b5ad19eda3f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:20.402776 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dbd235-f208-444c-aae7-b5ad19eda3f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:20.403560 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dbd235-f208-444c-aae7-b5ad19eda3f7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:29:20.404988 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dbd235-f208-444c-aae7-b5ad19eda3f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:20.406515 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dbd235-f208-444c-aae7-b5ad19eda3f7 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:20.426479 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 88/168] 10.222.0.15 () {56 vars in 1101 bytes} [Tue May 31 14:29:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:20.432239 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dbd235-f208-444c-aae7-b5ad19eda3f7 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:20.504680 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1204b4-8010-4656-bf90-1ef85a0b20f5 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:20.597004 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997f146e-bc5c-4bcb-94a7-0e5c9389fe6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:20.597803 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997f146e-bc5c-4bcb-94a7-0e5c9389fe6d None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:20.598094 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997f146e-bc5c-4bcb-94a7-0e5c9389fe6d None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:20.598376 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997f146e-bc5c-4bcb-94a7-0e5c9389fe6d None admin] PATH_INFO: `/v3/projects/6a0fafbf41854f8ab937e416e30b1892` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:20.601002 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997f146e-bc5c-4bcb-94a7-0e5c9389fe6d None admin] RBAC: Authorizing `identity:get_project(project_id=6a0fafbf41854f8ab937e416e30b1892)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:20.603348 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997f146e-bc5c-4bcb-94a7-0e5c9389fe6d None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:20.609263 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 81/169] 10.222.0.15 () {56 vars in 1186 bytes} [Tue May 31 14:29:20 2022] GET /identity/v3/projects/6a0fafbf41854f8ab937e416e30b1892 => generated 298 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:20.609875 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997f146e-bc5c-4bcb-94a7-0e5c9389fe6d None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:20.665537 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:20.676513 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dbd235-f208-444c-aae7-b5ad19eda3f7 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:20.711829 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:20.763297 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fdd1f0-d2a4-42cd-822d-dad6ddb8bcd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:20.765610 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fdd1f0-d2a4-42cd-822d-dad6ddb8bcd8 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:20.768126 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fdd1f0-d2a4-42cd-822d-dad6ddb8bcd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:20.768651 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fdd1f0-d2a4-42cd-822d-dad6ddb8bcd8 None admin] PATH_INFO: `/v3/users/6c51550d3d834029bb4659c457cb292f` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:20.773374 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fdd1f0-d2a4-42cd-822d-dad6ddb8bcd8 None admin] RBAC: Authorizing `identity:get_user(user_id=6c51550d3d834029bb4659c457cb292f)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:20.780290 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fdd1f0-d2a4-42cd-822d-dad6ddb8bcd8 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:20.784584 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 89/170] 10.222.0.15 () {56 vars in 1177 bytes} [Tue May 31 14:29:20 2022] GET /identity/v3/users/6c51550d3d834029bb4659c457cb292f => generated 275 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 14:29:20.789579 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fdd1f0-d2a4-42cd-822d-dad6ddb8bcd8 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:20.864776 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997f146e-bc5c-4bcb-94a7-0e5c9389fe6d None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:20.927477 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f617913-9270-4a03-823a-d55fbee65987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:20.934579 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f617913-9270-4a03-823a-d55fbee65987 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:20.934579 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f617913-9270-4a03-823a-d55fbee65987 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:20.934579 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f617913-9270-4a03-823a-d55fbee65987 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:20.947119 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fdd1f0-d2a4-42cd-822d-dad6ddb8bcd8 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:20.955399 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f617913-9270-4a03-823a-d55fbee65987 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 14:29:20.963068 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-6f617913-9270-4a03-823a-d55fbee65987 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 31 14:29:20.963068 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:29:20.963068 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:29:20.963068 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:29:20.963068 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:29:20.963068 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:29:20.963068 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:29:20.963068 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:29:20.963068 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:29:20.963068 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:29:20.963068 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:29:20.963068 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:29:20.963068 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 14:29:20.963068 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 14:29:20.963068 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 14:29:20.963068 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 14:29:20.963943 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 14:29:20.963943 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 14:29:20.963943 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 14:29:20.963943 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 14:29:20.963943 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:29:20.963943 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:29:20.963943 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:29:20.963943 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:29:20.963943 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:29:20.963943 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:29:20.963943 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:29:20.963943 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:29:20.963943 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:29:20.963943 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:29:20.963943 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:29:20.963943 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:29:20.964738 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:29:20.964738 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:29:20.964738 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:29:20.964738 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:29:20.964738 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 14:29:20.964738 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 14:29:20.964738 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 14:29:20.964738 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 14:29:20.964738 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 14:29:20.964738 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 14:29:20.964738 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 31 14:29:20.964738 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:29:20.964738 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 82/171] 10.222.0.15 () {56 vars in 1099 bytes} [Tue May 31 14:29:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:29:20.965464 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f617913-9270-4a03-823a-d55fbee65987 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:21.009185 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035e1ae7-a5a6-49fa-afb8-935180d0937e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:21.010264 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e1ae7-a5a6-49fa-afb8-935180d0937e None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:21.013978 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e1ae7-a5a6-49fa-afb8-935180d0937e None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:21.014495 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e1ae7-a5a6-49fa-afb8-935180d0937e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:21.015598 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035e1ae7-a5a6-49fa-afb8-935180d0937e None admin] RBAC: Adding query filter params (role.id=86e29729720b4d53b2a375a337765a2d, scope.project.id=6a0fafbf41854f8ab937e416e30b1892, user.id=6c51550d3d834029bb4659c457cb292f) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:29:21.016119 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035e1ae7-a5a6-49fa-afb8-935180d0937e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:21.017805 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035e1ae7-a5a6-49fa-afb8-935180d0937e None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:21.037901 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 90/172] 10.222.0.15 () {56 vars in 1374 bytes} [Tue May 31 14:29:20 2022] GET /identity/v3/role_assignments?user.id=6c51550d3d834029bb4659c457cb292f&scope.project.id=6a0fafbf41854f8ab937e416e30b1892&role.id=86e29729720b4d53b2a375a337765a2d => generated 608 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:21.039077 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035e1ae7-a5a6-49fa-afb8-935180d0937e None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:21.135590 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:21.228979 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035e1ae7-a5a6-49fa-afb8-935180d0937e None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:21.281256 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482b11b1-3d54-40c0-ac3b-aa18a5719829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:21.282612 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482b11b1-3d54-40c0-ac3b-aa18a5719829 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:21.283160 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482b11b1-3d54-40c0-ac3b-aa18a5719829 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:21.283642 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482b11b1-3d54-40c0-ac3b-aa18a5719829 None admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:21.284765 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482b11b1-3d54-40c0-ac3b-aa18a5719829 None admin] RBAC: Adding query filter params (name=member) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:29:21.285298 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482b11b1-3d54-40c0-ac3b-aa18a5719829 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:21.287015 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482b11b1-3d54-40c0-ac3b-aa18a5719829 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:21.302706 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 91/173] 10.222.0.15 () {56 vars in 1101 bytes} [Tue May 31 14:29:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:21.304080 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c2f8e-51de-45b6-a3bc-003873d67df3 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:21.304372 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c2f8e-51de-45b6-a3bc-003873d67df3 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:21.304652 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c2f8e-51de-45b6-a3bc-003873d67df3 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:21.305031 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f617913-9270-4a03-823a-d55fbee65987 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:21.305904 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 92/174] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:29:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:29:21.307490 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:21.312636 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc210a26-5838-410c-86af-52ee2cf8bac2 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:21.313008 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc210a26-5838-410c-86af-52ee2cf8bac2 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:21.313215 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc210a26-5838-410c-86af-52ee2cf8bac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:21.339941 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-bc210a26-5838-410c-86af-52ee2cf8bac2 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:29:21.341199 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-bc210a26-5838-410c-86af-52ee2cf8bac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:29:21.445514 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155cbe09-6981-4cf7-a488-131ec5943c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:21.446130 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155cbe09-6981-4cf7-a488-131ec5943c31 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:21.446419 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155cbe09-6981-4cf7-a488-131ec5943c31 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:21.446728 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155cbe09-6981-4cf7-a488-131ec5943c31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:21.498168 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 93/175] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:29:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 14:29:21.499066 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc210a26-5838-410c-86af-52ee2cf8bac2 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:21.528108 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:21.599303 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155cbe09-6981-4cf7-a488-131ec5943c31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:21.602882 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155cbe09-6981-4cf7-a488-131ec5943c31 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:21.622347 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc210a26-5838-410c-86af-52ee2cf8bac2 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:21.666584 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff1a94f-a0f9-43df-9b9f-35bce7ad3e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:21.667719 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff1a94f-a0f9-43df-9b9f-35bce7ad3e4c None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:21.668011 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff1a94f-a0f9-43df-9b9f-35bce7ad3e4c None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:21.668382 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff1a94f-a0f9-43df-9b9f-35bce7ad3e4c None admin] PATH_INFO: `/v3/users/6c51550d3d834029bb4659c457cb292f` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:21.669607 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff1a94f-a0f9-43df-9b9f-35bce7ad3e4c None admin] RBAC: Authorizing `identity:get_user(user_id=6c51550d3d834029bb4659c457cb292f)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:21.671329 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff1a94f-a0f9-43df-9b9f-35bce7ad3e4c None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:21.673181 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 94/176] 10.222.0.15 () {56 vars in 1177 bytes} [Tue May 31 14:29:21 2022] GET /identity/v3/users/6c51550d3d834029bb4659c457cb292f => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:21.673863 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff1a94f-a0f9-43df-9b9f-35bce7ad3e4c None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:21.713994 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 83/177] 10.222.0.15 () {58 vars in 1282 bytes} [Tue May 31 14:29:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 749 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 31 14:29:21.715285 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2f39de-d2f8-4968-9914-08d4d13f002a None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:21.715574 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2f39de-d2f8-4968-9914-08d4d13f002a None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:21.715849 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2f39de-d2f8-4968-9914-08d4d13f002a None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:21.717117 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 84/178] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:29:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:29:21.717816 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2f39de-d2f8-4968-9914-08d4d13f002a None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:21.726794 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:21.777671 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:21.795310 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff1a94f-a0f9-43df-9b9f-35bce7ad3e4c None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:21.840593 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d187db-23d2-493b-a7a1-0f0a9b6c85f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:21.841402 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d187db-23d2-493b-a7a1-0f0a9b6c85f4 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:21.841693 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d187db-23d2-493b-a7a1-0f0a9b6c85f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:21.841976 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d187db-23d2-493b-a7a1-0f0a9b6c85f4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:21.853581 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d187db-23d2-493b-a7a1-0f0a9b6c85f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 14:29:21.859348 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2f39de-d2f8-4968-9914-08d4d13f002a None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:21.862953 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-d5d187db-23d2-493b-a7a1-0f0a9b6c85f4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 31 14:29:21.862953 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:29:21.862953 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:29:21.862953 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:29:21.862953 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:29:21.862953 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:29:21.862953 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:29:21.862953 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:29:21.862953 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:29:21.862953 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:29:21.862953 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:29:21.862953 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:29:21.862953 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 14:29:21.862953 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 14:29:21.862953 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 14:29:21.862953 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 14:29:21.863818 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 14:29:21.863818 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 14:29:21.863818 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 14:29:21.863818 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 14:29:21.863818 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:29:21.863818 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:29:21.863818 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:29:21.863818 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:29:21.863818 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:29:21.863818 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:29:21.863818 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:29:21.863818 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:29:21.863818 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:29:21.863818 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:29:21.863818 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:29:21.863818 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:29:21.864622 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:29:21.864622 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:29:21.864622 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:29:21.864622 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:29:21.864622 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 14:29:21.864622 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 14:29:21.864622 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 14:29:21.864622 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 14:29:21.864622 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 14:29:21.864622 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 14:29:21.864622 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 31 14:29:21.864622 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:29:21.868126 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 95/179] 10.222.0.15 () {56 vars in 1096 bytes} [Tue May 31 14:29:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:29:21.869400 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d187db-23d2-493b-a7a1-0f0a9b6c85f4 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:21.895295 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7723736c-d6b9-4224-94d4-c397982bad2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:21.895980 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7723736c-d6b9-4224-94d4-c397982bad2f None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:21.896209 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7723736c-d6b9-4224-94d4-c397982bad2f None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:21.896493 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7723736c-d6b9-4224-94d4-c397982bad2f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:21.967656 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7723736c-d6b9-4224-94d4-c397982bad2f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:21.969162 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7723736c-d6b9-4224-94d4-c397982bad2f None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:21.971059 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:21.982438 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d187db-23d2-493b-a7a1-0f0a9b6c85f4 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:22.018135 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34430300-8266-46d8-a8a9-140241ecc6c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:22.019101 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34430300-8266-46d8-a8a9-140241ecc6c3 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:22.019386 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34430300-8266-46d8-a8a9-140241ecc6c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:22.019668 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34430300-8266-46d8-a8a9-140241ecc6c3 None admin] PATH_INFO: `/v3/projects/6a0fafbf41854f8ab937e416e30b1892` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:22.020875 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34430300-8266-46d8-a8a9-140241ecc6c3 None admin] RBAC: Authorizing `identity:get_project(project_id=6a0fafbf41854f8ab937e416e30b1892)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:22.022355 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34430300-8266-46d8-a8a9-140241ecc6c3 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:22.024091 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 96/180] 10.222.0.15 () {56 vars in 1186 bytes} [Tue May 31 14:29:21 2022] GET /identity/v3/projects/6a0fafbf41854f8ab937e416e30b1892 => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:22.025410 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67585066-e36e-4a4f-931c-97c7932316b4 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:22.025702 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67585066-e36e-4a4f-931c-97c7932316b4 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:22.025981 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67585066-e36e-4a4f-931c-97c7932316b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:22.042757 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-67585066-e36e-4a4f-931c-97c7932316b4 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:29:22.043956 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-67585066-e36e-4a4f-931c-97c7932316b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:29:22.055228 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:22.076540 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 85/181] 10.222.0.15 () {58 vars in 1282 bytes} [Tue May 31 14:29:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 31 14:29:22.077454 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7723736c-d6b9-4224-94d4-c397982bad2f None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:22.114419 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 97/182] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:29:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 14:29:22.122735 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91df437-403b-4349-9524-53d50773c6e0 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:22.122735 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91df437-403b-4349-9524-53d50773c6e0 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:22.122735 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91df437-403b-4349-9524-53d50773c6e0 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:22.122735 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 98/183] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:29:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:29:22.122735 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91df437-403b-4349-9524-53d50773c6e0 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:22.179427 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7723736c-d6b9-4224-94d4-c397982bad2f None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:22.180924 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:22.211859 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b8d4ee-515c-4eaa-8120-1646d6ea41f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:22.212522 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b8d4ee-515c-4eaa-8120-1646d6ea41f8 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:22.212815 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b8d4ee-515c-4eaa-8120-1646d6ea41f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:22.213082 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b8d4ee-515c-4eaa-8120-1646d6ea41f8 None admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:22.213823 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b8d4ee-515c-4eaa-8120-1646d6ea41f8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:29:22.214129 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b8d4ee-515c-4eaa-8120-1646d6ea41f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:22.215549 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b8d4ee-515c-4eaa-8120-1646d6ea41f8 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:22.224210 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 86/184] 10.222.0.15 () {56 vars in 1099 bytes} [Tue May 31 14:29:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:22.225978 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b4aef-55bd-4001-88af-909f5ce73722 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:22.226272 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b4aef-55bd-4001-88af-909f5ce73722 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:22.226627 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b4aef-55bd-4001-88af-909f5ce73722 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:22.227437 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91df437-403b-4349-9524-53d50773c6e0 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:22.230594 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 87/185] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:29:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:29:22.230594 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062b4aef-55bd-4001-88af-909f5ce73722 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:22.263818 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96477c54-8e1b-446f-a615-1ba5c47776dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:22.264470 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96477c54-8e1b-446f-a615-1ba5c47776dc None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:22.264753 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96477c54-8e1b-446f-a615-1ba5c47776dc None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:22.265044 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96477c54-8e1b-446f-a615-1ba5c47776dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:22.265870 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96477c54-8e1b-446f-a615-1ba5c47776dc None admin] RBAC: Adding query filter params (role.id=317f725e26bf43648d8235bb1f7c4cb3, scope.project.id=6a0fafbf41854f8ab937e416e30b1892, user.id=6c51550d3d834029bb4659c457cb292f) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:29:22.266181 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96477c54-8e1b-446f-a615-1ba5c47776dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:22.267667 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96477c54-8e1b-446f-a615-1ba5c47776dc None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:22.273547 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 99/186] 10.222.0.15 () {56 vars in 1374 bytes} [Tue May 31 14:29:22 2022] GET /identity/v3/role_assignments?user.id=6c51550d3d834029bb4659c457cb292f&scope.project.id=6a0fafbf41854f8ab937e416e30b1892&role.id=317f725e26bf43648d8235bb1f7c4cb3 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:22.274757 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6de08-4729-47f2-bad4-84d975281557 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:22.275048 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6de08-4729-47f2-bad4-84d975281557 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:22.275327 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6de08-4729-47f2-bad4-84d975281557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:22.293681 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-ffc6de08-4729-47f2-bad4-84d975281557 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:29:22.294949 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-ffc6de08-4729-47f2-bad4-84d975281557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:29:22.299200 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:22.353570 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062b4aef-55bd-4001-88af-909f5ce73722 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:22.372030 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 100/187] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:29:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 14:29:22.372912 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc6de08-4729-47f2-bad4-84d975281557 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:22.399995 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33714709-8bbb-4c71-b2ad-6b829cf76da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:22.401291 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33714709-8bbb-4c71-b2ad-6b829cf76da0 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:22.401854 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33714709-8bbb-4c71-b2ad-6b829cf76da0 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:22.402200 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33714709-8bbb-4c71-b2ad-6b829cf76da0 None admin] PATH_INFO: `/v3/projects/629deba768dc4387b5a04362543efc3e` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:22.403609 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33714709-8bbb-4c71-b2ad-6b829cf76da0 None admin] RBAC: Authorizing `identity:get_project(project_id=629deba768dc4387b5a04362543efc3e)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:22.405311 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33714709-8bbb-4c71-b2ad-6b829cf76da0 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:22.407501 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 88/188] 10.222.0.15 () {56 vars in 1186 bytes} [Tue May 31 14:29:22 2022] GET /identity/v3/projects/629deba768dc4387b5a04362543efc3e => generated 312 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:22.408294 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33714709-8bbb-4c71-b2ad-6b829cf76da0 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:22.444106 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:22.507239 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc6de08-4729-47f2-bad4-84d975281557 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:22.525779 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33714709-8bbb-4c71-b2ad-6b829cf76da0 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:22.546397 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e2c511-08e4-446e-97ac-604488d2c517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:22.547297 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e2c511-08e4-446e-97ac-604488d2c517 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:22.547579 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e2c511-08e4-446e-97ac-604488d2c517 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:22.547854 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e2c511-08e4-446e-97ac-604488d2c517 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:22.549004 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e2c511-08e4-446e-97ac-604488d2c517 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:22.550441 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e2c511-08e4-446e-97ac-604488d2c517 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:22.552070 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 101/189] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:29:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:22.554401 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00773a1-92fe-45e3-bb96-fa394668fbe4 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:22.554812 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00773a1-92fe-45e3-bb96-fa394668fbe4 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:22.555096 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00773a1-92fe-45e3-bb96-fa394668fbe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:22.560888 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb2478b-5e3e-4217-a61e-fec0d39e8336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:22.561764 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb2478b-5e3e-4217-a61e-fec0d39e8336 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:22.562049 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb2478b-5e3e-4217-a61e-fec0d39e8336 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:22.562324 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb2478b-5e3e-4217-a61e-fec0d39e8336 None admin] PATH_INFO: `/v3/users/89d1c5fc37004be295785b8d947d23af` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:22.570905 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-d00773a1-92fe-45e3-bb96-fa394668fbe4 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:29:22.572082 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-d00773a1-92fe-45e3-bb96-fa394668fbe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:29:22.573989 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:22.575413 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb2478b-5e3e-4217-a61e-fec0d39e8336 None admin] RBAC: Authorizing `identity:get_user(user_id=89d1c5fc37004be295785b8d947d23af)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:22.576875 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb2478b-5e3e-4217-a61e-fec0d39e8336 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:22.578528 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 89/190] 10.222.0.15 () {56 vars in 1177 bytes} [Tue May 31 14:29:22 2022] GET /identity/v3/users/89d1c5fc37004be295785b8d947d23af => generated 283 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:22.580394 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb2478b-5e3e-4217-a61e-fec0d39e8336 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:22.639095 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 102/191] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:29:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 14:29:22.650094 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00773a1-92fe-45e3-bb96-fa394668fbe4 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:22.678292 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:22.687535 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb2478b-5e3e-4217-a61e-fec0d39e8336 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:22.720948 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e70d68a-3e6b-4e16-a75b-e82d49edc2f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:22.721758 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e70d68a-3e6b-4e16-a75b-e82d49edc2f1 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:22.722048 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e70d68a-3e6b-4e16-a75b-e82d49edc2f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:22.722329 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e70d68a-3e6b-4e16-a75b-e82d49edc2f1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:22.733418 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e70d68a-3e6b-4e16-a75b-e82d49edc2f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 14:29:22.742476 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-4e70d68a-3e6b-4e16-a75b-e82d49edc2f1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 31 14:29:22.742476 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:29:22.742476 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:29:22.742476 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:29:22.742476 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:29:22.742476 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:29:22.742476 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:29:22.742476 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:29:22.742476 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:29:22.742476 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:29:22.742476 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:29:22.742476 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:29:22.742476 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 14:29:22.742476 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 14:29:22.742476 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 14:29:22.742476 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 14:29:22.743559 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 14:29:22.743559 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 14:29:22.743559 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 14:29:22.743559 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 14:29:22.743559 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:29:22.743559 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:29:22.743559 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:29:22.743559 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:29:22.743559 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:29:22.743559 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:29:22.743559 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:29:22.743559 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:29:22.743559 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:29:22.743559 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:29:22.743559 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:29:22.743559 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:29:22.744573 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:29:22.744573 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:29:22.744573 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:29:22.744573 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:29:22.744573 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 14:29:22.744573 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 14:29:22.744573 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 14:29:22.744573 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 14:29:22.744573 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 14:29:22.744573 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 14:29:22.744573 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 31 14:29:22.744573 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:29:22.745324 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 90/192] 10.222.0.15 () {56 vars in 1114 bytes} [Tue May 31 14:29:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:29:22.745834 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e70d68a-3e6b-4e16-a75b-e82d49edc2f1 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:22.748467 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00773a1-92fe-45e3-bb96-fa394668fbe4 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:22.784663 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9f79c3-0c63-4e4d-9b50-9b35b77157de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:22.785215 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9f79c3-0c63-4e4d-9b50-9b35b77157de None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:22.785488 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9f79c3-0c63-4e4d-9b50-9b35b77157de None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:22.785761 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9f79c3-0c63-4e4d-9b50-9b35b77157de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:22.786614 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9f79c3-0c63-4e4d-9b50-9b35b77157de None admin] RBAC: Adding query filter params (role.id=317f725e26bf43648d8235bb1f7c4cb3, scope.project.id=629deba768dc4387b5a04362543efc3e, user.id=6c51550d3d834029bb4659c457cb292f) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:29:22.786909 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9f79c3-0c63-4e4d-9b50-9b35b77157de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:22.788984 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9f79c3-0c63-4e4d-9b50-9b35b77157de None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:22.794971 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 103/193] 10.222.0.15 () {56 vars in 1374 bytes} [Tue May 31 14:29:22 2022] GET /identity/v3/role_assignments?user.id=6c51550d3d834029bb4659c457cb292f&scope.project.id=629deba768dc4387b5a04362543efc3e&role.id=317f725e26bf43648d8235bb1f7c4cb3 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:22.795527 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9f79c3-0c63-4e4d-9b50-9b35b77157de None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:22.797962 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:22.859646 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e70d68a-3e6b-4e16-a75b-e82d49edc2f1 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:22.899227 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b335f905-d411-4c01-b135-0ca728fd571d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:22.899892 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b335f905-d411-4c01-b135-0ca728fd571d None admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:22.900190 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b335f905-d411-4c01-b135-0ca728fd571d None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:22.900476 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b335f905-d411-4c01-b135-0ca728fd571d None admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:22.901221 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b335f905-d411-4c01-b135-0ca728fd571d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:22.902789 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b335f905-d411-4c01-b135-0ca728fd571d None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:22.906742 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9f79c3-0c63-4e4d-9b50-9b35b77157de None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:22.942073 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0736e2a5-2129-48f5-beed-9f5dc8c69803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:22.942775 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0736e2a5-2129-48f5-beed-9f5dc8c69803 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:22.943068 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0736e2a5-2129-48f5-beed-9f5dc8c69803 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:22.943352 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0736e2a5-2129-48f5-beed-9f5dc8c69803 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:23.015665 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0736e2a5-2129-48f5-beed-9f5dc8c69803 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:23.017161 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0736e2a5-2129-48f5-beed-9f5dc8c69803 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:23.017535 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 91/194] 10.222.0.15 () {60 vars in 1132 bytes} [Tue May 31 14:29:22 2022] POST /identity/v3/users => generated 297 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:29:23.018470 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b335f905-d411-4c01-b135-0ca728fd571d None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:23.026166 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:23.029975 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:23.154345 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 104/195] 10.222.0.15 () {58 vars in 1282 bytes} [Tue May 31 14:29:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 31 14:29:23.157120 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b335f905-d411-4c01-b135-0ca728fd571d None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:23.158817 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0736e2a5-2129-48f5-beed-9f5dc8c69803 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:23.196574 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53079f67-6ce9-4b71-9ad6-269845719bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:23.197699 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53079f67-6ce9-4b71-9ad6-269845719bff None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:23.198165 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53079f67-6ce9-4b71-9ad6-269845719bff None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:23.198664 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53079f67-6ce9-4b71-9ad6-269845719bff None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:23.212011 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53079f67-6ce9-4b71-9ad6-269845719bff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 14:29:23.221043 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-53079f67-6ce9-4b71-9ad6-269845719bff None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 31 14:29:23.221043 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:29:23.221043 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:29:23.221043 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:29:23.221043 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:29:23.221043 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:29:23.221043 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:29:23.221043 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:29:23.221043 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:29:23.221043 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:29:23.221043 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:29:23.221043 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:29:23.221043 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 14:29:23.221043 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 14:29:23.221043 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 14:29:23.221043 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 14:29:23.222080 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 14:29:23.222080 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 14:29:23.222080 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 14:29:23.222080 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 14:29:23.222080 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:29:23.222080 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:29:23.222080 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:29:23.222080 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:29:23.222080 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:29:23.222080 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:29:23.222080 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:29:23.222080 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:29:23.222080 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:29:23.222080 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:29:23.222080 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:29:23.222080 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:29:23.222965 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:29:23.222965 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:29:23.222965 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:29:23.222965 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:29:23.222965 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 14:29:23.222965 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 14:29:23.222965 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 14:29:23.222965 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 14:29:23.222965 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 14:29:23.222965 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 14:29:23.222965 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 31 14:29:23.222965 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:29:23.231865 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 92/196] 10.222.0.15 () {56 vars in 1099 bytes} [Tue May 31 14:29:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:29:23.231865 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53079f67-6ce9-4b71-9ad6-269845719bff None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:23.272608 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0736e2a5-2129-48f5-beed-9f5dc8c69803 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:23.274130 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:23.303406 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:23.313883 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f789bf-3a51-4a1e-8df9-709e8a8af02f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:23.314622 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f789bf-3a51-4a1e-8df9-709e8a8af02f None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:23.314910 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f789bf-3a51-4a1e-8df9-709e8a8af02f None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:23.315185 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f789bf-3a51-4a1e-8df9-709e8a8af02f None admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:23.316336 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f789bf-3a51-4a1e-8df9-709e8a8af02f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:29:23.316336 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f789bf-3a51-4a1e-8df9-709e8a8af02f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:23.317614 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f789bf-3a51-4a1e-8df9-709e8a8af02f None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:23.329646 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 105/197] 10.222.0.15 () {56 vars in 1111 bytes} [Tue May 31 14:29:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:23.330374 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f789bf-3a51-4a1e-8df9-709e8a8af02f None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:23.351548 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53079f67-6ce9-4b71-9ad6-269845719bff None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:23.396821 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9898f8-67b9-47ac-a246-bf5cf1ef993e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:23.397697 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9898f8-67b9-47ac-a246-bf5cf1ef993e None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:23.397979 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9898f8-67b9-47ac-a246-bf5cf1ef993e None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:23.398259 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9898f8-67b9-47ac-a246-bf5cf1ef993e None admin] PATH_INFO: `/v3/projects/a492408a00474ddd952118fdba3219ad` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:23.399581 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9898f8-67b9-47ac-a246-bf5cf1ef993e None admin] RBAC: Authorizing `identity:get_project(project_id=a492408a00474ddd952118fdba3219ad)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:23.401040 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9898f8-67b9-47ac-a246-bf5cf1ef993e None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:23.402894 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 93/198] 10.222.0.15 () {56 vars in 1186 bytes} [Tue May 31 14:29:23 2022] GET /identity/v3/projects/a492408a00474ddd952118fdba3219ad => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:23.403673 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9898f8-67b9-47ac-a246-bf5cf1ef993e None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:23.463289 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f789bf-3a51-4a1e-8df9-709e8a8af02f None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:23.500793 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc3c555-2edb-4415-8904-dbe38be8adbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:23.501521 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc3c555-2edb-4415-8904-dbe38be8adbd None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:23.501804 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc3c555-2edb-4415-8904-dbe38be8adbd None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:23.502136 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc3c555-2edb-4415-8904-dbe38be8adbd None admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:23.503335 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc3c555-2edb-4415-8904-dbe38be8adbd None admin] RBAC: Adding query filter params (name=reader) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:29:23.503444 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc3c555-2edb-4415-8904-dbe38be8adbd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:23.504762 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc3c555-2edb-4415-8904-dbe38be8adbd None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:23.521528 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 106/199] 10.222.0.15 () {56 vars in 1101 bytes} [Tue May 31 14:29:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:23.522191 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc3c555-2edb-4415-8904-dbe38be8adbd None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:23.543971 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9898f8-67b9-47ac-a246-bf5cf1ef993e None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:23.565212 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:23.581118 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e1ee72-c4cb-4318-8c80-a466b580126b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:23.582127 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e1ee72-c4cb-4318-8c80-a466b580126b None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:23.592481 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e1ee72-c4cb-4318-8c80-a466b580126b None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:23.592481 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e1ee72-c4cb-4318-8c80-a466b580126b None admin] PATH_INFO: `/v3/users/89d1c5fc37004be295785b8d947d23af` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:23.592481 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e1ee72-c4cb-4318-8c80-a466b580126b None admin] RBAC: Authorizing `identity:get_user(user_id=89d1c5fc37004be295785b8d947d23af)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:23.592481 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e1ee72-c4cb-4318-8c80-a466b580126b None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:23.592481 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 94/200] 10.222.0.15 () {56 vars in 1177 bytes} [Tue May 31 14:29:23 2022] GET /identity/v3/users/89d1c5fc37004be295785b8d947d23af => generated 283 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:23.592481 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e1ee72-c4cb-4318-8c80-a466b580126b None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:23.595666 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:23.659946 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc3c555-2edb-4415-8904-dbe38be8adbd None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:23.696663 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e89fdf-7ed6-45a4-802e-463247e54ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:23.697591 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e89fdf-7ed6-45a4-802e-463247e54ed7 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:23.697957 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e89fdf-7ed6-45a4-802e-463247e54ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:23.698338 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e89fdf-7ed6-45a4-802e-463247e54ed7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:23.699327 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e89fdf-7ed6-45a4-802e-463247e54ed7 None admin] RBAC: Adding query filter params (role.id=76c53e2c353644f885028a0226c06146, scope.project.id=a492408a00474ddd952118fdba3219ad, user.id=89d1c5fc37004be295785b8d947d23af) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:29:23.699779 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e89fdf-7ed6-45a4-802e-463247e54ed7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:23.701305 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e89fdf-7ed6-45a4-802e-463247e54ed7 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:23.707308 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 107/201] 10.222.0.15 () {56 vars in 1374 bytes} [Tue May 31 14:29:23 2022] GET /identity/v3/role_assignments?user.id=89d1c5fc37004be295785b8d947d23af&scope.project.id=a492408a00474ddd952118fdba3219ad&role.id=76c53e2c353644f885028a0226c06146 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:23.708222 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e89fdf-7ed6-45a4-802e-463247e54ed7 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:23.726826 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e1ee72-c4cb-4318-8c80-a466b580126b None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:23.774131 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c916ded6-25cb-4add-a8b3-10972e752878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:23.775443 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c916ded6-25cb-4add-a8b3-10972e752878 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:23.775982 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c916ded6-25cb-4add-a8b3-10972e752878 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:23.776414 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c916ded6-25cb-4add-a8b3-10972e752878 None admin] PATH_INFO: `/v3/users/0e258f2690124146807af5c52f82b6bc` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:23.777904 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c916ded6-25cb-4add-a8b3-10972e752878 None admin] RBAC: Authorizing `identity:get_user(user_id=0e258f2690124146807af5c52f82b6bc)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:23.779597 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c916ded6-25cb-4add-a8b3-10972e752878 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:23.781823 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 95/202] 10.222.0.15 () {56 vars in 1177 bytes} [Tue May 31 14:29:23 2022] GET /identity/v3/users/0e258f2690124146807af5c52f82b6bc => generated 289 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:23.791716 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c916ded6-25cb-4add-a8b3-10972e752878 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:23.813602 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:23.824556 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e89fdf-7ed6-45a4-802e-463247e54ed7 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:23.865966 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56bb539-7bfe-469e-9b23-66ae9d20bd0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:23.866841 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56bb539-7bfe-469e-9b23-66ae9d20bd0e None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:23.867231 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56bb539-7bfe-469e-9b23-66ae9d20bd0e None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:23.867611 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56bb539-7bfe-469e-9b23-66ae9d20bd0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:23.873542 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:23.909427 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c916ded6-25cb-4add-a8b3-10972e752878 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:23.950577 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dae2657-2859-4707-ad9f-c4d09a90779c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:23.951503 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae2657-2859-4707-ad9f-c4d09a90779c None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:23.951955 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae2657-2859-4707-ad9f-c4d09a90779c None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:23.952360 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae2657-2859-4707-ad9f-c4d09a90779c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:23.999927 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56bb539-7bfe-469e-9b23-66ae9d20bd0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:24.001625 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56bb539-7bfe-469e-9b23-66ae9d20bd0e None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:24.025296 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dae2657-2859-4707-ad9f-c4d09a90779c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:24.027046 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dae2657-2859-4707-ad9f-c4d09a90779c None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:24.097505 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:24.130992 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 96/203] 10.222.0.15 () {58 vars in 1282 bytes} [Tue May 31 14:29:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 31 14:29:24.137327 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dae2657-2859-4707-ad9f-c4d09a90779c None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:24.186917 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:24.195033 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 108/204] 10.222.0.15 () {58 vars in 1282 bytes} [Tue May 31 14:29:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 31 14:29:24.200507 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56bb539-7bfe-469e-9b23-66ae9d20bd0e None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:24.310590 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56bb539-7bfe-469e-9b23-66ae9d20bd0e None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:24.342693 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c975137-41e4-4f0f-8399-14c89ad1c032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:24.343724 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c975137-41e4-4f0f-8399-14c89ad1c032 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:24.344158 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c975137-41e4-4f0f-8399-14c89ad1c032 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:24.344530 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c975137-41e4-4f0f-8399-14c89ad1c032 None admin] PATH_INFO: `/v3/projects/a492408a00474ddd952118fdba3219ad` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:24.345957 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c975137-41e4-4f0f-8399-14c89ad1c032 None admin] RBAC: Authorizing `identity:get_project(project_id=a492408a00474ddd952118fdba3219ad)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:24.347661 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c975137-41e4-4f0f-8399-14c89ad1c032 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:24.349963 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 109/205] 10.222.0.15 () {56 vars in 1186 bytes} [Tue May 31 14:29:24 2022] GET /identity/v3/projects/a492408a00474ddd952118fdba3219ad => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:24.360620 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c975137-41e4-4f0f-8399-14c89ad1c032 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:24.372641 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dae2657-2859-4707-ad9f-c4d09a90779c None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:24.450913 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:24.466959 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dfc8e4-06b7-4344-8eae-d2bd729bdbb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:24.467884 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dfc8e4-06b7-4344-8eae-d2bd729bdbb4 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:24.468173 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dfc8e4-06b7-4344-8eae-d2bd729bdbb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:24.468448 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dfc8e4-06b7-4344-8eae-d2bd729bdbb4 None admin] PATH_INFO: `/v3/projects/6a0fafbf41854f8ab937e416e30b1892` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:24.475278 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c975137-41e4-4f0f-8399-14c89ad1c032 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:24.475920 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dfc8e4-06b7-4344-8eae-d2bd729bdbb4 None admin] RBAC: Authorizing `identity:get_project(project_id=6a0fafbf41854f8ab937e416e30b1892)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:24.477504 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dfc8e4-06b7-4344-8eae-d2bd729bdbb4 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:24.481315 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 97/206] 10.222.0.15 () {56 vars in 1186 bytes} [Tue May 31 14:29:24 2022] GET /identity/v3/projects/6a0fafbf41854f8ab937e416e30b1892 => generated 298 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:24.484993 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dfc8e4-06b7-4344-8eae-d2bd729bdbb4 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:24.532126 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:24.571380 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102e06b2-b884-4aac-a7cd-b5b73cce91df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:24.571969 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102e06b2-b884-4aac-a7cd-b5b73cce91df None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:24.572249 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102e06b2-b884-4aac-a7cd-b5b73cce91df None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:24.575557 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102e06b2-b884-4aac-a7cd-b5b73cce91df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:24.576409 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102e06b2-b884-4aac-a7cd-b5b73cce91df None admin] RBAC: Adding query filter params (role.id=86e29729720b4d53b2a375a337765a2d, scope.project.id=a492408a00474ddd952118fdba3219ad, user.id=89d1c5fc37004be295785b8d947d23af) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:29:24.576724 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102e06b2-b884-4aac-a7cd-b5b73cce91df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:24.579734 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102e06b2-b884-4aac-a7cd-b5b73cce91df None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:24.589459 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 110/207] 10.222.0.15 () {56 vars in 1374 bytes} [Tue May 31 14:29:24 2022] GET /identity/v3/role_assignments?user.id=89d1c5fc37004be295785b8d947d23af&scope.project.id=a492408a00474ddd952118fdba3219ad&role.id=86e29729720b4d53b2a375a337765a2d => generated 259 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:24.616936 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dfc8e4-06b7-4344-8eae-d2bd729bdbb4 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:24.676159 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cb44e7-f609-4ecc-b702-66a347dc0f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:24.676899 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cb44e7-f609-4ecc-b702-66a347dc0f31 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:24.677178 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cb44e7-f609-4ecc-b702-66a347dc0f31 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:24.677505 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cb44e7-f609-4ecc-b702-66a347dc0f31 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:24.678386 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cb44e7-f609-4ecc-b702-66a347dc0f31 None admin] RBAC: Adding query filter params (role.id=7ac88acfdd6d4edaa12064f0d47e1bf9, scope.project.id=6a0fafbf41854f8ab937e416e30b1892, user.id=0e258f2690124146807af5c52f82b6bc) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:29:24.678744 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cb44e7-f609-4ecc-b702-66a347dc0f31 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:24.680192 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cb44e7-f609-4ecc-b702-66a347dc0f31 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:24.687328 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 98/208] 10.222.0.15 () {56 vars in 1374 bytes} [Tue May 31 14:29:24 2022] GET /identity/v3/role_assignments?user.id=0e258f2690124146807af5c52f82b6bc&scope.project.id=6a0fafbf41854f8ab937e416e30b1892&role.id=7ac88acfdd6d4edaa12064f0d47e1bf9 => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:25.623601 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3050f6ec-098f-4c0c-9986-ee5333284f26 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:25.624086 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3050f6ec-098f-4c0c-9986-ee5333284f26 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:25.624086 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3050f6ec-098f-4c0c-9986-ee5333284f26 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:25.625554 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 111/209] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:29:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:29:25.631132 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bc07ce-bf9d-4f3f-b758-4d9e85956546 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:25.631929 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bc07ce-bf9d-4f3f-b758-4d9e85956546 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:25.632411 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bc07ce-bf9d-4f3f-b758-4d9e85956546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:25.649889 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-a6bc07ce-bf9d-4f3f-b758-4d9e85956546 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:29:25.651420 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-a6bc07ce-bf9d-4f3f-b758-4d9e85956546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:29:25.719604 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 99/210] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:29:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 14:29:25.743978 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3050f6ec-098f-4c0c-9986-ee5333284f26 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:25.848884 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3050f6ec-098f-4c0c-9986-ee5333284f26 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:25.872335 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:25.886456 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416d04c4-f51b-48de-b3bf-b5b7a769d693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:25.886456 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416d04c4-f51b-48de-b3bf-b5b7a769d693 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:25.886456 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416d04c4-f51b-48de-b3bf-b5b7a769d693 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:25.886456 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416d04c4-f51b-48de-b3bf-b5b7a769d693 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:25.897359 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416d04c4-f51b-48de-b3bf-b5b7a769d693 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 14:29:25.905159 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-416d04c4-f51b-48de-b3bf-b5b7a769d693 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 31 14:29:25.905159 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:29:25.905159 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:29:25.905159 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:29:25.905159 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:29:25.905159 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:29:25.905159 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:29:25.905159 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:29:25.905159 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:29:25.905159 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:29:25.905159 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:29:25.905159 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:29:25.905159 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 14:29:25.905159 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 14:29:25.905159 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 14:29:25.905159 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 14:29:25.906054 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 14:29:25.906054 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 14:29:25.906054 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 14:29:25.906054 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 14:29:25.906054 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:29:25.906054 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:29:25.906054 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:29:25.906054 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:29:25.906054 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:29:25.906054 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:29:25.906054 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:29:25.906054 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:29:25.906054 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:29:25.906054 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:29:25.906054 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:29:25.906054 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:29:25.906905 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:29:25.906905 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:29:25.906905 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:29:25.906905 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:29:25.906905 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 14:29:25.906905 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 14:29:25.906905 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 14:29:25.906905 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 14:29:25.906905 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 14:29:25.906905 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 14:29:25.906905 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 31 14:29:25.906905 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:29:25.906905 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 112/211] 10.222.0.15 () {56 vars in 1099 bytes} [Tue May 31 14:29:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:29:25.914763 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce2200-06bd-4bd4-b3aa-cd31659e7526 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:25.915057 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce2200-06bd-4bd4-b3aa-cd31659e7526 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:25.915334 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce2200-06bd-4bd4-b3aa-cd31659e7526 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:25.916821 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 100/212] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:29:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:29:25.919600 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416d04c4-f51b-48de-b3bf-b5b7a769d693 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:25.922112 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff63e3b-5e38-40aa-a448-56b91feaea9c None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:25.922399 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff63e3b-5e38-40aa-a448-56b91feaea9c None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:25.922714 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff63e3b-5e38-40aa-a448-56b91feaea9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:25.942201 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-fff63e3b-5e38-40aa-a448-56b91feaea9c None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:29:25.943511 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-fff63e3b-5e38-40aa-a448-56b91feaea9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:29:25.977560 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:26.040697 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 101/213] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:29:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 14:29:26.040898 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416d04c4-f51b-48de-b3bf-b5b7a769d693 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:26.064884 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff63e3b-5e38-40aa-a448-56b91feaea9c None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:26.080341 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f013ff-2844-4216-856e-ad4155af5e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:26.081013 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f013ff-2844-4216-856e-ad4155af5e9c None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:26.081295 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f013ff-2844-4216-856e-ad4155af5e9c None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:26.081569 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f013ff-2844-4216-856e-ad4155af5e9c None admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:26.082310 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f013ff-2844-4216-856e-ad4155af5e9c None admin] RBAC: Adding query filter params (name=member) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:29:26.082637 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f013ff-2844-4216-856e-ad4155af5e9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:26.084010 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f013ff-2844-4216-856e-ad4155af5e9c None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:26.093159 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 113/214] 10.222.0.15 () {56 vars in 1101 bytes} [Tue May 31 14:29:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:26.100090 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f013ff-2844-4216-856e-ad4155af5e9c None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:26.167047 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:26.191046 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff63e3b-5e38-40aa-a448-56b91feaea9c None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:26.227729 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f013ff-2844-4216-856e-ad4155af5e9c None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:26.237867 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3134e7e0-bf3c-4bda-a56f-094c400d1e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:26.239057 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134e7e0-bf3c-4bda-a56f-094c400d1e1e None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:26.239564 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134e7e0-bf3c-4bda-a56f-094c400d1e1e None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:26.240064 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134e7e0-bf3c-4bda-a56f-094c400d1e1e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:26.242092 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3134e7e0-bf3c-4bda-a56f-094c400d1e1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:26.243882 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3134e7e0-bf3c-4bda-a56f-094c400d1e1e None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:26.245820 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 102/215] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:29:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 14:29:26.255998 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3134e7e0-bf3c-4bda-a56f-094c400d1e1e None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:26.263323 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64620e41-27aa-460d-87f6-e0da5bb33dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:26.264199 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64620e41-27aa-460d-87f6-e0da5bb33dab None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:26.264482 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64620e41-27aa-460d-87f6-e0da5bb33dab None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:26.264765 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64620e41-27aa-460d-87f6-e0da5bb33dab None admin] PATH_INFO: `/v3/users/e810a8642eca47c08efac54c4daa8fdf` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:26.280710 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64620e41-27aa-460d-87f6-e0da5bb33dab None admin] RBAC: Authorizing `identity:get_user(user_id=e810a8642eca47c08efac54c4daa8fdf)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:26.282437 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64620e41-27aa-460d-87f6-e0da5bb33dab None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:26.284772 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 114/216] 10.222.0.15 () {56 vars in 1177 bytes} [Tue May 31 14:29:26 2022] GET /identity/v3/users/e810a8642eca47c08efac54c4daa8fdf => generated 297 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 14:29:26.294322 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b71b17-cba1-4908-924a-3b5030ac8201 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:26.294322 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b71b17-cba1-4908-924a-3b5030ac8201 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:26.294322 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b71b17-cba1-4908-924a-3b5030ac8201 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:26.294322 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 115/217] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:29:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:29:26.294322 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b71b17-cba1-4908-924a-3b5030ac8201 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:26.301001 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:26.374097 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3134e7e0-bf3c-4bda-a56f-094c400d1e1e None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:26.408584 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b71b17-cba1-4908-924a-3b5030ac8201 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:26.409430 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c146f00-13ba-4722-8e36-581c81589962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:26.410103 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c146f00-13ba-4722-8e36-581c81589962 None admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:26.410383 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c146f00-13ba-4722-8e36-581c81589962 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:26.410486 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:26.410689 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c146f00-13ba-4722-8e36-581c81589962 None admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:26.411400 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c146f00-13ba-4722-8e36-581c81589962 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:26.412889 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c146f00-13ba-4722-8e36-581c81589962 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:26.445279 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a04848-cda4-4687-bfad-49e1cf168809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:26.445858 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a04848-cda4-4687-bfad-49e1cf168809 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:26.446198 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a04848-cda4-4687-bfad-49e1cf168809 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:26.446482 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a04848-cda4-4687-bfad-49e1cf168809 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:26.505514 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 103/218] 10.222.0.15 () {60 vars in 1132 bytes} [Tue May 31 14:29:26 2022] POST /identity/v3/users => generated 297 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:29:26.507835 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdba576-66cd-4224-a9f5-9e9fb162d6cb None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:26.508128 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdba576-66cd-4224-a9f5-9e9fb162d6cb None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:26.508409 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdba576-66cd-4224-a9f5-9e9fb162d6cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:26.528291 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a04848-cda4-4687-bfad-49e1cf168809 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:26.529965 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a04848-cda4-4687-bfad-49e1cf168809 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:26.532601 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-1cdba576-66cd-4224-a9f5-9e9fb162d6cb None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:29:26.535463 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-1cdba576-66cd-4224-a9f5-9e9fb162d6cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:29:26.641698 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 104/219] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:29:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 14:29:26.659716 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 116/220] 10.222.0.15 () {58 vars in 1282 bytes} [Tue May 31 14:29:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 31 14:29:26.666080 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdba576-66cd-4224-a9f5-9e9fb162d6cb None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:26.668072 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a04848-cda4-4687-bfad-49e1cf168809 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:26.671444 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:26.690694 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:26.795406 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a04848-cda4-4687-bfad-49e1cf168809 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:26.808801 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdba576-66cd-4224-a9f5-9e9fb162d6cb None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:26.847241 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec0fb52-1657-4f51-aece-3e01ba59e96d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:26.848120 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec0fb52-1657-4f51-aece-3e01ba59e96d None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:26.848814 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec0fb52-1657-4f51-aece-3e01ba59e96d None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:26.848814 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec0fb52-1657-4f51-aece-3e01ba59e96d None admin] PATH_INFO: `/v3/projects/a492408a00474ddd952118fdba3219ad` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:26.850381 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec0fb52-1657-4f51-aece-3e01ba59e96d None admin] RBAC: Authorizing `identity:get_project(project_id=a492408a00474ddd952118fdba3219ad)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:26.851861 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec0fb52-1657-4f51-aece-3e01ba59e96d None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:26.853792 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 117/221] 10.222.0.15 () {56 vars in 1186 bytes} [Tue May 31 14:29:26 2022] GET /identity/v3/projects/a492408a00474ddd952118fdba3219ad => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:26.859598 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec0fb52-1657-4f51-aece-3e01ba59e96d None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:26.860054 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352e0dac-8e47-4850-8a75-ece3295efe59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:26.860869 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e0dac-8e47-4850-8a75-ece3295efe59 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:26.861155 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e0dac-8e47-4850-8a75-ece3295efe59 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:26.861432 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e0dac-8e47-4850-8a75-ece3295efe59 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:26.876309 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352e0dac-8e47-4850-8a75-ece3295efe59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 14:29:26.884022 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-352e0dac-8e47-4850-8a75-ece3295efe59 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 31 14:29:26.884022 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:29:26.884022 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:29:26.884022 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:29:26.884022 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:29:26.884022 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:29:26.884022 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:29:26.884022 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:29:26.884022 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:29:26.884022 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:29:26.884022 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:29:26.884022 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:29:26.884022 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 14:29:26.884022 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 14:29:26.884022 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 14:29:26.884022 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 14:29:26.884925 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 14:29:26.884925 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 14:29:26.884925 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 14:29:26.884925 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 14:29:26.884925 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:29:26.884925 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:29:26.884925 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:29:26.884925 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:29:26.884925 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:29:26.884925 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:29:26.884925 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:29:26.884925 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:29:26.884925 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:29:26.884925 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:29:26.884925 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:29:26.884925 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:29:26.885706 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:29:26.885706 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:29:26.885706 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:29:26.885706 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:29:26.885706 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 14:29:26.885706 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 14:29:26.885706 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 14:29:26.885706 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 14:29:26.885706 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 14:29:26.885706 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 14:29:26.885706 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 31 14:29:26.885706 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:29:26.885706 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 105/222] 10.222.0.15 () {56 vars in 1096 bytes} [Tue May 31 14:29:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:29:26.890928 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352e0dac-8e47-4850-8a75-ece3295efe59 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:26.947360 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:26.983298 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec0fb52-1657-4f51-aece-3e01ba59e96d None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:26.983985 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:27.011999 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352e0dac-8e47-4850-8a75-ece3295efe59 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:27.019749 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdb2d35-a25f-4bb2-9043-814c6c2a16e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:27.020738 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb2d35-a25f-4bb2-9043-814c6c2a16e8 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:27.020903 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb2d35-a25f-4bb2-9043-814c6c2a16e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:27.021288 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb2d35-a25f-4bb2-9043-814c6c2a16e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:27.022859 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdb2d35-a25f-4bb2-9043-814c6c2a16e8 None admin] RBAC: Adding query filter params (role.id=317f725e26bf43648d8235bb1f7c4cb3, scope.project.id=a492408a00474ddd952118fdba3219ad, user.id=e810a8642eca47c08efac54c4daa8fdf) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:29:27.023286 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdb2d35-a25f-4bb2-9043-814c6c2a16e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:27.024862 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdb2d35-a25f-4bb2-9043-814c6c2a16e8 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:27.033079 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 118/223] 10.222.0.15 () {56 vars in 1374 bytes} [Tue May 31 14:29:26 2022] GET /identity/v3/role_assignments?user.id=e810a8642eca47c08efac54c4daa8fdf&scope.project.id=a492408a00474ddd952118fdba3219ad&role.id=317f725e26bf43648d8235bb1f7c4cb3 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:27.054677 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4ed733-854c-41d9-91d5-910dd8d60504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:27.055669 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4ed733-854c-41d9-91d5-910dd8d60504 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:27.056127 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4ed733-854c-41d9-91d5-910dd8d60504 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:27.056576 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4ed733-854c-41d9-91d5-910dd8d60504 None admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:27.057518 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4ed733-854c-41d9-91d5-910dd8d60504 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:29:27.058007 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4ed733-854c-41d9-91d5-910dd8d60504 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:27.059652 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4ed733-854c-41d9-91d5-910dd8d60504 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:27.071232 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 106/224] 10.222.0.15 () {56 vars in 1099 bytes} [Tue May 31 14:29:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 14:29:27.077376 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdb2d35-a25f-4bb2-9043-814c6c2a16e8 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:27.199293 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc848af-89a9-449f-8f8a-1f9015dda61f None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:27.199618 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc848af-89a9-449f-8f8a-1f9015dda61f None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:27.199863 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc848af-89a9-449f-8f8a-1f9015dda61f None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:27.201343 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 107/225] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:29:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 31 14:29:27.210156 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596a820-2699-4e50-8898-4e6920fca64e None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:27.210433 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596a820-2699-4e50-8898-4e6920fca64e None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:27.210760 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596a820-2699-4e50-8898-4e6920fca64e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:27.214513 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdb2d35-a25f-4bb2-9043-814c6c2a16e8 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:27.246971 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-d596a820-2699-4e50-8898-4e6920fca64e None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:29:27.248175 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-d596a820-2699-4e50-8898-4e6920fca64e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:29:27.256863 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63857031-630f-42bc-87b1-1b8b4eb88a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:27.257753 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63857031-630f-42bc-87b1-1b8b4eb88a58 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:27.258036 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63857031-630f-42bc-87b1-1b8b4eb88a58 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:27.258311 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63857031-630f-42bc-87b1-1b8b4eb88a58 None admin] PATH_INFO: `/v3/users/89d1c5fc37004be295785b8d947d23af` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:27.259626 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63857031-630f-42bc-87b1-1b8b4eb88a58 None admin] RBAC: Authorizing `identity:get_user(user_id=89d1c5fc37004be295785b8d947d23af)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:27.261319 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63857031-630f-42bc-87b1-1b8b4eb88a58 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:27.263296 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 119/226] 10.222.0.15 () {56 vars in 1177 bytes} [Tue May 31 14:29:27 2022] GET /identity/v3/users/89d1c5fc37004be295785b8d947d23af => generated 283 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:27.271488 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63857031-630f-42bc-87b1-1b8b4eb88a58 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:27.275404 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:27.362381 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 108/227] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:29:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 31 14:29:27.388338 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d596a820-2699-4e50-8898-4e6920fca64e None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:27.428450 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63857031-630f-42bc-87b1-1b8b4eb88a58 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:27.458327 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:27.493558 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d596a820-2699-4e50-8898-4e6920fca64e None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:27.501523 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fffa797-0fc3-446f-ae05-35fd151c52e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:27.502642 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fffa797-0fc3-446f-ae05-35fd151c52e2 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:27.503066 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fffa797-0fc3-446f-ae05-35fd151c52e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:27.503481 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fffa797-0fc3-446f-ae05-35fd151c52e2 None admin] PATH_INFO: `/v3/projects/a492408a00474ddd952118fdba3219ad` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:27.504872 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fffa797-0fc3-446f-ae05-35fd151c52e2 None admin] RBAC: Authorizing `identity:get_project(project_id=a492408a00474ddd952118fdba3219ad)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:27.515250 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fffa797-0fc3-446f-ae05-35fd151c52e2 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:27.517649 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 120/228] 10.222.0.15 () {56 vars in 1186 bytes} [Tue May 31 14:29:27 2022] GET /identity/v3/projects/a492408a00474ddd952118fdba3219ad => generated 302 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:27.523305 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fffa797-0fc3-446f-ae05-35fd151c52e2 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:27.531172 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04f32a4-16e8-4ad5-9ab2-e089fc93a86c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:27.532395 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04f32a4-16e8-4ad5-9ab2-e089fc93a86c None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:27.532785 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04f32a4-16e8-4ad5-9ab2-e089fc93a86c None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:27.533166 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04f32a4-16e8-4ad5-9ab2-e089fc93a86c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:27.546143 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04f32a4-16e8-4ad5-9ab2-e089fc93a86c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 14:29:27.556167 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-d04f32a4-16e8-4ad5-9ab2-e089fc93a86c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 31 14:29:27.556167 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:29:27.556167 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:29:27.556167 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:29:27.556167 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:29:27.556167 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:29:27.556167 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:29:27.556167 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:29:27.556167 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:29:27.556167 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:29:27.556167 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:29:27.556167 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:29:27.556167 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 14:29:27.556167 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 14:29:27.556167 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 14:29:27.556167 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 14:29:27.557247 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 14:29:27.557247 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 14:29:27.557247 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 14:29:27.557247 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 14:29:27.557247 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:29:27.557247 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:29:27.557247 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:29:27.557247 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:29:27.557247 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:29:27.557247 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:29:27.557247 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:29:27.557247 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:29:27.557247 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:29:27.557247 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:29:27.557247 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:29:27.557247 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:29:27.558244 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:29:27.558244 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:29:27.558244 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:29:27.558244 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:29:27.558244 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 14:29:27.558244 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 14:29:27.558244 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 14:29:27.558244 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 14:29:27.558244 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 14:29:27.558244 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 14:29:27.558244 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 31 14:29:27.558244 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:29:27.560332 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 109/229] 10.222.0.15 () {56 vars in 1114 bytes} [Tue May 31 14:29:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:29:27.567612 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04f32a4-16e8-4ad5-9ab2-e089fc93a86c None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:27.630220 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:27.680135 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fffa797-0fc3-446f-ae05-35fd151c52e2 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:27.690248 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04f32a4-16e8-4ad5-9ab2-e089fc93a86c None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:27.718975 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:27.726504 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7152d0b1-061f-4444-b951-a5c5558ca30b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:27.727523 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7152d0b1-061f-4444-b951-a5c5558ca30b None admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:27.727878 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7152d0b1-061f-4444-b951-a5c5558ca30b None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:27.729147 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7152d0b1-061f-4444-b951-a5c5558ca30b None admin] PATH_INFO: `/v3/projects/a492408a00474ddd952118fdba3219ad/users/89d1c5fc37004be295785b8d947d23af/roles/76c53e2c353644f885028a0226c06146` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:27.729253 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d90e99e-bee3-4976-813a-70b17eeb255f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:27.729488 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d90e99e-bee3-4976-813a-70b17eeb255f None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:27.730007 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d90e99e-bee3-4976-813a-70b17eeb255f None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:27.730424 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d90e99e-bee3-4976-813a-70b17eeb255f None admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:27.730916 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7152d0b1-061f-4444-b951-a5c5558ca30b None admin] RBAC: Authorizing `identity:create_grant(project_id=a492408a00474ddd952118fdba3219ad, user_id=89d1c5fc37004be295785b8d947d23af, role_id=76c53e2c353644f885028a0226c06146)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:27.731592 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d90e99e-bee3-4976-813a-70b17eeb255f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:29:27.732074 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d90e99e-bee3-4976-813a-70b17eeb255f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:27.732651 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7152d0b1-061f-4444-b951-a5c5558ca30b None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:27.733765 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d90e99e-bee3-4976-813a-70b17eeb255f None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:27.746645 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 110/230] 10.222.0.15 () {56 vars in 1111 bytes} [Tue May 31 14:29:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:27.752961 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d90e99e-bee3-4976-813a-70b17eeb255f None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:27.812797 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 121/231] 10.222.0.15 () {58 vars in 1439 bytes} [Tue May 31 14:29:27 2022] PUT /identity/v3/projects/a492408a00474ddd952118fdba3219ad/users/89d1c5fc37004be295785b8d947d23af/roles/76c53e2c353644f885028a0226c06146 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 14:29:27.867660 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d90e99e-bee3-4976-813a-70b17eeb255f None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:27.919788 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27df588c-3aef-4bcb-ba95-3b037afb128f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:27.921091 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df588c-3aef-4bcb-ba95-3b037afb128f None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:27.921593 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df588c-3aef-4bcb-ba95-3b037afb128f None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:27.922067 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df588c-3aef-4bcb-ba95-3b037afb128f None admin] PATH_INFO: `/v3/users/89d1c5fc37004be295785b8d947d23af` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:27.923658 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27df588c-3aef-4bcb-ba95-3b037afb128f None admin] RBAC: Authorizing `identity:get_user(user_id=89d1c5fc37004be295785b8d947d23af)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:27.925448 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27df588c-3aef-4bcb-ba95-3b037afb128f None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:27.932720 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 111/232] 10.222.0.15 () {56 vars in 1177 bytes} [Tue May 31 14:29:27 2022] GET /identity/v3/users/89d1c5fc37004be295785b8d947d23af => generated 283 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:27.935707 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7152d0b1-061f-4444-b951-a5c5558ca30b None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:28.085001 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7152d0b1-061f-4444-b951-a5c5558ca30b None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:28.116030 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:28.121679 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acc481c-d994-48e6-bd44-ba36bb07967e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:28.122599 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc481c-d994-48e6-bd44-ba36bb07967e None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:28.122892 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc481c-d994-48e6-bd44-ba36bb07967e None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:28.123176 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc481c-d994-48e6-bd44-ba36bb07967e None admin] PATH_INFO: `/v3/projects/a492408a00474ddd952118fdba3219ad` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:28.124366 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acc481c-d994-48e6-bd44-ba36bb07967e None admin] RBAC: Authorizing `identity:get_project(project_id=a492408a00474ddd952118fdba3219ad)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:28.125902 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acc481c-d994-48e6-bd44-ba36bb07967e None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:28.127843 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 122/233] 10.222.0.15 () {56 vars in 1186 bytes} [Tue May 31 14:29:27 2022] GET /identity/v3/projects/a492408a00474ddd952118fdba3219ad => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:28.133929 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27df588c-3aef-4bcb-ba95-3b037afb128f None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:28.204423 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:28.258526 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27df588c-3aef-4bcb-ba95-3b037afb128f None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:28.307358 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c95e15-1958-4d16-9685-d64d520a022b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:28.308259 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c95e15-1958-4d16-9685-d64d520a022b None admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:28.308547 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c95e15-1958-4d16-9685-d64d520a022b None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:28.308889 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c95e15-1958-4d16-9685-d64d520a022b None admin] PATH_INFO: `/v3/projects/a492408a00474ddd952118fdba3219ad/users/89d1c5fc37004be295785b8d947d23af/roles/86e29729720b4d53b2a375a337765a2d` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:28.316548 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c95e15-1958-4d16-9685-d64d520a022b None admin] RBAC: Authorizing `identity:create_grant(project_id=a492408a00474ddd952118fdba3219ad, user_id=89d1c5fc37004be295785b8d947d23af, role_id=86e29729720b4d53b2a375a337765a2d)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:28.321192 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c95e15-1958-4d16-9685-d64d520a022b None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:28.491217 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 112/234] 10.222.0.15 () {58 vars in 1439 bytes} [Tue May 31 14:29:28 2022] PUT /identity/v3/projects/a492408a00474ddd952118fdba3219ad/users/89d1c5fc37004be295785b8d947d23af/roles/86e29729720b4d53b2a375a337765a2d => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:29:29.364927 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c86dac-a4ef-4415-9116-b8d012a4c90b None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:29.365433 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c86dac-a4ef-4415-9116-b8d012a4c90b None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:29.365506 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c86dac-a4ef-4415-9116-b8d012a4c90b None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:29.367688 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 123/235] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:29:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:29:29.372810 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1721fe77-96a8-4dd8-b064-08cfbbfcaa23 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:29.373212 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1721fe77-96a8-4dd8-b064-08cfbbfcaa23 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:29.373378 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1721fe77-96a8-4dd8-b064-08cfbbfcaa23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:29.399732 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-1721fe77-96a8-4dd8-b064-08cfbbfcaa23 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:29:29.401009 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-1721fe77-96a8-4dd8-b064-08cfbbfcaa23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:29:29.488923 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 113/236] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:29:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 14:29:29.536009 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c86dac-a4ef-4415-9116-b8d012a4c90b None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:29.653114 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c86dac-a4ef-4415-9116-b8d012a4c90b None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:29.688615 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecdd824-4a4c-4ebc-a1bb-e0e6c4a06382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:29.689433 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecdd824-4a4c-4ebc-a1bb-e0e6c4a06382 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:29.689718 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecdd824-4a4c-4ebc-a1bb-e0e6c4a06382 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:29.689994 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecdd824-4a4c-4ebc-a1bb-e0e6c4a06382 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:29.700661 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecdd824-4a4c-4ebc-a1bb-e0e6c4a06382 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 14:29:29.708851 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-0ecdd824-4a4c-4ebc-a1bb-e0e6c4a06382 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 31 14:29:29.708851 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:29:29.708851 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:29:29.708851 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:29:29.708851 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:29:29.708851 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:29:29.708851 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:29:29.708851 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:29:29.708851 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:29:29.708851 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:29:29.708851 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:29:29.708851 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:29:29.708851 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 14:29:29.708851 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 14:29:29.708851 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 14:29:29.708851 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 14:29:29.709786 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 14:29:29.709786 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 14:29:29.709786 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 14:29:29.709786 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 14:29:29.709786 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:29:29.709786 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:29:29.709786 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:29:29.709786 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:29:29.709786 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:29:29.709786 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:29:29.709786 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:29:29.709786 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:29:29.709786 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:29:29.709786 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:29:29.709786 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:29:29.709786 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:29:29.710589 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:29:29.710589 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:29:29.710589 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:29:29.710589 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:29:29.710589 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 14:29:29.710589 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 14:29:29.710589 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 14:29:29.710589 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 14:29:29.710589 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 14:29:29.710589 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 14:29:29.710589 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 31 14:29:29.710589 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:29:29.710589 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 124/237] 10.222.0.15 () {56 vars in 1099 bytes} [Tue May 31 14:29:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:29:29.715879 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1721fe77-96a8-4dd8-b064-08cfbbfcaa23 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:29.761775 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e17e03-d1a1-4daa-8607-64b56d339984 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:29.762062 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e17e03-d1a1-4daa-8607-64b56d339984 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:29.762343 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e17e03-d1a1-4daa-8607-64b56d339984 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:29.763860 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 125/238] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:29:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:29:29.768823 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4565f02-7d97-4755-9d7b-d6650ea185e0 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:29.769110 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4565f02-7d97-4755-9d7b-d6650ea185e0 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:29.769389 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4565f02-7d97-4755-9d7b-d6650ea185e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:29.790919 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:29.799574 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-e4565f02-7d97-4755-9d7b-d6650ea185e0 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:29:29.800796 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-e4565f02-7d97-4755-9d7b-d6650ea185e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:29:29.842856 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1721fe77-96a8-4dd8-b064-08cfbbfcaa23 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:29.881969 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:29.884002 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da6ca9c-92bd-47f7-a33b-8f4f50acadd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:29.884750 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da6ca9c-92bd-47f7-a33b-8f4f50acadd1 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:29.885104 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da6ca9c-92bd-47f7-a33b-8f4f50acadd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:29.885452 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da6ca9c-92bd-47f7-a33b-8f4f50acadd1 None admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:29.886271 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da6ca9c-92bd-47f7-a33b-8f4f50acadd1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:29:29.886676 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da6ca9c-92bd-47f7-a33b-8f4f50acadd1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:29.888121 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da6ca9c-92bd-47f7-a33b-8f4f50acadd1 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:29.896734 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 126/239] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:29:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 31 14:29:29.897851 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 114/240] 10.222.0.15 () {56 vars in 1101 bytes} [Tue May 31 14:29:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:29.898911 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33417a72-e486-416f-938e-917665a2bf3e None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:29.899250 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33417a72-e486-416f-938e-917665a2bf3e None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:29.899536 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33417a72-e486-416f-938e-917665a2bf3e None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:29.903378 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da6ca9c-92bd-47f7-a33b-8f4f50acadd1 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:29.905128 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 127/241] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:29:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:29:29.906892 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473dd5ff-ef9b-4d67-bb32-ac34df52aa81 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:29.907183 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473dd5ff-ef9b-4d67-bb32-ac34df52aa81 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:29.907716 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473dd5ff-ef9b-4d67-bb32-ac34df52aa81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:29.932209 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-473dd5ff-ef9b-4d67-bb32-ac34df52aa81 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:29:29.933548 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-473dd5ff-ef9b-4d67-bb32-ac34df52aa81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:29:30.010973 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 128/242] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:29:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 14:29:30.012033 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473dd5ff-ef9b-4d67-bb32-ac34df52aa81 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:30.034239 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da6ca9c-92bd-47f7-a33b-8f4f50acadd1 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:30.046034 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:30.072737 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f103f7a1-1850-4d3c-bd0b-583daa85eb5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:30.073749 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f103f7a1-1850-4d3c-bd0b-583daa85eb5e None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:30.074231 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f103f7a1-1850-4d3c-bd0b-583daa85eb5e None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:30.074637 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f103f7a1-1850-4d3c-bd0b-583daa85eb5e None admin] PATH_INFO: `/v3/users/f779cdf9688540e8b3dbe7734534c931` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:30.091029 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f103f7a1-1850-4d3c-bd0b-583daa85eb5e None admin] RBAC: Authorizing `identity:get_user(user_id=f779cdf9688540e8b3dbe7734534c931)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:30.092877 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f103f7a1-1850-4d3c-bd0b-583daa85eb5e None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:30.095172 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 115/243] 10.222.0.15 () {56 vars in 1177 bytes} [Tue May 31 14:29:29 2022] GET /identity/v3/users/f779cdf9688540e8b3dbe7734534c931 => generated 297 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:30.101349 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f103f7a1-1850-4d3c-bd0b-583daa85eb5e None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:30.117474 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473dd5ff-ef9b-4d67-bb32-ac34df52aa81 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:30.135548 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:30.152984 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153cdd0f-2ffd-4ef9-a6db-155f7342aabe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:30.154064 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153cdd0f-2ffd-4ef9-a6db-155f7342aabe None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:30.154585 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153cdd0f-2ffd-4ef9-a6db-155f7342aabe None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:30.155062 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153cdd0f-2ffd-4ef9-a6db-155f7342aabe None admin] PATH_INFO: `/v3/roles/member` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:30.167237 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153cdd0f-2ffd-4ef9-a6db-155f7342aabe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 14:29:30.175737 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-153cdd0f-2ffd-4ef9-a6db-155f7342aabe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 31 14:29:30.175737 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:29:30.175737 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:29:30.175737 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:29:30.175737 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:29:30.175737 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:29:30.175737 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:29:30.175737 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:29:30.175737 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:29:30.175737 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:29:30.175737 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:29:30.175737 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:29:30.175737 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 14:29:30.175737 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 14:29:30.175737 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 14:29:30.175737 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 14:29:30.176639 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 14:29:30.176639 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 14:29:30.176639 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 14:29:30.176639 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 14:29:30.176639 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:29:30.176639 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:29:30.176639 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:29:30.176639 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:29:30.176639 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:29:30.176639 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:29:30.176639 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:29:30.176639 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:29:30.176639 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:29:30.176639 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:29:30.176639 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:29:30.176639 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:29:30.177437 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:29:30.177437 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:29:30.177437 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:29:30.177437 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:29:30.177437 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 14:29:30.177437 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 14:29:30.177437 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 14:29:30.177437 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 14:29:30.177437 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 14:29:30.177437 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 14:29:30.177437 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 31 14:29:30.177437 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:29:30.180323 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 129/244] 10.222.0.15 () {56 vars in 1099 bytes} [Tue May 31 14:29:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:29:30.185802 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153cdd0f-2ffd-4ef9-a6db-155f7342aabe None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:30.214392 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f103f7a1-1850-4d3c-bd0b-583daa85eb5e None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:30.252446 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227478bb-503b-4ad6-9a63-38b2ac38590e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:30.253256 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227478bb-503b-4ad6-9a63-38b2ac38590e None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:30.253538 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227478bb-503b-4ad6-9a63-38b2ac38590e None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:30.253814 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227478bb-503b-4ad6-9a63-38b2ac38590e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:30.255268 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227478bb-503b-4ad6-9a63-38b2ac38590e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:30.257420 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227478bb-503b-4ad6-9a63-38b2ac38590e None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:30.259612 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 116/245] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:29:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:30.260429 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227478bb-503b-4ad6-9a63-38b2ac38590e None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:30.294391 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153cdd0f-2ffd-4ef9-a6db-155f7342aabe None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:30.298400 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:30.331287 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f3e924-e286-446b-ab02-9da8c66495c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:30.332285 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f3e924-e286-446b-ab02-9da8c66495c9 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:30.332762 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f3e924-e286-446b-ab02-9da8c66495c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:30.333236 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f3e924-e286-446b-ab02-9da8c66495c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:30.373918 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227478bb-503b-4ad6-9a63-38b2ac38590e None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:30.432279 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:30.458815 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b642567-c842-4c1f-8d0b-48e9bb75b69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:30.460122 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b642567-c842-4c1f-8d0b-48e9bb75b69f None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:30.460355 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f3e924-e286-446b-ab02-9da8c66495c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:30.460833 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b642567-c842-4c1f-8d0b-48e9bb75b69f None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:30.461304 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b642567-c842-4c1f-8d0b-48e9bb75b69f None admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:30.461847 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f3e924-e286-446b-ab02-9da8c66495c9 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:30.462442 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b642567-c842-4c1f-8d0b-48e9bb75b69f None admin] RBAC: Adding query filter params (name=member) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:29:30.462962 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b642567-c842-4c1f-8d0b-48e9bb75b69f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:30.465482 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b642567-c842-4c1f-8d0b-48e9bb75b69f None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:30.477383 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 117/246] 10.222.0.15 () {56 vars in 1101 bytes} [Tue May 31 14:29:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:30.482235 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b642567-c842-4c1f-8d0b-48e9bb75b69f None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:30.586802 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 130/247] 10.222.0.15 () {58 vars in 1282 bytes} [Tue May 31 14:29:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 31 14:29:30.591208 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f3e924-e286-446b-ab02-9da8c66495c9 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:30.603789 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:30.609198 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b642567-c842-4c1f-8d0b-48e9bb75b69f None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:30.646779 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f1f88f-6ac1-4172-9f32-3d54d15f94b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:30.647822 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f1f88f-6ac1-4172-9f32-3d54d15f94b6 None admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:30.648251 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f1f88f-6ac1-4172-9f32-3d54d15f94b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:30.648668 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f1f88f-6ac1-4172-9f32-3d54d15f94b6 None admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:30.649551 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f1f88f-6ac1-4172-9f32-3d54d15f94b6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:30.651369 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f1f88f-6ac1-4172-9f32-3d54d15f94b6 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:30.682526 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:30.703385 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f3e924-e286-446b-ab02-9da8c66495c9 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:30.729394 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 118/248] 10.222.0.15 () {60 vars in 1132 bytes} [Tue May 31 14:29:30 2022] POST /identity/v3/users => generated 293 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:29:30.730240 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f1f88f-6ac1-4172-9f32-3d54d15f94b6 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:30.751040 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df98e3c4-2bb7-4d08-996a-f0e77cfad747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:30.753233 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df98e3c4-2bb7-4d08-996a-f0e77cfad747 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:30.753788 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df98e3c4-2bb7-4d08-996a-f0e77cfad747 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:30.754534 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df98e3c4-2bb7-4d08-996a-f0e77cfad747 None admin] PATH_INFO: `/v3/users/e810a8642eca47c08efac54c4daa8fdf` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:30.756464 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df98e3c4-2bb7-4d08-996a-f0e77cfad747 None admin] RBAC: Authorizing `identity:get_user(user_id=e810a8642eca47c08efac54c4daa8fdf)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:30.758716 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df98e3c4-2bb7-4d08-996a-f0e77cfad747 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:30.761778 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 131/249] 10.222.0.15 () {56 vars in 1177 bytes} [Tue May 31 14:29:30 2022] GET /identity/v3/users/e810a8642eca47c08efac54c4daa8fdf => generated 297 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:30.763514 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d24f91-db8c-4e38-b67e-db4b807d76de None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:30.765815 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d24f91-db8c-4e38-b67e-db4b807d76de None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:30.765815 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d24f91-db8c-4e38-b67e-db4b807d76de None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:30.765815 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 132/250] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:29:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:29:30.773117 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d24f91-db8c-4e38-b67e-db4b807d76de None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:30.870265 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f1f88f-6ac1-4172-9f32-3d54d15f94b6 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:30.889147 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d24f91-db8c-4e38-b67e-db4b807d76de None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:30.906820 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4257c974-15ba-417a-8646-a90e82075239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:30.907941 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4257c974-15ba-417a-8646-a90e82075239 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:30.908392 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4257c974-15ba-417a-8646-a90e82075239 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:30.908809 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4257c974-15ba-417a-8646-a90e82075239 None admin] PATH_INFO: `/v3/projects/a492408a00474ddd952118fdba3219ad` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:30.910242 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4257c974-15ba-417a-8646-a90e82075239 None admin] RBAC: Authorizing `identity:get_project(project_id=a492408a00474ddd952118fdba3219ad)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:30.911816 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4257c974-15ba-417a-8646-a90e82075239 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:30.914354 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 119/251] 10.222.0.15 () {56 vars in 1186 bytes} [Tue May 31 14:29:30 2022] GET /identity/v3/projects/a492408a00474ddd952118fdba3219ad => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:30.915944 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e41e47-b5da-4be4-8058-69bf26ead28a None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:30.916505 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e41e47-b5da-4be4-8058-69bf26ead28a None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:30.916985 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e41e47-b5da-4be4-8058-69bf26ead28a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:30.935758 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-69e41e47-b5da-4be4-8058-69bf26ead28a None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:29:30.936543 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24f7727-a7b5-4231-9d05-09c77e875446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:30.937518 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24f7727-a7b5-4231-9d05-09c77e875446 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:30.937851 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24f7727-a7b5-4231-9d05-09c77e875446 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:30.938090 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-69e41e47-b5da-4be4-8058-69bf26ead28a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:29:30.938246 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24f7727-a7b5-4231-9d05-09c77e875446 None admin] PATH_INFO: `/v3/projects/a492408a00474ddd952118fdba3219ad` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:30.939614 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24f7727-a7b5-4231-9d05-09c77e875446 None admin] RBAC: Authorizing `identity:get_project(project_id=a492408a00474ddd952118fdba3219ad)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:30.941700 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24f7727-a7b5-4231-9d05-09c77e875446 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:30.950502 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 133/252] 10.222.0.15 () {56 vars in 1186 bytes} [Tue May 31 14:29:30 2022] GET /identity/v3/projects/a492408a00474ddd952118fdba3219ad => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 14:29:30.951553 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24f7727-a7b5-4231-9d05-09c77e875446 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:30.962931 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:30.977101 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:31.032177 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 120/253] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:29:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 14:29:31.033377 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e41e47-b5da-4be4-8058-69bf26ead28a None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:31.082248 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24f7727-a7b5-4231-9d05-09c77e875446 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:31.123908 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf935bf-4edc-4f89-951d-9ddbfdf031ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:31.124580 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf935bf-4edc-4f89-951d-9ddbfdf031ad None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:31.124863 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf935bf-4edc-4f89-951d-9ddbfdf031ad None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:31.125136 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf935bf-4edc-4f89-951d-9ddbfdf031ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:31.125966 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf935bf-4edc-4f89-951d-9ddbfdf031ad None admin] RBAC: Adding query filter params (role.id=7ac88acfdd6d4edaa12064f0d47e1bf9, scope.project.id=a492408a00474ddd952118fdba3219ad, user.id=f779cdf9688540e8b3dbe7734534c931) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:29:31.126856 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf935bf-4edc-4f89-951d-9ddbfdf031ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:31.128622 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf935bf-4edc-4f89-951d-9ddbfdf031ad None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:31.136452 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 134/254] 10.222.0.15 () {56 vars in 1374 bytes} [Tue May 31 14:29:30 2022] GET /identity/v3/role_assignments?user.id=f779cdf9688540e8b3dbe7734534c931&scope.project.id=a492408a00474ddd952118fdba3219ad&role.id=7ac88acfdd6d4edaa12064f0d47e1bf9 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:31.138667 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf935bf-4edc-4f89-951d-9ddbfdf031ad None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:31.166042 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e41e47-b5da-4be4-8058-69bf26ead28a None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:31.218903 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aa9411-cf79-4139-a435-f1a8b1d08a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:31.219828 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aa9411-cf79-4139-a435-f1a8b1d08a81 None admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:31.220313 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aa9411-cf79-4139-a435-f1a8b1d08a81 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:31.220601 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aa9411-cf79-4139-a435-f1a8b1d08a81 None admin] PATH_INFO: `/v3/projects/a492408a00474ddd952118fdba3219ad/users/e810a8642eca47c08efac54c4daa8fdf/roles/317f725e26bf43648d8235bb1f7c4cb3` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:31.223569 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aa9411-cf79-4139-a435-f1a8b1d08a81 None admin] RBAC: Authorizing `identity:create_grant(project_id=a492408a00474ddd952118fdba3219ad, user_id=e810a8642eca47c08efac54c4daa8fdf, role_id=317f725e26bf43648d8235bb1f7c4cb3)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:31.225162 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aa9411-cf79-4139-a435-f1a8b1d08a81 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:31.243475 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:31.274010 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf935bf-4edc-4f89-951d-9ddbfdf031ad None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:31.301429 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 121/255] 10.222.0.15 () {58 vars in 1439 bytes} [Tue May 31 14:29:31 2022] PUT /identity/v3/projects/a492408a00474ddd952118fdba3219ad/users/e810a8642eca47c08efac54c4daa8fdf/roles/317f725e26bf43648d8235bb1f7c4cb3 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:29:31.303876 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e5c296-5e60-435c-b33c-f49aa30165b2 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:31.304244 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e5c296-5e60-435c-b33c-f49aa30165b2 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:31.304600 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e5c296-5e60-435c-b33c-f49aa30165b2 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:31.306273 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 122/256] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:29:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:29:31.313795 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676502c8-e0b5-4ed3-8759-f27d5d1c1691 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:31.314187 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676502c8-e0b5-4ed3-8759-f27d5d1c1691 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:31.314612 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676502c8-e0b5-4ed3-8759-f27d5d1c1691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:31.321502 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549b62ae-947d-4238-a290-2663ec1c28c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:31.323226 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b62ae-947d-4238-a290-2663ec1c28c5 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:31.323226 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b62ae-947d-4238-a290-2663ec1c28c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:31.323832 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b62ae-947d-4238-a290-2663ec1c28c5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:31.340033 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549b62ae-947d-4238-a290-2663ec1c28c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 14:29:31.340164 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-676502c8-e0b5-4ed3-8759-f27d5d1c1691 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:29:31.340505 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-676502c8-e0b5-4ed3-8759-f27d5d1c1691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:29:31.344597 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-549b62ae-947d-4238-a290-2663ec1c28c5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 31 14:29:31.344597 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:29:31.344597 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:29:31.344597 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:29:31.344597 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:29:31.344597 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:29:31.344597 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:29:31.344597 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:29:31.344597 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:29:31.344597 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:29:31.344597 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:29:31.344597 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:29:31.344597 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 14:29:31.344597 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 14:29:31.344597 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 14:29:31.344597 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 14:29:31.345557 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 14:29:31.345557 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 14:29:31.345557 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 14:29:31.345557 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 14:29:31.345557 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:29:31.345557 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:29:31.345557 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:29:31.345557 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:29:31.345557 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:29:31.345557 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:29:31.345557 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:29:31.345557 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:29:31.345557 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:29:31.345557 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:29:31.345557 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:29:31.345557 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:29:31.346393 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:29:31.346393 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:29:31.346393 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:29:31.346393 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:29:31.346393 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 14:29:31.346393 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 14:29:31.346393 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 14:29:31.346393 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 14:29:31.346393 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 14:29:31.346393 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 14:29:31.346393 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 31 14:29:31.346393 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:29:31.350724 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 135/257] 10.222.0.15 () {56 vars in 1096 bytes} [Tue May 31 14:29:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:29:31.352571 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549b62ae-947d-4238-a290-2663ec1c28c5 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:31.354192 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:31.484074 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 123/258] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:29:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 14:29:31.512400 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549b62ae-947d-4238-a290-2663ec1c28c5 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:31.523853 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676502c8-e0b5-4ed3-8759-f27d5d1c1691 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:31.589295 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f203cc-c749-44ee-a528-7325acaa9fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:31.589982 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f203cc-c749-44ee-a528-7325acaa9fed None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:31.590269 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f203cc-c749-44ee-a528-7325acaa9fed None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:31.590560 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f203cc-c749-44ee-a528-7325acaa9fed None admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:31.591325 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f203cc-c749-44ee-a528-7325acaa9fed None admin] RBAC: Adding query filter params (name=admin) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:29:31.594393 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f203cc-c749-44ee-a528-7325acaa9fed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:31.595843 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f203cc-c749-44ee-a528-7325acaa9fed None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:31.605095 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:31.617279 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 136/259] 10.222.0.15 () {56 vars in 1099 bytes} [Tue May 31 14:29:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 14:29:31.622954 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f203cc-c749-44ee-a528-7325acaa9fed None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:31.708051 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676502c8-e0b5-4ed3-8759-f27d5d1c1691 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:31.771560 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881cfcdf-8ed2-4b39-9eb6-e27f92ded923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:31.772352 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881cfcdf-8ed2-4b39-9eb6-e27f92ded923 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:31.772814 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881cfcdf-8ed2-4b39-9eb6-e27f92ded923 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:31.773103 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881cfcdf-8ed2-4b39-9eb6-e27f92ded923 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:31.792870 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881cfcdf-8ed2-4b39-9eb6-e27f92ded923 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 14:29:31.807954 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-881cfcdf-8ed2-4b39-9eb6-e27f92ded923 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 31 14:29:31.807954 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:29:31.807954 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:29:31.807954 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:29:31.807954 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:29:31.807954 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:29:31.807954 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:29:31.807954 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:29:31.807954 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:29:31.807954 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:29:31.807954 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:29:31.807954 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:29:31.807954 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 14:29:31.807954 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 14:29:31.807954 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 14:29:31.807954 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 14:29:31.808841 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 14:29:31.808841 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 14:29:31.808841 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 14:29:31.808841 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 14:29:31.808841 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:29:31.808841 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:29:31.808841 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:29:31.808841 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:29:31.808841 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:29:31.808841 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:29:31.808841 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:29:31.808841 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:29:31.808841 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:29:31.808841 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:29:31.808841 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:29:31.808841 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:29:31.809736 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:29:31.809736 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:29:31.809736 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:29:31.809736 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:29:31.809736 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 14:29:31.809736 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 14:29:31.809736 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 14:29:31.809736 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 14:29:31.809736 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 14:29:31.809736 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 14:29:31.809736 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 31 14:29:31.809736 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:29:31.809736 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 124/260] 10.222.0.15 () {56 vars in 1114 bytes} [Tue May 31 14:29:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:29:31.816659 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f203cc-c749-44ee-a528-7325acaa9fed None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:31.816827 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881cfcdf-8ed2-4b39-9eb6-e27f92ded923 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:31.822864 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:31.887303 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3193053-6619-4de2-8baa-5d7ac8d7a947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:31.888199 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3193053-6619-4de2-8baa-5d7ac8d7a947 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:31.888486 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3193053-6619-4de2-8baa-5d7ac8d7a947 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:31.888768 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3193053-6619-4de2-8baa-5d7ac8d7a947 None admin] PATH_INFO: `/v3/users/89d1c5fc37004be295785b8d947d23af` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:31.895329 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3193053-6619-4de2-8baa-5d7ac8d7a947 None admin] RBAC: Authorizing `identity:get_user(user_id=89d1c5fc37004be295785b8d947d23af)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:31.896819 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3193053-6619-4de2-8baa-5d7ac8d7a947 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:31.898600 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 137/261] 10.222.0.15 () {56 vars in 1177 bytes} [Tue May 31 14:29:31 2022] GET /identity/v3/users/89d1c5fc37004be295785b8d947d23af => generated 283 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:31.907759 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3193053-6619-4de2-8baa-5d7ac8d7a947 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:31.946953 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881cfcdf-8ed2-4b39-9eb6-e27f92ded923 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:32.008316 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2268a244-abe7-4808-9884-6c625e669ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:32.009006 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2268a244-abe7-4808-9884-6c625e669ea6 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:32.009366 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2268a244-abe7-4808-9884-6c625e669ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:32.009562 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2268a244-abe7-4808-9884-6c625e669ea6 None admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:32.010338 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2268a244-abe7-4808-9884-6c625e669ea6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:29:32.010677 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2268a244-abe7-4808-9884-6c625e669ea6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:32.012113 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2268a244-abe7-4808-9884-6c625e669ea6 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:32.018933 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:32.031210 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 125/262] 10.222.0.15 () {56 vars in 1111 bytes} [Tue May 31 14:29:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 14:29:32.031474 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2268a244-abe7-4808-9884-6c625e669ea6 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:32.056008 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3193053-6619-4de2-8baa-5d7ac8d7a947 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:32.093943 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91006ae8-a79f-4d86-8cbb-622f54f42051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:32.094616 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91006ae8-a79f-4d86-8cbb-622f54f42051 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:32.094905 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91006ae8-a79f-4d86-8cbb-622f54f42051 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:32.095182 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91006ae8-a79f-4d86-8cbb-622f54f42051 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:32.162028 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:32.176161 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91006ae8-a79f-4d86-8cbb-622f54f42051 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:32.177658 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91006ae8-a79f-4d86-8cbb-622f54f42051 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:32.238359 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2268a244-abe7-4808-9884-6c625e669ea6 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:32.247085 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:32.289074 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 138/263] 10.222.0.15 () {58 vars in 1282 bytes} [Tue May 31 14:29:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 31 14:29:32.294439 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91006ae8-a79f-4d86-8cbb-622f54f42051 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:32.310414 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3675ec9e-c6f6-4447-af8f-e5ee8ef05de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:32.313779 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3675ec9e-c6f6-4447-af8f-e5ee8ef05de8 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:32.314222 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3675ec9e-c6f6-4447-af8f-e5ee8ef05de8 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:32.314691 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3675ec9e-c6f6-4447-af8f-e5ee8ef05de8 None admin] PATH_INFO: `/v3/users/89d1c5fc37004be295785b8d947d23af` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:32.317551 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3675ec9e-c6f6-4447-af8f-e5ee8ef05de8 None admin] RBAC: Authorizing `identity:get_user(user_id=89d1c5fc37004be295785b8d947d23af)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:32.319219 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3675ec9e-c6f6-4447-af8f-e5ee8ef05de8 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:32.323566 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 126/264] 10.222.0.15 () {56 vars in 1177 bytes} [Tue May 31 14:29:32 2022] GET /identity/v3/users/89d1c5fc37004be295785b8d947d23af => generated 283 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 14:29:32.329063 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3675ec9e-c6f6-4447-af8f-e5ee8ef05de8 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:32.518252 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91006ae8-a79f-4d86-8cbb-622f54f42051 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:32.541165 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3675ec9e-c6f6-4447-af8f-e5ee8ef05de8 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:32.588769 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:32.593927 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eed409-c346-4ab0-be4d-0513a275b81e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:32.598893 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eed409-c346-4ab0-be4d-0513a275b81e None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:32.601717 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eed409-c346-4ab0-be4d-0513a275b81e None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:32.601717 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eed409-c346-4ab0-be4d-0513a275b81e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:32.602235 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e503d4-09fe-4813-aeae-a5ef11fda289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:32.603358 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e503d4-09fe-4813-aeae-a5ef11fda289 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:32.603836 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e503d4-09fe-4813-aeae-a5ef11fda289 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:32.604319 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e503d4-09fe-4813-aeae-a5ef11fda289 None admin] PATH_INFO: `/v3/projects/a492408a00474ddd952118fdba3219ad` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:32.611278 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e503d4-09fe-4813-aeae-a5ef11fda289 None admin] RBAC: Authorizing `identity:get_project(project_id=a492408a00474ddd952118fdba3219ad)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:32.613059 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e503d4-09fe-4813-aeae-a5ef11fda289 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:32.615349 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 139/265] 10.222.0.15 () {56 vars in 1186 bytes} [Tue May 31 14:29:32 2022] GET /identity/v3/projects/a492408a00474ddd952118fdba3219ad => generated 302 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:32.620965 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e503d4-09fe-4813-aeae-a5ef11fda289 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:32.711639 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:32.732668 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eed409-c346-4ab0-be4d-0513a275b81e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:32.734206 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eed409-c346-4ab0-be4d-0513a275b81e None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:32.907947 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e503d4-09fe-4813-aeae-a5ef11fda289 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:32.913669 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 127/266] 10.222.0.15 () {58 vars in 1282 bytes} [Tue May 31 14:29:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 585 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 31 14:29:32.922588 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eed409-c346-4ab0-be4d-0513a275b81e None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:32.992379 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57651d16-6082-4e5b-b9f5-d2827b08e942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:32.993410 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57651d16-6082-4e5b-b9f5-d2827b08e942 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:32.993889 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57651d16-6082-4e5b-b9f5-d2827b08e942 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:32.994358 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57651d16-6082-4e5b-b9f5-d2827b08e942 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:32.995428 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57651d16-6082-4e5b-b9f5-d2827b08e942 None admin] RBAC: Adding query filter params (role.id=76c53e2c353644f885028a0226c06146, scope.project.id=a492408a00474ddd952118fdba3219ad, user.id=89d1c5fc37004be295785b8d947d23af) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:29:32.995959 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57651d16-6082-4e5b-b9f5-d2827b08e942 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:32.997613 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57651d16-6082-4e5b-b9f5-d2827b08e942 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:32.999158 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:33.016863 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 140/267] 10.222.0.15 () {56 vars in 1374 bytes} [Tue May 31 14:29:32 2022] GET /identity/v3/role_assignments?user.id=89d1c5fc37004be295785b8d947d23af&scope.project.id=a492408a00474ddd952118fdba3219ad&role.id=76c53e2c353644f885028a0226c06146 => generated 608 bytes in 396 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 14:29:33.115170 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eed409-c346-4ab0-be4d-0513a275b81e None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:33.156982 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c157c722-3112-41f2-8638-6c4fe3c2aea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:33.158176 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c157c722-3112-41f2-8638-6c4fe3c2aea3 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:33.158404 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c157c722-3112-41f2-8638-6c4fe3c2aea3 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:33.158718 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c157c722-3112-41f2-8638-6c4fe3c2aea3 None admin] PATH_INFO: `/v3/projects/a492408a00474ddd952118fdba3219ad` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:33.159988 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c157c722-3112-41f2-8638-6c4fe3c2aea3 None admin] RBAC: Authorizing `identity:get_project(project_id=a492408a00474ddd952118fdba3219ad)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:33.161471 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c157c722-3112-41f2-8638-6c4fe3c2aea3 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:33.163742 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 128/268] 10.222.0.15 () {56 vars in 1186 bytes} [Tue May 31 14:29:32 2022] GET /identity/v3/projects/a492408a00474ddd952118fdba3219ad => generated 302 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:33.169305 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57651d16-6082-4e5b-b9f5-d2827b08e942 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:33.335270 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:33.341428 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57651d16-6082-4e5b-b9f5-d2827b08e942 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:33.429566 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c52949-00d7-4c49-ab48-138c3ecf5ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:33.430144 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c52949-00d7-4c49-ab48-138c3ecf5ad2 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:33.430425 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c52949-00d7-4c49-ab48-138c3ecf5ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:33.430722 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c52949-00d7-4c49-ab48-138c3ecf5ad2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:33.431544 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c52949-00d7-4c49-ab48-138c3ecf5ad2 None admin] RBAC: Adding query filter params (role.id=86e29729720b4d53b2a375a337765a2d, scope.project.id=a492408a00474ddd952118fdba3219ad, user.id=89d1c5fc37004be295785b8d947d23af) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:29:33.431851 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c52949-00d7-4c49-ab48-138c3ecf5ad2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:33.433289 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c52949-00d7-4c49-ab48-138c3ecf5ad2 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:33.443323 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 141/269] 10.222.0.15 () {56 vars in 1374 bytes} [Tue May 31 14:29:33 2022] GET /identity/v3/role_assignments?user.id=89d1c5fc37004be295785b8d947d23af&scope.project.id=a492408a00474ddd952118fdba3219ad&role.id=86e29729720b4d53b2a375a337765a2d => generated 608 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:34.155854 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca8fe57-28f4-4369-9ab9-44fc328083ba None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:34.156361 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca8fe57-28f4-4369-9ab9-44fc328083ba None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:34.156461 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca8fe57-28f4-4369-9ab9-44fc328083ba None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:34.158110 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 129/270] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:29:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:29:34.164395 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0b961a-8eb5-4c8e-8965-850ed9ac8fdc None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:34.164872 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0b961a-8eb5-4c8e-8965-850ed9ac8fdc None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:34.164958 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0b961a-8eb5-4c8e-8965-850ed9ac8fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:34.182486 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-fc0b961a-8eb5-4c8e-8965-850ed9ac8fdc None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:29:34.183739 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-fc0b961a-8eb5-4c8e-8965-850ed9ac8fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:29:34.269278 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 142/271] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:29:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 14:29:34.281841 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cbfe24-d934-48a5-9460-a331172704b0 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:34.282135 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cbfe24-d934-48a5-9460-a331172704b0 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:34.282433 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cbfe24-d934-48a5-9460-a331172704b0 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:34.285841 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 130/272] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:29:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:29:34.290332 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d3b60c-ff83-405c-b74a-55f33efdd252 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:34.290745 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d3b60c-ff83-405c-b74a-55f33efdd252 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:34.291042 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d3b60c-ff83-405c-b74a-55f33efdd252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:34.296611 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cbfe24-d934-48a5-9460-a331172704b0 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:34.309749 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-86d3b60c-ff83-405c-b74a-55f33efdd252 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:29:34.311287 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-86d3b60c-ff83-405c-b74a-55f33efdd252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:29:34.385608 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 143/273] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:29:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 14:29:34.394833 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89782f12-3505-4a51-affe-374d3e2949bb None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:34.394833 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89782f12-3505-4a51-affe-374d3e2949bb None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:34.394833 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89782f12-3505-4a51-affe-374d3e2949bb None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:34.394833 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 144/274] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:29:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:29:34.399212 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ade56-478b-4697-a0b6-51ed4d2d402e None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:34.399503 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ade56-478b-4697-a0b6-51ed4d2d402e None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:34.399782 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ade56-478b-4697-a0b6-51ed4d2d402e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:34.418013 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:34.418165 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-714ade56-478b-4697-a0b6-51ed4d2d402e None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:29:34.419457 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-714ade56-478b-4697-a0b6-51ed4d2d402e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:29:34.421805 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cbfe24-d934-48a5-9460-a331172704b0 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:34.437607 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:34.456917 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7352674e-b92d-48f5-919e-2ceec9147366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:34.457741 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7352674e-b92d-48f5-919e-2ceec9147366 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:34.458029 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7352674e-b92d-48f5-919e-2ceec9147366 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:34.458309 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7352674e-b92d-48f5-919e-2ceec9147366 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:34.459530 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7352674e-b92d-48f5-919e-2ceec9147366 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:34.461028 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7352674e-b92d-48f5-919e-2ceec9147366 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:34.462884 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 131/275] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:29:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 14:29:34.463429 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7352674e-b92d-48f5-919e-2ceec9147366 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:34.487467 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 145/276] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:29:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 31 14:29:34.488851 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c62674-0828-4ba4-b6ff-602303dfb1bd None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:34.489146 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c62674-0828-4ba4-b6ff-602303dfb1bd None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:34.489425 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c62674-0828-4ba4-b6ff-602303dfb1bd None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:34.490917 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 146/277] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:29:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:29:34.492132 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c62674-0828-4ba4-b6ff-602303dfb1bd None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:34.568287 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7352674e-b92d-48f5-919e-2ceec9147366 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:34.592471 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c62674-0828-4ba4-b6ff-602303dfb1bd None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:34.602734 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bd6793-8e79-4007-a9f7-c4b90dadbb3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:34.603530 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bd6793-8e79-4007-a9f7-c4b90dadbb3c None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:34.603815 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bd6793-8e79-4007-a9f7-c4b90dadbb3c None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:34.604101 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bd6793-8e79-4007-a9f7-c4b90dadbb3c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:34.614154 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bd6793-8e79-4007-a9f7-c4b90dadbb3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 14:29:34.621862 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-a1bd6793-8e79-4007-a9f7-c4b90dadbb3c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 31 14:29:34.621862 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:29:34.621862 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:29:34.621862 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:29:34.621862 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:29:34.621862 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:29:34.621862 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:29:34.621862 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:29:34.621862 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:29:34.621862 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:29:34.621862 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:29:34.621862 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:29:34.621862 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 14:29:34.621862 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 14:29:34.621862 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 14:29:34.621862 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 14:29:34.622803 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 14:29:34.622803 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 14:29:34.622803 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 14:29:34.622803 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 14:29:34.622803 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:29:34.622803 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:29:34.622803 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:29:34.622803 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:29:34.622803 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:29:34.622803 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:29:34.622803 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:29:34.622803 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:29:34.622803 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:29:34.622803 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:29:34.622803 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:29:34.622803 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:29:34.623588 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:29:34.623588 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:29:34.623588 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:29:34.623588 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:29:34.623588 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 14:29:34.623588 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 14:29:34.623588 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 14:29:34.623588 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 14:29:34.623588 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 14:29:34.623588 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 14:29:34.623588 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 31 14:29:34.623588 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:29:34.623588 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 132/278] 10.222.0.15 () {56 vars in 1099 bytes} [Tue May 31 14:29:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:29:34.624384 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d5bc1-147c-4131-8fa6-4bf52ac0f7e3 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:34.624598 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d5bc1-147c-4131-8fa6-4bf52ac0f7e3 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:34.624881 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d5bc1-147c-4131-8fa6-4bf52ac0f7e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:34.629707 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dd17cd-1348-43b2-8778-5f2311b7b918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:34.630371 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd17cd-1348-43b2-8778-5f2311b7b918 None admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:34.630673 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd17cd-1348-43b2-8778-5f2311b7b918 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:34.630948 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd17cd-1348-43b2-8778-5f2311b7b918 None admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:34.631674 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dd17cd-1348-43b2-8778-5f2311b7b918 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:34.633129 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dd17cd-1348-43b2-8778-5f2311b7b918 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:34.642386 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-854d5bc1-147c-4131-8fa6-4bf52ac0f7e3 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:29:34.643584 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-854d5bc1-147c-4131-8fa6-4bf52ac0f7e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:29:34.667096 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:34.707878 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 133/279] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:29:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 14:29:34.708776 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854d5bc1-147c-4131-8fa6-4bf52ac0f7e3 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:34.730880 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 147/280] 10.222.0.15 () {60 vars in 1132 bytes} [Tue May 31 14:29:34 2022] POST /identity/v3/users => generated 293 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:29:34.731778 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dd17cd-1348-43b2-8778-5f2311b7b918 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:34.745105 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:34.829834 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854d5bc1-147c-4131-8fa6-4bf52ac0f7e3 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:34.847176 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dd17cd-1348-43b2-8778-5f2311b7b918 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:34.869454 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46325b8-64aa-477a-95a3-26e18eb951b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:34.870329 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46325b8-64aa-477a-95a3-26e18eb951b9 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:34.870650 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46325b8-64aa-477a-95a3-26e18eb951b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:34.870927 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46325b8-64aa-477a-95a3-26e18eb951b9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:34.883020 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6e1f2f-ddd5-453f-85af-75398ab82025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:34.883698 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e1f2f-ddd5-453f-85af-75398ab82025 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:34.883983 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e1f2f-ddd5-453f-85af-75398ab82025 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:34.884257 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e1f2f-ddd5-453f-85af-75398ab82025 None admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:34.884576 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46325b8-64aa-477a-95a3-26e18eb951b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 14:29:34.885002 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6e1f2f-ddd5-453f-85af-75398ab82025 None admin] RBAC: Adding query filter params (name=member) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:29:34.885304 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6e1f2f-ddd5-453f-85af-75398ab82025 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:34.886736 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6e1f2f-ddd5-453f-85af-75398ab82025 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:34.893525 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-a46325b8-64aa-477a-95a3-26e18eb951b9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 31 14:29:34.893525 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:29:34.893525 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:29:34.893525 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:29:34.893525 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:29:34.893525 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:29:34.893525 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:29:34.893525 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:29:34.893525 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:29:34.893525 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:29:34.893525 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:29:34.893525 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:29:34.893525 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 14:29:34.893525 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 14:29:34.893525 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 14:29:34.893525 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 14:29:34.894703 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 14:29:34.894703 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 14:29:34.894703 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 14:29:34.894703 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 14:29:34.894703 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:29:34.894703 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:29:34.894703 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:29:34.894703 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:29:34.894703 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:29:34.894703 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:29:34.894703 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:29:34.894703 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:29:34.894703 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:29:34.894703 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:29:34.894703 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:29:34.894703 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:29:34.895704 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:29:34.895704 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:29:34.895704 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:29:34.895704 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:29:34.895704 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 14:29:34.895704 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 14:29:34.895704 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 14:29:34.895704 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 14:29:34.895704 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 14:29:34.895704 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 14:29:34.895704 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 31 14:29:34.895704 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:29:34.896435 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 148/281] 10.222.0.15 () {56 vars in 1101 bytes} [Tue May 31 14:29:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:34.896836 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6e1f2f-ddd5-453f-85af-75398ab82025 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:34.898944 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 134/282] 10.222.0.15 () {56 vars in 1099 bytes} [Tue May 31 14:29:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:29:34.902955 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46325b8-64aa-477a-95a3-26e18eb951b9 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:34.924560 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:34.995788 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:35.019873 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46325b8-64aa-477a-95a3-26e18eb951b9 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:35.031734 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6e1f2f-ddd5-453f-85af-75398ab82025 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:35.061921 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7963bc-0f16-43b7-ba49-cdc21a3f525d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:35.062856 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7963bc-0f16-43b7-ba49-cdc21a3f525d None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:35.063146 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7963bc-0f16-43b7-ba49-cdc21a3f525d None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:35.063518 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7963bc-0f16-43b7-ba49-cdc21a3f525d None admin] PATH_INFO: `/v3/users/70097047812e4d0a89987ba18d673e2f` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:35.082187 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7963bc-0f16-43b7-ba49-cdc21a3f525d None admin] RBAC: Authorizing `identity:get_user(user_id=70097047812e4d0a89987ba18d673e2f)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:35.082628 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c4f00d-bcc5-4100-87db-a23ee1bac94e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:35.083611 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c4f00d-bcc5-4100-87db-a23ee1bac94e None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:35.083732 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7963bc-0f16-43b7-ba49-cdc21a3f525d None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:35.083899 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c4f00d-bcc5-4100-87db-a23ee1bac94e None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:35.084182 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c4f00d-bcc5-4100-87db-a23ee1bac94e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:35.086206 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 135/283] 10.222.0.15 () {56 vars in 1177 bytes} [Tue May 31 14:29:34 2022] GET /identity/v3/users/70097047812e4d0a89987ba18d673e2f => generated 293 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:35.086850 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7963bc-0f16-43b7-ba49-cdc21a3f525d None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:35.097594 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c4f00d-bcc5-4100-87db-a23ee1bac94e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 14:29:35.105564 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-f0c4f00d-bcc5-4100-87db-a23ee1bac94e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 31 14:29:35.105564 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:29:35.105564 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:29:35.105564 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:29:35.105564 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:29:35.105564 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:29:35.105564 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:29:35.105564 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:29:35.105564 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:29:35.105564 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:29:35.105564 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:29:35.105564 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:29:35.105564 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 14:29:35.105564 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 14:29:35.105564 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 14:29:35.105564 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 14:29:35.106436 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 14:29:35.106436 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 14:29:35.106436 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 14:29:35.106436 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 14:29:35.106436 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:29:35.106436 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:29:35.106436 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:29:35.106436 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:29:35.106436 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:29:35.106436 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:29:35.106436 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:29:35.106436 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:29:35.106436 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:29:35.106436 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:29:35.106436 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:29:35.106436 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:29:35.107293 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:29:35.107293 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:29:35.107293 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:29:35.107293 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:29:35.107293 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 14:29:35.107293 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 14:29:35.107293 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 14:29:35.107293 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 14:29:35.107293 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 14:29:35.107293 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 14:29:35.107293 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 31 14:29:35.107293 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:29:35.110626 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 149/284] 10.222.0.15 () {56 vars in 1099 bytes} [Tue May 31 14:29:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:29:35.111670 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c4f00d-bcc5-4100-87db-a23ee1bac94e None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:35.182671 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:35.215138 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7963bc-0f16-43b7-ba49-cdc21a3f525d None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:35.224043 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c4f00d-bcc5-4100-87db-a23ee1bac94e None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:35.260244 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959f66f2-f4d3-4989-bd41-2ca9e0932fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:35.260777 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:35.261499 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f66f2-f4d3-4989-bd41-2ca9e0932fe0 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:35.262018 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f66f2-f4d3-4989-bd41-2ca9e0932fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:35.262483 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f66f2-f4d3-4989-bd41-2ca9e0932fe0 None admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:35.263588 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959f66f2-f4d3-4989-bd41-2ca9e0932fe0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:29:35.264160 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959f66f2-f4d3-4989-bd41-2ca9e0932fe0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:35.266039 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959f66f2-f4d3-4989-bd41-2ca9e0932fe0 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:35.266334 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81e8dde-27b0-41fd-940a-62260ee676fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:35.267026 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e8dde-27b0-41fd-940a-62260ee676fa None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:35.267316 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e8dde-27b0-41fd-940a-62260ee676fa None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:35.267648 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e8dde-27b0-41fd-940a-62260ee676fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:35.268829 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81e8dde-27b0-41fd-940a-62260ee676fa None admin] RBAC: Adding query filter params (role.id=317f725e26bf43648d8235bb1f7c4cb3, user.id=70097047812e4d0a89987ba18d673e2f, scope.system=all) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:29:35.269154 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81e8dde-27b0-41fd-940a-62260ee676fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:35.271088 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81e8dde-27b0-41fd-940a-62260ee676fa None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:35.277554 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 136/285] 10.222.0.15 () {56 vars in 1101 bytes} [Tue May 31 14:29:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:35.277976 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 150/286] 10.222.0.15 () {56 vars in 1308 bytes} [Tue May 31 14:29:35 2022] GET /identity/v3/role_assignments?user.id=70097047812e4d0a89987ba18d673e2f&scope.system=all&role.id=317f725e26bf43648d8235bb1f7c4cb3 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:35.286614 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81e8dde-27b0-41fd-940a-62260ee676fa None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:35.289783 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959f66f2-f4d3-4989-bd41-2ca9e0932fe0 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:35.432825 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81e8dde-27b0-41fd-940a-62260ee676fa None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:35.480440 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4b17b0-c04f-4164-82bd-42e0919f97b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:35.481164 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4b17b0-c04f-4164-82bd-42e0919f97b8 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:35.481445 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4b17b0-c04f-4164-82bd-42e0919f97b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:35.481720 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4b17b0-c04f-4164-82bd-42e0919f97b8 None admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:35.482473 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4b17b0-c04f-4164-82bd-42e0919f97b8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:29:35.482805 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4b17b0-c04f-4164-82bd-42e0919f97b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:35.486054 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4b17b0-c04f-4164-82bd-42e0919f97b8 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:35.499156 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959f66f2-f4d3-4989-bd41-2ca9e0932fe0 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:35.500745 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 151/287] 10.222.0.15 () {56 vars in 1101 bytes} [Tue May 31 14:29:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:35.503829 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4b17b0-c04f-4164-82bd-42e0919f97b8 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:35.541657 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3488a612-2aa5-41f2-873c-90f7c11549e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:35.542532 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3488a612-2aa5-41f2-873c-90f7c11549e9 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:35.542904 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3488a612-2aa5-41f2-873c-90f7c11549e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:35.543215 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3488a612-2aa5-41f2-873c-90f7c11549e9 None admin] PATH_INFO: `/v3/users/f779cdf9688540e8b3dbe7734534c931` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:35.544523 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3488a612-2aa5-41f2-873c-90f7c11549e9 None admin] RBAC: Authorizing `identity:get_user(user_id=f779cdf9688540e8b3dbe7734534c931)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:35.545989 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3488a612-2aa5-41f2-873c-90f7c11549e9 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:35.547895 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 137/288] 10.222.0.15 () {56 vars in 1177 bytes} [Tue May 31 14:29:35 2022] GET /identity/v3/users/f779cdf9688540e8b3dbe7734534c931 => generated 297 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:35.554208 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3488a612-2aa5-41f2-873c-90f7c11549e9 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:35.564269 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:35.588985 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:35.664486 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4b17b0-c04f-4164-82bd-42e0919f97b8 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:35.732840 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd66fcda-5a0e-4f89-8d3f-aa4d30d8c29f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:35.734193 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd66fcda-5a0e-4f89-8d3f-aa4d30d8c29f None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:35.734787 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd66fcda-5a0e-4f89-8d3f-aa4d30d8c29f None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:35.736054 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd66fcda-5a0e-4f89-8d3f-aa4d30d8c29f None admin] PATH_INFO: `/v3/users/e810a8642eca47c08efac54c4daa8fdf` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:35.738965 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd66fcda-5a0e-4f89-8d3f-aa4d30d8c29f None admin] RBAC: Authorizing `identity:get_user(user_id=e810a8642eca47c08efac54c4daa8fdf)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:35.741950 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd66fcda-5a0e-4f89-8d3f-aa4d30d8c29f None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:35.745705 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 152/289] 10.222.0.15 () {56 vars in 1177 bytes} [Tue May 31 14:29:35 2022] GET /identity/v3/users/e810a8642eca47c08efac54c4daa8fdf => generated 297 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:35.747785 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3488a612-2aa5-41f2-873c-90f7c11549e9 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:35.750129 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd66fcda-5a0e-4f89-8d3f-aa4d30d8c29f None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:35.827876 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d46ded-6d78-4cd3-b6d3-b856bb27315f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:35.829150 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d46ded-6d78-4cd3-b6d3-b856bb27315f None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:35.829637 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d46ded-6d78-4cd3-b6d3-b856bb27315f None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:35.830114 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d46ded-6d78-4cd3-b6d3-b856bb27315f None admin] PATH_INFO: `/v3/projects/a492408a00474ddd952118fdba3219ad` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:35.833860 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d46ded-6d78-4cd3-b6d3-b856bb27315f None admin] RBAC: Authorizing `identity:get_project(project_id=a492408a00474ddd952118fdba3219ad)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:35.835839 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d46ded-6d78-4cd3-b6d3-b856bb27315f None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:35.838576 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 138/290] 10.222.0.15 () {56 vars in 1186 bytes} [Tue May 31 14:29:35 2022] GET /identity/v3/projects/a492408a00474ddd952118fdba3219ad => generated 302 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 14:29:35.845177 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d46ded-6d78-4cd3-b6d3-b856bb27315f None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:35.945489 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:35.972229 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d46ded-6d78-4cd3-b6d3-b856bb27315f None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:35.997290 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd66fcda-5a0e-4f89-8d3f-aa4d30d8c29f None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:36.019853 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33243f0-73be-47ae-abfb-dc99e2d74efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:36.020753 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33243f0-73be-47ae-abfb-dc99e2d74efe None admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:36.021071 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33243f0-73be-47ae-abfb-dc99e2d74efe None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:36.021314 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33243f0-73be-47ae-abfb-dc99e2d74efe None admin] PATH_INFO: `/v3/projects/a492408a00474ddd952118fdba3219ad/users/f779cdf9688540e8b3dbe7734534c931/roles/7ac88acfdd6d4edaa12064f0d47e1bf9` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:36.023859 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33243f0-73be-47ae-abfb-dc99e2d74efe None admin] RBAC: Authorizing `identity:create_grant(project_id=a492408a00474ddd952118fdba3219ad, user_id=f779cdf9688540e8b3dbe7734534c931, role_id=7ac88acfdd6d4edaa12064f0d47e1bf9)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:36.025315 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33243f0-73be-47ae-abfb-dc99e2d74efe None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:36.034913 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:36.043037 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d473199-4617-4c6d-8656-8e062954ebe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:36.043688 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d473199-4617-4c6d-8656-8e062954ebe9 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:36.043974 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d473199-4617-4c6d-8656-8e062954ebe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:36.044253 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d473199-4617-4c6d-8656-8e062954ebe9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:36.108236 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 139/291] 10.222.0.15 () {58 vars in 1439 bytes} [Tue May 31 14:29:35 2022] PUT /identity/v3/projects/a492408a00474ddd952118fdba3219ad/users/f779cdf9688540e8b3dbe7734534c931/roles/7ac88acfdd6d4edaa12064f0d47e1bf9 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:29:36.125863 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d473199-4617-4c6d-8656-8e062954ebe9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:36.131716 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d473199-4617-4c6d-8656-8e062954ebe9 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:36.243937 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 153/292] 10.222.0.15 () {58 vars in 1282 bytes} [Tue May 31 14:29:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 31 14:29:36.251704 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33243f0-73be-47ae-abfb-dc99e2d74efe None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:36.425170 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33243f0-73be-47ae-abfb-dc99e2d74efe None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:36.464717 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21f5ccf-f939-4443-b7cb-461eafa1a99f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:36.466012 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f5ccf-f939-4443-b7cb-461eafa1a99f None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:36.466501 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f5ccf-f939-4443-b7cb-461eafa1a99f None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:36.467008 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f5ccf-f939-4443-b7cb-461eafa1a99f None admin] PATH_INFO: `/v3/projects/a492408a00474ddd952118fdba3219ad` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:36.468405 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21f5ccf-f939-4443-b7cb-461eafa1a99f None admin] RBAC: Authorizing `identity:get_project(project_id=a492408a00474ddd952118fdba3219ad)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:36.470042 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21f5ccf-f939-4443-b7cb-461eafa1a99f None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:36.472005 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 140/293] 10.222.0.15 () {56 vars in 1186 bytes} [Tue May 31 14:29:36 2022] GET /identity/v3/projects/a492408a00474ddd952118fdba3219ad => generated 302 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:36.478023 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d473199-4617-4c6d-8656-8e062954ebe9 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:36.510199 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:36.608113 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d473199-4617-4c6d-8656-8e062954ebe9 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:36.656075 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405091aa-50b1-4813-89ab-a37be964dd96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:36.656732 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405091aa-50b1-4813-89ab-a37be964dd96 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:36.657014 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405091aa-50b1-4813-89ab-a37be964dd96 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:36.657289 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405091aa-50b1-4813-89ab-a37be964dd96 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:36.658362 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405091aa-50b1-4813-89ab-a37be964dd96 None admin] RBAC: Adding query filter params (role.id=317f725e26bf43648d8235bb1f7c4cb3, scope.project.id=a492408a00474ddd952118fdba3219ad, user.id=e810a8642eca47c08efac54c4daa8fdf) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:29:36.658712 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405091aa-50b1-4813-89ab-a37be964dd96 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:36.660149 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405091aa-50b1-4813-89ab-a37be964dd96 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:36.667032 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 154/294] 10.222.0.15 () {56 vars in 1374 bytes} [Tue May 31 14:29:36 2022] GET /identity/v3/role_assignments?user.id=e810a8642eca47c08efac54c4daa8fdf&scope.project.id=a492408a00474ddd952118fdba3219ad&role.id=317f725e26bf43648d8235bb1f7c4cb3 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 14:29:37.464561 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83689834-f47b-4b55-bc79-74513ca1aa75 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:37.465589 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83689834-f47b-4b55-bc79-74513ca1aa75 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:37.466083 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83689834-f47b-4b55-bc79-74513ca1aa75 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:37.467980 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 141/295] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:29:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:29:37.473291 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c671446-e6e1-465f-8b7d-9f3ee9c8c4c8 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:37.473714 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c671446-e6e1-465f-8b7d-9f3ee9c8c4c8 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:37.473850 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c671446-e6e1-465f-8b7d-9f3ee9c8c4c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:37.493296 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-7c671446-e6e1-465f-8b7d-9f3ee9c8c4c8 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:29:37.494809 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-7c671446-e6e1-465f-8b7d-9f3ee9c8c4c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:29:37.575453 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 155/296] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:29:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 14:29:37.595813 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9663dd-78d0-4b26-beed-abe58f2d6ba0 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:37.596487 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9663dd-78d0-4b26-beed-abe58f2d6ba0 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:37.596999 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9663dd-78d0-4b26-beed-abe58f2d6ba0 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:37.597194 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c671446-e6e1-465f-8b7d-9f3ee9c8c4c8 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:37.599039 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 142/297] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:29:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:29:37.604977 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c36346c-6144-4133-b6af-612bfe8764f4 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:37.605526 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c36346c-6144-4133-b6af-612bfe8764f4 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:37.606040 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c36346c-6144-4133-b6af-612bfe8764f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:37.611799 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:37.622742 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:37.624491 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-8c36346c-6144-4133-b6af-612bfe8764f4 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:29:37.625893 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-8c36346c-6144-4133-b6af-612bfe8764f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:29:37.718887 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 143/298] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:29:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 31 14:29:37.722568 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c671446-e6e1-465f-8b7d-9f3ee9c8c4c8 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:37.742323 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c36346c-6144-4133-b6af-612bfe8764f4 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:37.764012 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d1e1be-5e83-4148-a819-0b14b84ec449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:37.765124 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d1e1be-5e83-4148-a819-0b14b84ec449 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:37.765613 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d1e1be-5e83-4148-a819-0b14b84ec449 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:37.766163 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d1e1be-5e83-4148-a819-0b14b84ec449 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:37.767602 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d1e1be-5e83-4148-a819-0b14b84ec449 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:37.769391 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d1e1be-5e83-4148-a819-0b14b84ec449 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:37.771549 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 156/299] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:29:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 14:29:37.777807 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d1e1be-5e83-4148-a819-0b14b84ec449 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:37.849324 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c36346c-6144-4133-b6af-612bfe8764f4 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:37.868847 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:37.880918 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d1e1be-5e83-4148-a819-0b14b84ec449 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:37.882624 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:37.887988 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017cd98d-a81b-427a-a1ab-f98a8ecf84ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:37.888784 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017cd98d-a81b-427a-a1ab-f98a8ecf84ac None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:37.889067 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017cd98d-a81b-427a-a1ab-f98a8ecf84ac None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:37.889588 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017cd98d-a81b-427a-a1ab-f98a8ecf84ac None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:37.900535 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017cd98d-a81b-427a-a1ab-f98a8ecf84ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 14:29:37.908559 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-017cd98d-a81b-427a-a1ab-f98a8ecf84ac None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 31 14:29:37.908559 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:29:37.908559 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:29:37.908559 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:29:37.908559 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:29:37.908559 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:29:37.908559 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:29:37.908559 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:29:37.908559 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:29:37.908559 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:29:37.908559 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:29:37.908559 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:29:37.908559 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 14:29:37.908559 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 14:29:37.908559 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 14:29:37.908559 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 14:29:37.909448 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 14:29:37.909448 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 14:29:37.909448 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 14:29:37.909448 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 14:29:37.909448 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:29:37.909448 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:29:37.909448 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:29:37.909448 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:29:37.909448 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:29:37.909448 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:29:37.909448 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:29:37.909448 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:29:37.909448 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:29:37.909448 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:29:37.909448 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:29:37.909448 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:29:37.910230 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:29:37.910230 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:29:37.910230 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:29:37.910230 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:29:37.910230 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 14:29:37.910230 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 14:29:37.910230 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 14:29:37.910230 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 14:29:37.910230 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 14:29:37.910230 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 14:29:37.910230 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 31 14:29:37.910230 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:29:37.910230 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 144/300] 10.222.0.15 () {56 vars in 1099 bytes} [Tue May 31 14:29:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:29:37.911413 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b97c69c-5813-4220-885f-d72b041f9c6b None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:37.911413 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b97c69c-5813-4220-885f-d72b041f9c6b None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:37.912058 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b97c69c-5813-4220-885f-d72b041f9c6b None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:37.913092 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 145/301] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:29:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:29:37.917863 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b97c69c-5813-4220-885f-d72b041f9c6b None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:37.922223 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3bb024-d9e5-4fa4-b9ec-95aa03314cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:37.922936 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3bb024-d9e5-4fa4-b9ec-95aa03314cc4 None admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:37.923225 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3bb024-d9e5-4fa4-b9ec-95aa03314cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:37.923509 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3bb024-d9e5-4fa4-b9ec-95aa03314cc4 None admin] PATH_INFO: `/v3/groups` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:37.924200 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3bb024-d9e5-4fa4-b9ec-95aa03314cc4 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:37.925776 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3bb024-d9e5-4fa4-b9ec-95aa03314cc4 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:37.997468 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 157/302] 10.222.0.15 () {60 vars in 1134 bytes} [Tue May 31 14:29:37 2022] POST /identity/v3/groups => generated 229 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:29:38.000138 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb418c-e07c-47e4-9a58-cd772778e528 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:38.000428 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb418c-e07c-47e4-9a58-cd772778e528 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:38.000730 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fb418c-e07c-47e4-9a58-cd772778e528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:38.025631 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-f2fb418c-e07c-47e4-9a58-cd772778e528 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:29:38.027441 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-f2fb418c-e07c-47e4-9a58-cd772778e528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:29:38.031141 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b97c69c-5813-4220-885f-d72b041f9c6b None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:38.076802 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abf37bf-aec7-4085-82ce-a237586409c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:38.077670 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abf37bf-aec7-4085-82ce-a237586409c2 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:38.078070 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abf37bf-aec7-4085-82ce-a237586409c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:38.078445 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abf37bf-aec7-4085-82ce-a237586409c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:38.079753 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abf37bf-aec7-4085-82ce-a237586409c2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:29:38.080781 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abf37bf-aec7-4085-82ce-a237586409c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:38.082456 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abf37bf-aec7-4085-82ce-a237586409c2 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:38.098227 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 146/303] 10.222.0.15 () {56 vars in 1101 bytes} [Tue May 31 14:29:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:38.099462 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abf37bf-aec7-4085-82ce-a237586409c2 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:38.130500 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 158/304] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:29:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 14:29:38.155662 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fb418c-e07c-47e4-9a58-cd772778e528 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:38.169443 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:38.220485 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abf37bf-aec7-4085-82ce-a237586409c2 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:38.250676 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:38.270987 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d25ae9a-5105-4963-8d9f-6df3596a6acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:38.271768 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d25ae9a-5105-4963-8d9f-6df3596a6acf None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:38.272009 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d25ae9a-5105-4963-8d9f-6df3596a6acf None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:38.273664 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d25ae9a-5105-4963-8d9f-6df3596a6acf None admin] PATH_INFO: `/v3/users/3067097454b7441cb89129057174b754` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:38.280706 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fb418c-e07c-47e4-9a58-cd772778e528 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:38.301316 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d25ae9a-5105-4963-8d9f-6df3596a6acf None admin] RBAC: Authorizing `identity:get_user(user_id=3067097454b7441cb89129057174b754)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:38.303286 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d25ae9a-5105-4963-8d9f-6df3596a6acf None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:38.305833 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 147/305] 10.222.0.15 () {56 vars in 1177 bytes} [Tue May 31 14:29:38 2022] GET /identity/v3/users/3067097454b7441cb89129057174b754 => generated 293 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:38.311352 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d25ae9a-5105-4963-8d9f-6df3596a6acf None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:38.324674 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d35bd9-c601-4534-a174-932de6a34f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:38.325760 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d35bd9-c601-4534-a174-932de6a34f2b None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:38.326044 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d35bd9-c601-4534-a174-932de6a34f2b None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:38.326416 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d35bd9-c601-4534-a174-932de6a34f2b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:38.341964 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d35bd9-c601-4534-a174-932de6a34f2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 14:29:38.354449 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-a4d35bd9-c601-4534-a174-932de6a34f2b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 31 14:29:38.354449 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:29:38.354449 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:29:38.354449 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:29:38.354449 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:29:38.354449 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:29:38.354449 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:29:38.354449 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:29:38.354449 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:29:38.354449 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:29:38.354449 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:29:38.354449 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:29:38.354449 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 14:29:38.354449 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 14:29:38.354449 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 14:29:38.354449 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 14:29:38.355428 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 14:29:38.355428 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 14:29:38.355428 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 14:29:38.355428 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 14:29:38.355428 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:29:38.355428 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:29:38.355428 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:29:38.355428 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:29:38.355428 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:29:38.355428 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:29:38.355428 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:29:38.355428 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:29:38.355428 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:29:38.355428 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:29:38.355428 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:29:38.355428 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:29:38.356231 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:29:38.356231 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:29:38.356231 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:29:38.356231 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:29:38.356231 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 14:29:38.356231 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 14:29:38.356231 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 14:29:38.356231 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 14:29:38.356231 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 14:29:38.356231 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 14:29:38.356231 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 31 14:29:38.356231 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:29:38.358759 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 159/306] 10.222.0.15 () {56 vars in 1099 bytes} [Tue May 31 14:29:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:29:38.363550 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d35bd9-c601-4534-a174-932de6a34f2b None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:38.430872 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d25ae9a-5105-4963-8d9f-6df3596a6acf None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:38.447247 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:38.470463 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9144bafd-7b65-4f26-b19a-b1c37bcf89ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:38.471400 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9144bafd-7b65-4f26-b19a-b1c37bcf89ef None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:38.471879 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9144bafd-7b65-4f26-b19a-b1c37bcf89ef None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:38.472316 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9144bafd-7b65-4f26-b19a-b1c37bcf89ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:38.473250 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9144bafd-7b65-4f26-b19a-b1c37bcf89ef None admin] RBAC: Adding query filter params (role.id=7ac88acfdd6d4edaa12064f0d47e1bf9, user.id=3067097454b7441cb89129057174b754, scope.system=all) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:29:38.473697 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9144bafd-7b65-4f26-b19a-b1c37bcf89ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:38.475828 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9144bafd-7b65-4f26-b19a-b1c37bcf89ef None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:38.486891 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 148/307] 10.222.0.15 () {56 vars in 1308 bytes} [Tue May 31 14:29:38 2022] GET /identity/v3/role_assignments?user.id=3067097454b7441cb89129057174b754&scope.system=all&role.id=7ac88acfdd6d4edaa12064f0d47e1bf9 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 14:29:38.498650 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d35bd9-c601-4534-a174-932de6a34f2b None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:38.537373 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a68ea7-98ea-4eed-a74b-71c40ebc25a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:38.539058 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a68ea7-98ea-4eed-a74b-71c40ebc25a2 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:38.539490 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a68ea7-98ea-4eed-a74b-71c40ebc25a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:38.539910 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a68ea7-98ea-4eed-a74b-71c40ebc25a2 None admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:38.540840 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a68ea7-98ea-4eed-a74b-71c40ebc25a2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:29:38.541290 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a68ea7-98ea-4eed-a74b-71c40ebc25a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:38.542883 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a68ea7-98ea-4eed-a74b-71c40ebc25a2 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:38.551048 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:38.554062 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 160/308] 10.222.0.15 () {56 vars in 1101 bytes} [Tue May 31 14:29:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:38.559901 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9144bafd-7b65-4f26-b19a-b1c37bcf89ef None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:38.687670 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9144bafd-7b65-4f26-b19a-b1c37bcf89ef None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:38.714773 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e13015-436f-4c1e-880b-46a5df52bd07 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:38.715067 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e13015-436f-4c1e-880b-46a5df52bd07 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:38.715355 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e13015-436f-4c1e-880b-46a5df52bd07 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:38.716763 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 161/309] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:29:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:29:38.723242 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cae4c9e-1902-41f9-b057-fa935a2baec1 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:38.723536 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cae4c9e-1902-41f9-b057-fa935a2baec1 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:38.723820 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cae4c9e-1902-41f9-b057-fa935a2baec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:38.724867 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0f0a1d-cbbc-47cf-8330-1ad6538971e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:38.726062 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0f0a1d-cbbc-47cf-8330-1ad6538971e5 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:38.726632 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0f0a1d-cbbc-47cf-8330-1ad6538971e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:38.727079 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0f0a1d-cbbc-47cf-8330-1ad6538971e5 None admin] PATH_INFO: `/v3/users/70097047812e4d0a89987ba18d673e2f` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:38.728556 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0f0a1d-cbbc-47cf-8330-1ad6538971e5 None admin] RBAC: Authorizing `identity:get_user(user_id=70097047812e4d0a89987ba18d673e2f)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:38.730161 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0f0a1d-cbbc-47cf-8330-1ad6538971e5 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:38.732390 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 149/310] 10.222.0.15 () {56 vars in 1177 bytes} [Tue May 31 14:29:38 2022] GET /identity/v3/users/70097047812e4d0a89987ba18d673e2f => generated 293 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:38.740009 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0f0a1d-cbbc-47cf-8330-1ad6538971e5 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:38.745906 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-3cae4c9e-1902-41f9-b057-fa935a2baec1 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:29:38.747219 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-3cae4c9e-1902-41f9-b057-fa935a2baec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:29:38.797428 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:38.833752 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 162/311] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:29:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 14:29:38.857158 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cae4c9e-1902-41f9-b057-fa935a2baec1 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:38.862368 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0f0a1d-cbbc-47cf-8330-1ad6538971e5 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:38.909748 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07454ff2-c770-4254-8647-90a3dc77e848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:38.910682 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07454ff2-c770-4254-8647-90a3dc77e848 None admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:38.910974 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07454ff2-c770-4254-8647-90a3dc77e848 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:38.911259 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07454ff2-c770-4254-8647-90a3dc77e848 None admin] PATH_INFO: `/v3/system/users/70097047812e4d0a89987ba18d673e2f/roles/317f725e26bf43648d8235bb1f7c4cb3` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:38.913355 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07454ff2-c770-4254-8647-90a3dc77e848 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=70097047812e4d0a89987ba18d673e2f, role_id=317f725e26bf43648d8235bb1f7c4cb3)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:38.915113 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07454ff2-c770-4254-8647-90a3dc77e848 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:38.971767 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cae4c9e-1902-41f9-b057-fa935a2baec1 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:39.004166 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:39.018594 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 150/312] 10.222.0.15 () {58 vars in 1334 bytes} [Tue May 31 14:29:38 2022] PUT /identity/v3/system/users/70097047812e4d0a89987ba18d673e2f/roles/317f725e26bf43648d8235bb1f7c4cb3 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 14:29:39.018837 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130e4822-d8d7-4d65-998b-b6d3e6207291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:39.018837 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e4822-d8d7-4d65-998b-b6d3e6207291 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:39.018837 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e4822-d8d7-4d65-998b-b6d3e6207291 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:39.018837 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e4822-d8d7-4d65-998b-b6d3e6207291 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:39.030163 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130e4822-d8d7-4d65-998b-b6d3e6207291 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 14:29:39.038840 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-130e4822-d8d7-4d65-998b-b6d3e6207291 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 31 14:29:39.038840 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:29:39.038840 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:29:39.038840 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:29:39.038840 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:29:39.038840 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:29:39.038840 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:29:39.038840 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:29:39.038840 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:29:39.038840 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:29:39.038840 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:29:39.038840 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:29:39.038840 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 14:29:39.038840 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 14:29:39.038840 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 14:29:39.038840 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 14:29:39.039802 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 14:29:39.039802 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 14:29:39.039802 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 14:29:39.039802 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 14:29:39.039802 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:29:39.039802 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:29:39.039802 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:29:39.039802 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:29:39.039802 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:29:39.039802 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:29:39.039802 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:29:39.039802 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:29:39.039802 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:29:39.039802 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:29:39.039802 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:29:39.039802 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:29:39.040613 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:29:39.040613 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:29:39.040613 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:29:39.040613 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:29:39.040613 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 14:29:39.040613 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 14:29:39.040613 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 14:29:39.040613 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 14:29:39.040613 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 14:29:39.040613 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 14:29:39.040613 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 31 14:29:39.040613 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:29:39.040613 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 163/313] 10.222.0.15 () {56 vars in 1099 bytes} [Tue May 31 14:29:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 14:29:39.046492 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07454ff2-c770-4254-8647-90a3dc77e848 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:39.158431 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07454ff2-c770-4254-8647-90a3dc77e848 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:39.171746 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:39.200019 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e07978-cf29-4b02-bf8f-24db3f6272b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:39.200709 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e07978-cf29-4b02-bf8f-24db3f6272b7 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:39.200995 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e07978-cf29-4b02-bf8f-24db3f6272b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:39.201274 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e07978-cf29-4b02-bf8f-24db3f6272b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:39.202094 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e07978-cf29-4b02-bf8f-24db3f6272b7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:29:39.202407 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e07978-cf29-4b02-bf8f-24db3f6272b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:39.203868 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e07978-cf29-4b02-bf8f-24db3f6272b7 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:39.214225 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 151/314] 10.222.0.15 () {56 vars in 1101 bytes} [Tue May 31 14:29:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:39.219812 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130e4822-d8d7-4d65-998b-b6d3e6207291 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:39.341508 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130e4822-d8d7-4d65-998b-b6d3e6207291 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:39.377441 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b3a5df-3685-4583-9077-26661b809e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:39.378583 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b3a5df-3685-4583-9077-26661b809e39 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:39.379030 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b3a5df-3685-4583-9077-26661b809e39 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:39.379453 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b3a5df-3685-4583-9077-26661b809e39 None admin] PATH_INFO: `/v3/users/f779cdf9688540e8b3dbe7734534c931` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:39.380924 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b3a5df-3685-4583-9077-26661b809e39 None admin] RBAC: Authorizing `identity:get_user(user_id=f779cdf9688540e8b3dbe7734534c931)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:39.383070 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b3a5df-3685-4583-9077-26661b809e39 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:39.385137 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 164/315] 10.222.0.15 () {56 vars in 1177 bytes} [Tue May 31 14:29:39 2022] GET /identity/v3/users/f779cdf9688540e8b3dbe7734534c931 => generated 297 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:39.390489 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e07978-cf29-4b02-bf8f-24db3f6272b7 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:39.494684 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e07978-cf29-4b02-bf8f-24db3f6272b7 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:39.529933 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8926e1-3cb9-4bdf-8b63-17a2420412f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:39.530626 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8926e1-3cb9-4bdf-8b63-17a2420412f2 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:39.530953 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8926e1-3cb9-4bdf-8b63-17a2420412f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:39.531238 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8926e1-3cb9-4bdf-8b63-17a2420412f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:39.572202 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:39.601025 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8926e1-3cb9-4bdf-8b63-17a2420412f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:39.602509 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8926e1-3cb9-4bdf-8b63-17a2420412f2 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:39.705740 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 152/316] 10.222.0.15 () {58 vars in 1282 bytes} [Tue May 31 14:29:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 31 14:29:39.711810 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b3a5df-3685-4583-9077-26661b809e39 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:39.771189 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:39.814235 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b3a5df-3685-4583-9077-26661b809e39 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:39.847979 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a07916e-bc13-4a74-8ba0-73c4bf4a3046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:39.848771 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a07916e-bc13-4a74-8ba0-73c4bf4a3046 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:39.849056 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a07916e-bc13-4a74-8ba0-73c4bf4a3046 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:39.849336 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a07916e-bc13-4a74-8ba0-73c4bf4a3046 None admin] PATH_INFO: `/v3/projects/a492408a00474ddd952118fdba3219ad` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:39.850541 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a07916e-bc13-4a74-8ba0-73c4bf4a3046 None admin] RBAC: Authorizing `identity:get_project(project_id=a492408a00474ddd952118fdba3219ad)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:39.852013 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a07916e-bc13-4a74-8ba0-73c4bf4a3046 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:39.853699 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 165/317] 10.222.0.15 () {56 vars in 1186 bytes} [Tue May 31 14:29:39 2022] GET /identity/v3/projects/a492408a00474ddd952118fdba3219ad => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:39.859573 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8926e1-3cb9-4bdf-8b63-17a2420412f2 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:39.937295 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:39.962469 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8926e1-3cb9-4bdf-8b63-17a2420412f2 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:39.999737 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b798abd2-b536-4dbc-b214-db5e6fd0b577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:40.000399 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b798abd2-b536-4dbc-b214-db5e6fd0b577 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:40.000686 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b798abd2-b536-4dbc-b214-db5e6fd0b577 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:40.000963 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b798abd2-b536-4dbc-b214-db5e6fd0b577 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:40.001787 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b798abd2-b536-4dbc-b214-db5e6fd0b577 None admin] RBAC: Adding query filter params (role.id=7ac88acfdd6d4edaa12064f0d47e1bf9, scope.project.id=a492408a00474ddd952118fdba3219ad, user.id=f779cdf9688540e8b3dbe7734534c931) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:29:40.002098 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b798abd2-b536-4dbc-b214-db5e6fd0b577 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:40.003577 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b798abd2-b536-4dbc-b214-db5e6fd0b577 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:40.010322 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 153/318] 10.222.0.15 () {56 vars in 1374 bytes} [Tue May 31 14:29:39 2022] GET /identity/v3/role_assignments?user.id=f779cdf9688540e8b3dbe7734534c931&scope.project.id=a492408a00474ddd952118fdba3219ad&role.id=7ac88acfdd6d4edaa12064f0d47e1bf9 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:40.441700 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2014cd-f131-4326-a540-ea82018a0ee2 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:40.442091 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2014cd-f131-4326-a540-ea82018a0ee2 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:40.442268 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2014cd-f131-4326-a540-ea82018a0ee2 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:40.443792 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 166/319] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:29:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:29:40.448978 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e76c5eb-da6d-4096-9302-cf7e204603dc None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:40.449266 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e76c5eb-da6d-4096-9302-cf7e204603dc None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:40.449545 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e76c5eb-da6d-4096-9302-cf7e204603dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:40.467249 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-6e76c5eb-da6d-4096-9302-cf7e204603dc None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:29:40.468463 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-6e76c5eb-da6d-4096-9302-cf7e204603dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:29:40.537075 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 154/320] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:29:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 14:29:40.559428 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2014cd-f131-4326-a540-ea82018a0ee2 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:40.660772 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2014cd-f131-4326-a540-ea82018a0ee2 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:40.686331 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:40.695135 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2f938c-c5d0-4f94-a052-e7708fe5788a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:40.695934 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2f938c-c5d0-4f94-a052-e7708fe5788a None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:40.696216 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2f938c-c5d0-4f94-a052-e7708fe5788a None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:40.701000 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2f938c-c5d0-4f94-a052-e7708fe5788a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:40.701000 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2f938c-c5d0-4f94-a052-e7708fe5788a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:40.701000 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2f938c-c5d0-4f94-a052-e7708fe5788a None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:40.701000 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 167/321] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:29:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:40.706188 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e76c5eb-da6d-4096-9302-cf7e204603dc None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:40.767561 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:40.798479 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3657225-c51e-4bfc-acc6-135a3af4d048 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:40.799039 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3657225-c51e-4bfc-acc6-135a3af4d048 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:40.799114 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3657225-c51e-4bfc-acc6-135a3af4d048 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:40.800433 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 168/322] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:29:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:29:40.805594 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a699e9e6-7eca-44c2-a14c-370fb33a725b None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:40.805890 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a699e9e6-7eca-44c2-a14c-370fb33a725b None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:40.806177 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a699e9e6-7eca-44c2-a14c-370fb33a725b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:40.807047 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e76c5eb-da6d-4096-9302-cf7e204603dc None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:40.822705 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-a699e9e6-7eca-44c2-a14c-370fb33a725b None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:29:40.823820 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-a699e9e6-7eca-44c2-a14c-370fb33a725b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:29:40.842927 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b5f8f8-802e-473f-a938-aa7607bbeb29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:40.843735 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b5f8f8-802e-473f-a938-aa7607bbeb29 None admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:40.844013 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b5f8f8-802e-473f-a938-aa7607bbeb29 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:40.844296 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b5f8f8-802e-473f-a938-aa7607bbeb29 None admin] PATH_INFO: `/v3/groups` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:40.845252 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b5f8f8-802e-473f-a938-aa7607bbeb29 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:40.846826 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b5f8f8-802e-473f-a938-aa7607bbeb29 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:40.892958 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 169/323] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:29:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 31 14:29:40.916012 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a699e9e6-7eca-44c2-a14c-370fb33a725b None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:40.936897 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 155/324] 10.222.0.15 () {60 vars in 1134 bytes} [Tue May 31 14:29:40 2022] POST /identity/v3/groups => generated 226 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 14:29:41.025136 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a699e9e6-7eca-44c2-a14c-370fb33a725b None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:41.050513 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:41.062316 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731f2253-752a-43f9-9cd3-3e3044d43020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:41.063169 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f2253-752a-43f9-9cd3-3e3044d43020 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:41.063446 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f2253-752a-43f9-9cd3-3e3044d43020 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:41.063720 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f2253-752a-43f9-9cd3-3e3044d43020 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:41.075680 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731f2253-752a-43f9-9cd3-3e3044d43020 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 14:29:41.084056 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-731f2253-752a-43f9-9cd3-3e3044d43020 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 31 14:29:41.084056 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:29:41.084056 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:29:41.084056 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:29:41.084056 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:29:41.084056 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:29:41.084056 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:29:41.084056 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:29:41.084056 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:29:41.084056 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:29:41.084056 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:29:41.084056 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:29:41.084056 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 14:29:41.084056 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 14:29:41.084056 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 14:29:41.084056 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 14:29:41.085665 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 14:29:41.085665 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 14:29:41.085665 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 14:29:41.085665 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 14:29:41.085665 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:29:41.085665 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:29:41.085665 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:29:41.085665 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:29:41.085665 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:29:41.085665 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:29:41.085665 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:29:41.085665 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:29:41.085665 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:29:41.085665 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:29:41.085665 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:29:41.085665 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:29:41.086460 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:29:41.086460 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:29:41.086460 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:29:41.086460 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:29:41.086460 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 14:29:41.086460 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 14:29:41.086460 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 14:29:41.086460 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 14:29:41.086460 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 14:29:41.086460 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 14:29:41.086460 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 31 14:29:41.086460 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:29:41.086460 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 170/325] 10.222.0.15 () {56 vars in 1099 bytes} [Tue May 31 14:29:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 14:29:41.093343 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b5f8f8-802e-473f-a938-aa7607bbeb29 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:41.204063 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b5f8f8-802e-473f-a938-aa7607bbeb29 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:41.229688 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:41.242622 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715cb649-a630-4b87-9263-8187fc7c7771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:41.243255 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715cb649-a630-4b87-9263-8187fc7c7771 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:41.243538 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715cb649-a630-4b87-9263-8187fc7c7771 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:41.243850 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715cb649-a630-4b87-9263-8187fc7c7771 None admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:41.244592 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715cb649-a630-4b87-9263-8187fc7c7771 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:29:41.244904 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715cb649-a630-4b87-9263-8187fc7c7771 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:41.246279 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715cb649-a630-4b87-9263-8187fc7c7771 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:41.256408 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 156/326] 10.222.0.15 () {56 vars in 1101 bytes} [Tue May 31 14:29:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:41.261743 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731f2253-752a-43f9-9cd3-3e3044d43020 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:41.371533 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731f2253-752a-43f9-9cd3-3e3044d43020 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:41.413596 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca58ea2-6744-4aaf-b2ad-8f9fd551b6f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:41.414488 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca58ea2-6744-4aaf-b2ad-8f9fd551b6f0 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:41.414848 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca58ea2-6744-4aaf-b2ad-8f9fd551b6f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:41.415129 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca58ea2-6744-4aaf-b2ad-8f9fd551b6f0 None admin] PATH_INFO: `/v3/users/3067097454b7441cb89129057174b754` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:41.416555 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca58ea2-6744-4aaf-b2ad-8f9fd551b6f0 None admin] RBAC: Authorizing `identity:get_user(user_id=3067097454b7441cb89129057174b754)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:41.418022 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca58ea2-6744-4aaf-b2ad-8f9fd551b6f0 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:41.419900 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 171/327] 10.222.0.15 () {56 vars in 1177 bytes} [Tue May 31 14:29:41 2022] GET /identity/v3/users/3067097454b7441cb89129057174b754 => generated 293 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:41.425329 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715cb649-a630-4b87-9263-8187fc7c7771 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:41.451131 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e5fc6-3311-49ad-9af7-ceadf9ea274d None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:41.451767 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e5fc6-3311-49ad-9af7-ceadf9ea274d None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:41.452288 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e5fc6-3311-49ad-9af7-ceadf9ea274d None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:41.453794 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 172/328] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:29:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:29:41.459623 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073701d9-56bf-4ae1-881e-8079f18eda1a None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:41.459960 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073701d9-56bf-4ae1-881e-8079f18eda1a None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:41.460246 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073701d9-56bf-4ae1-881e-8079f18eda1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:41.487590 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-073701d9-56bf-4ae1-881e-8079f18eda1a None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:29:41.488802 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-073701d9-56bf-4ae1-881e-8079f18eda1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:29:41.551313 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715cb649-a630-4b87-9263-8187fc7c7771 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:41.558118 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:41.589597 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 173/329] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:29:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 31 14:29:41.607282 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770a8dcb-b183-4c80-bea7-175665af5304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:41.608255 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a8dcb-b183-4c80-bea7-175665af5304 None admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:41.608616 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a8dcb-b183-4c80-bea7-175665af5304 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:41.608957 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a8dcb-b183-4c80-bea7-175665af5304 None admin] PATH_INFO: `/v3/system/users/3067097454b7441cb89129057174b754/roles/7ac88acfdd6d4edaa12064f0d47e1bf9` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:41.610514 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770a8dcb-b183-4c80-bea7-175665af5304 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=3067097454b7441cb89129057174b754, role_id=7ac88acfdd6d4edaa12064f0d47e1bf9)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:41.612101 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770a8dcb-b183-4c80-bea7-175665af5304 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:41.616775 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073701d9-56bf-4ae1-881e-8079f18eda1a None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:41.685951 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 157/330] 10.222.0.15 () {58 vars in 1334 bytes} [Tue May 31 14:29:41 2022] PUT /identity/v3/system/users/3067097454b7441cb89129057174b754/roles/7ac88acfdd6d4edaa12064f0d47e1bf9 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:29:41.736264 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073701d9-56bf-4ae1-881e-8079f18eda1a None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:41.776018 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4238825-0927-4f80-9f57-391e15a66c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:41.776845 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4238825-0927-4f80-9f57-391e15a66c4e None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:41.777132 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4238825-0927-4f80-9f57-391e15a66c4e None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:41.777471 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4238825-0927-4f80-9f57-391e15a66c4e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:41.791698 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4238825-0927-4f80-9f57-391e15a66c4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 14:29:41.800120 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-b4238825-0927-4f80-9f57-391e15a66c4e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 31 14:29:41.800120 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:29:41.800120 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:29:41.800120 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:29:41.800120 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:29:41.800120 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:29:41.800120 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:29:41.800120 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:29:41.800120 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:29:41.800120 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:29:41.800120 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:29:41.800120 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:29:41.800120 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 14:29:41.800120 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 14:29:41.800120 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 14:29:41.800120 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 14:29:41.801510 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 14:29:41.801510 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 14:29:41.801510 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 14:29:41.801510 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 14:29:41.801510 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:29:41.801510 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:29:41.801510 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:29:41.801510 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:29:41.801510 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:29:41.801510 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:29:41.801510 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:29:41.801510 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:29:41.801510 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:29:41.801510 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:29:41.801510 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:29:41.801510 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:29:41.802309 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:29:41.802309 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:29:41.802309 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:29:41.802309 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:29:41.802309 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 14:29:41.802309 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 14:29:41.802309 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 14:29:41.802309 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 14:29:41.802309 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 14:29:41.802309 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 14:29:41.802309 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 31 14:29:41.802309 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:29:41.802309 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 174/331] 10.222.0.15 () {56 vars in 1099 bytes} [Tue May 31 14:29:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 14:29:41.807749 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770a8dcb-b183-4c80-bea7-175665af5304 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:41.877189 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:41.936138 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770a8dcb-b183-4c80-bea7-175665af5304 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:41.982015 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60830d8-3375-4f64-965c-94bacf4d7dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:41.982731 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60830d8-3375-4f64-965c-94bacf4d7dc4 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:41.983024 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60830d8-3375-4f64-965c-94bacf4d7dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:41.983305 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60830d8-3375-4f64-965c-94bacf4d7dc4 None admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:41.984059 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60830d8-3375-4f64-965c-94bacf4d7dc4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:29:41.984370 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60830d8-3375-4f64-965c-94bacf4d7dc4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:41.985755 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60830d8-3375-4f64-965c-94bacf4d7dc4 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:41.995711 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 158/332] 10.222.0.15 () {56 vars in 1101 bytes} [Tue May 31 14:29:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:42.000996 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4238825-0927-4f80-9f57-391e15a66c4e None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:42.053543 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:42.117881 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4238825-0927-4f80-9f57-391e15a66c4e None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:42.162760 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766b91df-9e3d-4dff-b5be-f76943f7f1ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:42.164296 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766b91df-9e3d-4dff-b5be-f76943f7f1ae None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:42.164661 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766b91df-9e3d-4dff-b5be-f76943f7f1ae None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:42.165009 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766b91df-9e3d-4dff-b5be-f76943f7f1ae None admin] PATH_INFO: `/v3/users/70097047812e4d0a89987ba18d673e2f` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:42.167285 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766b91df-9e3d-4dff-b5be-f76943f7f1ae None admin] RBAC: Authorizing `identity:get_user(user_id=70097047812e4d0a89987ba18d673e2f)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:42.168824 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766b91df-9e3d-4dff-b5be-f76943f7f1ae None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:42.170973 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 175/333] 10.222.0.15 () {56 vars in 1177 bytes} [Tue May 31 14:29:41 2022] GET /identity/v3/users/70097047812e4d0a89987ba18d673e2f => generated 293 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 14:29:42.176459 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60830d8-3375-4f64-965c-94bacf4d7dc4 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:42.297050 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60830d8-3375-4f64-965c-94bacf4d7dc4 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:42.314744 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:42.338858 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbac685-997c-42e2-911d-e92837a961c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:42.339620 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbac685-997c-42e2-911d-e92837a961c6 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:42.339982 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbac685-997c-42e2-911d-e92837a961c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:42.340351 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbac685-997c-42e2-911d-e92837a961c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:42.341268 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbac685-997c-42e2-911d-e92837a961c6 None admin] RBAC: Adding query filter params (role.id=317f725e26bf43648d8235bb1f7c4cb3, user.id=70097047812e4d0a89987ba18d673e2f, scope.system=all) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:29:42.341661 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbac685-997c-42e2-911d-e92837a961c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:42.343232 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbac685-997c-42e2-911d-e92837a961c6 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:42.359528 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 159/334] 10.222.0.15 () {56 vars in 1308 bytes} [Tue May 31 14:29:42 2022] GET /identity/v3/role_assignments?user.id=70097047812e4d0a89987ba18d673e2f&scope.system=all&role.id=317f725e26bf43648d8235bb1f7c4cb3 => generated 510 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:43.725493 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0980ccd9-21fb-4299-988b-fc76dd9ca04b None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:43.726507 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0980ccd9-21fb-4299-988b-fc76dd9ca04b None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:43.726507 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0980ccd9-21fb-4299-988b-fc76dd9ca04b None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:43.728142 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 176/335] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:29:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:29:43.746944 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd1a02-7cb4-404a-bf78-c72e65a97a6e None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:43.747466 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd1a02-7cb4-404a-bf78-c72e65a97a6e None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:43.747547 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd1a02-7cb4-404a-bf78-c72e65a97a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:43.774665 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-89bd1a02-7cb4-404a-bf78-c72e65a97a6e None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:29:43.776080 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-89bd1a02-7cb4-404a-bf78-c72e65a97a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:29:43.873219 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 160/336] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:29:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 14:29:43.914298 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0980ccd9-21fb-4299-988b-fc76dd9ca04b None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:44.073357 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0980ccd9-21fb-4299-988b-fc76dd9ca04b None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:44.084225 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:44.108610 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a14c00b-fcd5-4a66-8233-91b619c7a08c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:44.109412 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a14c00b-fcd5-4a66-8233-91b619c7a08c None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:44.109702 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a14c00b-fcd5-4a66-8233-91b619c7a08c None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:44.109983 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a14c00b-fcd5-4a66-8233-91b619c7a08c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:44.121789 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a14c00b-fcd5-4a66-8233-91b619c7a08c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 14:29:44.129745 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-6a14c00b-fcd5-4a66-8233-91b619c7a08c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 31 14:29:44.129745 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:29:44.129745 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:29:44.129745 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:29:44.129745 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:29:44.129745 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:29:44.129745 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:29:44.129745 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:29:44.129745 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:29:44.129745 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:29:44.129745 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:29:44.129745 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:29:44.129745 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 14:29:44.129745 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 14:29:44.129745 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 14:29:44.129745 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 14:29:44.130747 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 14:29:44.130747 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 14:29:44.130747 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 14:29:44.130747 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 14:29:44.130747 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:29:44.130747 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:29:44.130747 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:29:44.130747 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:29:44.130747 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:29:44.130747 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:29:44.130747 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:29:44.130747 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:29:44.130747 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:29:44.130747 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:29:44.130747 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:29:44.130747 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:29:44.131585 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:29:44.131585 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:29:44.131585 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:29:44.131585 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:29:44.131585 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 14:29:44.131585 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 14:29:44.131585 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 14:29:44.131585 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 14:29:44.131585 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 14:29:44.131585 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 14:29:44.131585 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 31 14:29:44.131585 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:29:44.133234 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 177/337] 10.222.0.15 () {56 vars in 1099 bytes} [Tue May 31 14:29:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:29:44.138733 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bd1a02-7cb4-404a-bf78-c72e65a97a6e None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:44.243993 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:44.246440 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bd1a02-7cb4-404a-bf78-c72e65a97a6e None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:44.281519 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f1b6c6-6617-4bd6-b90a-0dc48e7e4709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:44.282196 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f1b6c6-6617-4bd6-b90a-0dc48e7e4709 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:44.282483 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f1b6c6-6617-4bd6-b90a-0dc48e7e4709 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:44.282792 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f1b6c6-6617-4bd6-b90a-0dc48e7e4709 None admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:44.283798 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f1b6c6-6617-4bd6-b90a-0dc48e7e4709 None admin] RBAC: Adding query filter params (name=member) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:29:44.284133 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f1b6c6-6617-4bd6-b90a-0dc48e7e4709 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:44.285623 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f1b6c6-6617-4bd6-b90a-0dc48e7e4709 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:44.295337 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 161/338] 10.222.0.15 () {56 vars in 1101 bytes} [Tue May 31 14:29:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:44.300895 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a14c00b-fcd5-4a66-8233-91b619c7a08c None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:44.415191 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a14c00b-fcd5-4a66-8233-91b619c7a08c None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:44.450793 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0e0942-e490-4f61-b211-ee0ffbc1d4a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:44.451453 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0e0942-e490-4f61-b211-ee0ffbc1d4a8 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:44.451738 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0e0942-e490-4f61-b211-ee0ffbc1d4a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:44.452017 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0e0942-e490-4f61-b211-ee0ffbc1d4a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:44.494833 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:44.527674 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0e0942-e490-4f61-b211-ee0ffbc1d4a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:44.529178 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0e0942-e490-4f61-b211-ee0ffbc1d4a8 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:44.638684 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 178/339] 10.222.0.15 () {58 vars in 1282 bytes} [Tue May 31 14:29:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 31 14:29:44.640866 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f1b6c6-6617-4bd6-b90a-0dc48e7e4709 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:44.735927 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca52794d-3138-4b66-9a5a-c09bd13b7351 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:44.736873 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca52794d-3138-4b66-9a5a-c09bd13b7351 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:44.737352 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca52794d-3138-4b66-9a5a-c09bd13b7351 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:44.739259 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 179/340] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:29:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:29:44.745361 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a71484-dc0e-4d23-9db6-a8e5b2cdc24c None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:44.745885 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a71484-dc0e-4d23-9db6-a8e5b2cdc24c None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:44.746367 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a71484-dc0e-4d23-9db6-a8e5b2cdc24c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:44.747417 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f1b6c6-6617-4bd6-b90a-0dc48e7e4709 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:44.764818 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-a5a71484-dc0e-4d23-9db6-a8e5b2cdc24c None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:29:44.766422 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-a5a71484-dc0e-4d23-9db6-a8e5b2cdc24c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:29:44.791328 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d039b3bd-730b-435d-b6a9-fe8b413b2f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:44.792213 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d039b3bd-730b-435d-b6a9-fe8b413b2f83 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:44.792502 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d039b3bd-730b-435d-b6a9-fe8b413b2f83 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:44.792785 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d039b3bd-730b-435d-b6a9-fe8b413b2f83 None admin] PATH_INFO: `/v3/projects/6a0fafbf41854f8ab937e416e30b1892` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:44.794566 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d039b3bd-730b-435d-b6a9-fe8b413b2f83 None admin] RBAC: Authorizing `identity:get_project(project_id=6a0fafbf41854f8ab937e416e30b1892)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:44.796621 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d039b3bd-730b-435d-b6a9-fe8b413b2f83 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:44.802649 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 162/341] 10.222.0.15 () {56 vars in 1186 bytes} [Tue May 31 14:29:44 2022] GET /identity/v3/projects/6a0fafbf41854f8ab937e416e30b1892 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:44.805510 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d039b3bd-730b-435d-b6a9-fe8b413b2f83 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:44.841614 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:44.864426 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:44.873456 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 180/342] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:29:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 31 14:29:44.903762 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a71484-dc0e-4d23-9db6-a8e5b2cdc24c None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:44.982342 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d039b3bd-730b-435d-b6a9-fe8b413b2f83 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:45.025829 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a71484-dc0e-4d23-9db6-a8e5b2cdc24c None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:45.052664 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2596e0f2-52e0-47f9-b835-87c2a31b14a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:45.053540 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2596e0f2-52e0-47f9-b835-87c2a31b14a7 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:45.054356 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2596e0f2-52e0-47f9-b835-87c2a31b14a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:45.054660 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2596e0f2-52e0-47f9-b835-87c2a31b14a7 None admin] PATH_INFO: `/v3/groups/5f67a89fa42d4683a086676ac79552b7` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:45.067220 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2596e0f2-52e0-47f9-b835-87c2a31b14a7 None admin] RBAC: Authorizing `identity:get_group(group_id=5f67a89fa42d4683a086676ac79552b7)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:45.068694 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2596e0f2-52e0-47f9-b835-87c2a31b14a7 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:45.071394 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 163/343] 10.222.0.15 () {56 vars in 1180 bytes} [Tue May 31 14:29:44 2022] GET /identity/v3/groups/5f67a89fa42d4683a086676ac79552b7 => generated 226 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 14:29:45.077754 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2596e0f2-52e0-47f9-b835-87c2a31b14a7 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:45.084601 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6800d56e-dcb8-4989-bed9-fe870213617d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:45.085706 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6800d56e-dcb8-4989-bed9-fe870213617d None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:45.086208 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6800d56e-dcb8-4989-bed9-fe870213617d None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:45.086708 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6800d56e-dcb8-4989-bed9-fe870213617d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:45.113777 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6800d56e-dcb8-4989-bed9-fe870213617d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 14:29:45.123786 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-6800d56e-dcb8-4989-bed9-fe870213617d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 31 14:29:45.123786 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:29:45.123786 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:29:45.123786 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:29:45.123786 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:29:45.123786 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:29:45.123786 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:29:45.123786 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:29:45.123786 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:29:45.123786 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:29:45.123786 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:29:45.123786 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:29:45.123786 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 14:29:45.123786 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 14:29:45.123786 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 14:29:45.123786 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 14:29:45.124672 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 14:29:45.124672 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 14:29:45.124672 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 14:29:45.124672 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 14:29:45.124672 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:29:45.124672 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:29:45.124672 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:29:45.124672 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:29:45.124672 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:29:45.124672 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:29:45.124672 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:29:45.124672 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:29:45.124672 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:29:45.124672 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:29:45.124672 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:29:45.124672 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:29:45.125457 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:29:45.125457 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:29:45.125457 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:29:45.125457 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:29:45.125457 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 14:29:45.125457 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 14:29:45.125457 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 14:29:45.125457 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 14:29:45.125457 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 14:29:45.125457 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 14:29:45.125457 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 31 14:29:45.125457 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:29:45.132762 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 181/344] 10.222.0.15 () {56 vars in 1114 bytes} [Tue May 31 14:29:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:29:45.138794 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6800d56e-dcb8-4989-bed9-fe870213617d None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:45.224057 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:45.228979 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2596e0f2-52e0-47f9-b835-87c2a31b14a7 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:45.262959 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:45.281862 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24439eb4-3545-46c0-9ad1-923dcc383d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:45.282459 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24439eb4-3545-46c0-9ad1-923dcc383d9a None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:45.282776 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24439eb4-3545-46c0-9ad1-923dcc383d9a None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:45.283062 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24439eb4-3545-46c0-9ad1-923dcc383d9a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:45.284174 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24439eb4-3545-46c0-9ad1-923dcc383d9a None admin] RBAC: Adding query filter params (group.id=5f67a89fa42d4683a086676ac79552b7, role.id=317f725e26bf43648d8235bb1f7c4cb3, scope.project.id=6a0fafbf41854f8ab937e416e30b1892) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:29:45.284494 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24439eb4-3545-46c0-9ad1-923dcc383d9a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:45.285974 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24439eb4-3545-46c0-9ad1-923dcc383d9a None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:45.295026 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 164/345] 10.222.0.15 () {56 vars in 1376 bytes} [Tue May 31 14:29:45 2022] GET /identity/v3/role_assignments?group.id=5f67a89fa42d4683a086676ac79552b7&scope.project.id=6a0fafbf41854f8ab937e416e30b1892&role.id=317f725e26bf43648d8235bb1f7c4cb3 => generated 260 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 14:29:45.345643 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6800d56e-dcb8-4989-bed9-fe870213617d None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:45.394309 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30aada1c-bcf0-48da-9304-d2f82c65c4d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:45.395024 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aada1c-bcf0-48da-9304-d2f82c65c4d6 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:45.395312 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aada1c-bcf0-48da-9304-d2f82c65c4d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:45.395591 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30aada1c-bcf0-48da-9304-d2f82c65c4d6 None admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:45.396341 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30aada1c-bcf0-48da-9304-d2f82c65c4d6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:29:45.396647 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30aada1c-bcf0-48da-9304-d2f82c65c4d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:45.398068 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30aada1c-bcf0-48da-9304-d2f82c65c4d6 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:45.410894 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 182/346] 10.222.0.15 () {56 vars in 1111 bytes} [Tue May 31 14:29:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:45.417266 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24439eb4-3545-46c0-9ad1-923dcc383d9a None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:45.571127 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24439eb4-3545-46c0-9ad1-923dcc383d9a None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:45.617346 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707b7010-7260-48bd-821b-74a92ad93faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:45.618002 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707b7010-7260-48bd-821b-74a92ad93faa None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:45.618289 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707b7010-7260-48bd-821b-74a92ad93faa None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:45.618578 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707b7010-7260-48bd-821b-74a92ad93faa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:45.651584 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:45.697300 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707b7010-7260-48bd-821b-74a92ad93faa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:45.698826 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707b7010-7260-48bd-821b-74a92ad93faa None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:45.747431 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1a0eee-0078-4ca9-845a-cba617e03017 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:45.747957 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1a0eee-0078-4ca9-845a-cba617e03017 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:45.747957 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1a0eee-0078-4ca9-845a-cba617e03017 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:45.749559 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 183/347] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:29:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:29:45.754820 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d236b8e2-64a6-4b34-b410-7c3432f2011f None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:45.755106 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d236b8e2-64a6-4b34-b410-7c3432f2011f None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:45.755386 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d236b8e2-64a6-4b34-b410-7c3432f2011f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:45.795789 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-d236b8e2-64a6-4b34-b410-7c3432f2011f None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:29:45.797196 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-d236b8e2-64a6-4b34-b410-7c3432f2011f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:29:45.803649 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 165/348] 10.222.0.15 () {58 vars in 1282 bytes} [Tue May 31 14:29:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 31 14:29:45.805009 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcc851f-8286-4481-98fc-1d704ccced8a None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:45.805305 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcc851f-8286-4481-98fc-1d704ccced8a None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:45.805638 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcc851f-8286-4481-98fc-1d704ccced8a None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:45.807225 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 166/349] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:29:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:29:45.810025 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcc851f-8286-4481-98fc-1d704ccced8a None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:45.873403 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:45.921277 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcc851f-8286-4481-98fc-1d704ccced8a None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:45.939396 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 184/350] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:29:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 31 14:29:45.940878 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cbb2c5-e883-4c13-9362-95d635fb7e85 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:45.941170 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cbb2c5-e883-4c13-9362-95d635fb7e85 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:45.941532 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cbb2c5-e883-4c13-9362-95d635fb7e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:45.961310 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022547e4-1fd8-4693-85ce-062462f8b9ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:45.962294 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022547e4-1fd8-4693-85ce-062462f8b9ab None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:45.962615 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022547e4-1fd8-4693-85ce-062462f8b9ab None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:45.962903 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022547e4-1fd8-4693-85ce-062462f8b9ab None admin] PATH_INFO: `/v3/projects/6a0fafbf41854f8ab937e416e30b1892` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:45.964200 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022547e4-1fd8-4693-85ce-062462f8b9ab None admin] RBAC: Authorizing `identity:get_project(project_id=6a0fafbf41854f8ab937e416e30b1892)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:45.965760 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022547e4-1fd8-4693-85ce-062462f8b9ab None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:45.967956 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 167/351] 10.222.0.15 () {56 vars in 1186 bytes} [Tue May 31 14:29:45 2022] GET /identity/v3/projects/6a0fafbf41854f8ab937e416e30b1892 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 14:29:45.973341 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022547e4-1fd8-4693-85ce-062462f8b9ab None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:45.985163 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-20cbb2c5-e883-4c13-9362-95d635fb7e85 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:29:45.986399 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-20cbb2c5-e883-4c13-9362-95d635fb7e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:29:46.082341 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022547e4-1fd8-4693-85ce-062462f8b9ab None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:46.084748 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:46.110244 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:46.122616 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6373fd-334c-47e2-992f-16ddfc0824af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:46.123551 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6373fd-334c-47e2-992f-16ddfc0824af None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:46.123778 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6373fd-334c-47e2-992f-16ddfc0824af None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:46.124065 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6373fd-334c-47e2-992f-16ddfc0824af None admin] PATH_INFO: `/v3/groups/5f67a89fa42d4683a086676ac79552b7` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:46.125990 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6373fd-334c-47e2-992f-16ddfc0824af None admin] RBAC: Authorizing `identity:get_group(group_id=5f67a89fa42d4683a086676ac79552b7)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:46.127753 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6373fd-334c-47e2-992f-16ddfc0824af None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:46.129896 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 168/352] 10.222.0.15 () {56 vars in 1180 bytes} [Tue May 31 14:29:45 2022] GET /identity/v3/groups/5f67a89fa42d4683a086676ac79552b7 => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 14:29:46.130488 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 185/353] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:29:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 14:29:46.134663 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6373fd-334c-47e2-992f-16ddfc0824af None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:46.137146 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cbb2c5-e883-4c13-9362-95d635fb7e85 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:46.325649 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cbb2c5-e883-4c13-9362-95d635fb7e85 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:46.332495 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6373fd-334c-47e2-992f-16ddfc0824af None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:46.367526 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2447e0be-6bdc-4174-927d-11e146099a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:46.368183 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2447e0be-6bdc-4174-927d-11e146099a81 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:46.368501 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2447e0be-6bdc-4174-927d-11e146099a81 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:46.368838 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2447e0be-6bdc-4174-927d-11e146099a81 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:46.369922 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2447e0be-6bdc-4174-927d-11e146099a81 None admin] RBAC: Adding query filter params (group.id=5f67a89fa42d4683a086676ac79552b7, role.id=86e29729720b4d53b2a375a337765a2d, scope.project.id=6a0fafbf41854f8ab937e416e30b1892) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:29:46.370236 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2447e0be-6bdc-4174-927d-11e146099a81 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:46.372162 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2447e0be-6bdc-4174-927d-11e146099a81 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:46.378835 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 186/354] 10.222.0.15 () {56 vars in 1376 bytes} [Tue May 31 14:29:46 2022] GET /identity/v3/role_assignments?group.id=5f67a89fa42d4683a086676ac79552b7&scope.project.id=6a0fafbf41854f8ab937e416e30b1892&role.id=86e29729720b4d53b2a375a337765a2d => generated 260 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 14:29:46.387995 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2447e0be-6bdc-4174-927d-11e146099a81 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:46.419789 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3bcc7a-9abb-427b-96f8-6433d4b32833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:46.420993 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3bcc7a-9abb-427b-96f8-6433d4b32833 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:46.421596 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3bcc7a-9abb-427b-96f8-6433d4b32833 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:46.422112 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3bcc7a-9abb-427b-96f8-6433d4b32833 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:46.437477 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3bcc7a-9abb-427b-96f8-6433d4b32833 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 14:29:46.446955 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-fc3bcc7a-9abb-427b-96f8-6433d4b32833 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 31 14:29:46.446955 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:29:46.446955 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:29:46.446955 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:29:46.446955 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:29:46.446955 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:29:46.446955 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:29:46.446955 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:29:46.446955 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:29:46.446955 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:29:46.446955 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:29:46.446955 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:29:46.446955 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 14:29:46.446955 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 14:29:46.446955 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 14:29:46.446955 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 14:29:46.447932 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 14:29:46.447932 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 14:29:46.447932 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 14:29:46.447932 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 14:29:46.447932 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:29:46.447932 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:29:46.447932 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:29:46.447932 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:29:46.447932 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:29:46.447932 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:29:46.447932 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:29:46.447932 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:29:46.447932 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:29:46.447932 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:29:46.447932 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:29:46.447932 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:29:46.448754 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:29:46.448754 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:29:46.448754 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:29:46.448754 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:29:46.448754 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 14:29:46.448754 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 14:29:46.448754 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 14:29:46.448754 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 14:29:46.448754 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 14:29:46.448754 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 14:29:46.448754 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 31 14:29:46.448754 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:29:46.450597 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:46.452211 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 169/355] 10.222.0.15 () {56 vars in 1099 bytes} [Tue May 31 14:29:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:29:46.453833 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9f2de1-bbb6-405f-ab87-d737b67b00ca None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:46.454348 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9f2de1-bbb6-405f-ab87-d737b67b00ca None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:46.454922 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9f2de1-bbb6-405f-ab87-d737b67b00ca None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:46.456526 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 170/356] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:29:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:29:46.457987 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e6c80-1b0d-4e2e-8443-b6f9711e27ab None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:46.458481 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e6c80-1b0d-4e2e-8443-b6f9711e27ab None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:46.459007 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e6c80-1b0d-4e2e-8443-b6f9711e27ab None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:46.461283 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 171/357] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:29:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:29:46.462752 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9b2f5d-7860-4f40-acef-d6fd80644e28 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:46.463248 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9b2f5d-7860-4f40-acef-d6fd80644e28 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:46.463724 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9b2f5d-7860-4f40-acef-d6fd80644e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:46.483943 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-6b9b2f5d-7860-4f40-acef-d6fd80644e28 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:29:46.486029 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-6b9b2f5d-7860-4f40-acef-d6fd80644e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:29:46.534771 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2447e0be-6bdc-4174-927d-11e146099a81 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:46.557901 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:46.578442 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 172/358] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:29:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 31 14:29:46.580572 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5454c6ba-8136-4c97-9f61-b63905cd55fa None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:46.580891 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5454c6ba-8136-4c97-9f61-b63905cd55fa None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:46.581606 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5454c6ba-8136-4c97-9f61-b63905cd55fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:46.585777 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f85062-9fea-49fc-86ea-be535b4d9b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:46.587184 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f85062-9fea-49fc-86ea-be535b4d9b0c None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:46.588644 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f85062-9fea-49fc-86ea-be535b4d9b0c None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:46.589166 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f85062-9fea-49fc-86ea-be535b4d9b0c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:46.602384 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-5454c6ba-8136-4c97-9f61-b63905cd55fa None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:29:46.605617 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-5454c6ba-8136-4c97-9f61-b63905cd55fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:29:46.608257 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f85062-9fea-49fc-86ea-be535b4d9b0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 14:29:46.621513 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-37f85062-9fea-49fc-86ea-be535b4d9b0c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 31 14:29:46.621513 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:29:46.621513 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:29:46.621513 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:29:46.621513 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:29:46.621513 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:29:46.621513 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:29:46.621513 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:29:46.621513 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:29:46.621513 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:29:46.621513 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:29:46.621513 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:29:46.621513 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 14:29:46.621513 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 14:29:46.621513 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 14:29:46.621513 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 14:29:46.622469 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 14:29:46.622469 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 14:29:46.622469 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 14:29:46.622469 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 14:29:46.622469 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:29:46.622469 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:29:46.622469 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:29:46.622469 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:29:46.622469 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:29:46.622469 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:29:46.622469 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:29:46.622469 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:29:46.622469 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:29:46.622469 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:29:46.622469 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:29:46.622469 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:29:46.623334 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:29:46.623334 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:29:46.623334 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:29:46.623334 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:29:46.623334 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 14:29:46.623334 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 14:29:46.623334 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 14:29:46.623334 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 14:29:46.623334 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 14:29:46.623334 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 14:29:46.623334 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 31 14:29:46.623334 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:29:46.624015 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 187/359] 10.222.0.15 () {56 vars in 1099 bytes} [Tue May 31 14:29:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:29:46.624852 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f85062-9fea-49fc-86ea-be535b4d9b0c None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:46.689904 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 173/360] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:29:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 14:29:46.690964 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5454c6ba-8136-4c97-9f61-b63905cd55fa None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:46.759249 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f85062-9fea-49fc-86ea-be535b4d9b0c None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:46.771693 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:46.813756 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96c033a-4a01-4712-b675-d6e5dc9e8950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:46.814464 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c033a-4a01-4712-b675-d6e5dc9e8950 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:46.814778 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c033a-4a01-4712-b675-d6e5dc9e8950 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:46.815061 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c033a-4a01-4712-b675-d6e5dc9e8950 None admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:46.815812 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96c033a-4a01-4712-b675-d6e5dc9e8950 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:29:46.816121 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96c033a-4a01-4712-b675-d6e5dc9e8950 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:46.817519 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96c033a-4a01-4712-b675-d6e5dc9e8950 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:46.830218 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 188/361] 10.222.0.15 () {56 vars in 1101 bytes} [Tue May 31 14:29:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:46.831211 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96c033a-4a01-4712-b675-d6e5dc9e8950 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:46.832254 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5454c6ba-8136-4c97-9f61-b63905cd55fa None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:46.851659 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:46.879260 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f3b4e1-ce02-4127-b53b-aedbe09c69cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:46.881095 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f3b4e1-ce02-4127-b53b-aedbe09c69cf None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:46.881591 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f3b4e1-ce02-4127-b53b-aedbe09c69cf None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:46.882802 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f3b4e1-ce02-4127-b53b-aedbe09c69cf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:46.897553 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f3b4e1-ce02-4127-b53b-aedbe09c69cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 14:29:46.908292 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-a0f3b4e1-ce02-4127-b53b-aedbe09c69cf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 31 14:29:46.908292 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:29:46.908292 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:29:46.908292 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:29:46.908292 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:29:46.908292 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:29:46.908292 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:29:46.908292 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:29:46.908292 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:29:46.908292 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:29:46.908292 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:29:46.908292 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:29:46.908292 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 14:29:46.908292 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 14:29:46.908292 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 14:29:46.908292 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 14:29:46.909464 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 14:29:46.909464 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 14:29:46.909464 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 14:29:46.909464 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 14:29:46.909464 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:29:46.909464 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:29:46.909464 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:29:46.909464 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:29:46.909464 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:29:46.909464 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:29:46.909464 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:29:46.909464 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:29:46.909464 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:29:46.909464 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:29:46.909464 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:29:46.909464 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:29:46.910301 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:29:46.910301 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:29:46.910301 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:29:46.910301 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:29:46.910301 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 14:29:46.910301 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 14:29:46.910301 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 14:29:46.910301 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 14:29:46.910301 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 14:29:46.910301 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 14:29:46.910301 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 31 14:29:46.910301 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:29:46.912826 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 174/362] 10.222.0.15 () {56 vars in 1096 bytes} [Tue May 31 14:29:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:29:46.914958 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f3b4e1-ce02-4127-b53b-aedbe09c69cf None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:46.948482 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96c033a-4a01-4712-b675-d6e5dc9e8950 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:46.988221 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d1553c-71ad-4f5f-a6da-b35b5f877829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:46.988633 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d1553c-71ad-4f5f-a6da-b35b5f877829 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:46.988927 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d1553c-71ad-4f5f-a6da-b35b5f877829 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:46.989259 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d1553c-71ad-4f5f-a6da-b35b5f877829 None admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:46.990022 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d1553c-71ad-4f5f-a6da-b35b5f877829 None admin] RBAC: Adding query filter params (name=member) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:29:46.990336 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d1553c-71ad-4f5f-a6da-b35b5f877829 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:46.993938 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d1553c-71ad-4f5f-a6da-b35b5f877829 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:47.005387 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 189/363] 10.222.0.15 () {56 vars in 1101 bytes} [Tue May 31 14:29:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:47.006225 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d1553c-71ad-4f5f-a6da-b35b5f877829 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:47.045926 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f3b4e1-ce02-4127-b53b-aedbe09c69cf None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:47.057344 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:47.087349 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542518d8-6482-4934-b33f-db2321a46f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:47.088166 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542518d8-6482-4934-b33f-db2321a46f68 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:47.088455 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542518d8-6482-4934-b33f-db2321a46f68 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:47.088739 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542518d8-6482-4934-b33f-db2321a46f68 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:47.101287 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542518d8-6482-4934-b33f-db2321a46f68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 14:29:47.109526 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-542518d8-6482-4934-b33f-db2321a46f68 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 31 14:29:47.109526 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:29:47.109526 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:29:47.109526 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:29:47.109526 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:29:47.109526 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:29:47.109526 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:29:47.109526 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:29:47.109526 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:29:47.109526 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:29:47.109526 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:29:47.109526 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:29:47.109526 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 14:29:47.109526 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 14:29:47.109526 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 14:29:47.109526 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 14:29:47.110470 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 14:29:47.110470 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 14:29:47.110470 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 14:29:47.110470 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 14:29:47.110470 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:29:47.110470 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:29:47.110470 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:29:47.110470 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:29:47.110470 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:29:47.110470 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:29:47.110470 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:29:47.110470 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:29:47.110470 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:29:47.110470 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:29:47.110470 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:29:47.110470 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:29:47.111324 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:29:47.111324 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:29:47.111324 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:29:47.111324 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:29:47.111324 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 14:29:47.111324 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 14:29:47.111324 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 14:29:47.111324 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 14:29:47.111324 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 14:29:47.111324 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 14:29:47.111324 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 31 14:29:47.111324 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:29:47.111943 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 175/364] 10.222.0.15 () {56 vars in 1114 bytes} [Tue May 31 14:29:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:29:47.113727 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542518d8-6482-4934-b33f-db2321a46f68 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:47.136050 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d1553c-71ad-4f5f-a6da-b35b5f877829 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:47.149212 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:47.171668 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cb52a7-3eaf-42c4-867b-5a55b26e3f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:47.172552 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb52a7-3eaf-42c4-867b-5a55b26e3f22 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:47.172831 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb52a7-3eaf-42c4-867b-5a55b26e3f22 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:47.173103 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb52a7-3eaf-42c4-867b-5a55b26e3f22 None admin] PATH_INFO: `/v3/users/3067097454b7441cb89129057174b754` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:47.174317 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cb52a7-3eaf-42c4-867b-5a55b26e3f22 None admin] RBAC: Authorizing `identity:get_user(user_id=3067097454b7441cb89129057174b754)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:47.175891 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cb52a7-3eaf-42c4-867b-5a55b26e3f22 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:47.177795 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 190/365] 10.222.0.15 () {56 vars in 1177 bytes} [Tue May 31 14:29:47 2022] GET /identity/v3/users/3067097454b7441cb89129057174b754 => generated 293 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:47.178583 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cb52a7-3eaf-42c4-867b-5a55b26e3f22 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:47.220611 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542518d8-6482-4934-b33f-db2321a46f68 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:47.259016 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d17a9c-f7bb-4c0b-8d61-eb1fb7dafcbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:47.259698 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d17a9c-f7bb-4c0b-8d61-eb1fb7dafcbf None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:47.259985 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d17a9c-f7bb-4c0b-8d61-eb1fb7dafcbf None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:47.260267 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d17a9c-f7bb-4c0b-8d61-eb1fb7dafcbf None admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:47.261027 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d17a9c-f7bb-4c0b-8d61-eb1fb7dafcbf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:29:47.261333 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d17a9c-f7bb-4c0b-8d61-eb1fb7dafcbf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:47.262753 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d17a9c-f7bb-4c0b-8d61-eb1fb7dafcbf None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:47.273982 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 176/366] 10.222.0.15 () {56 vars in 1099 bytes} [Tue May 31 14:29:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:47.274886 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d17a9c-f7bb-4c0b-8d61-eb1fb7dafcbf None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:47.296130 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cb52a7-3eaf-42c4-867b-5a55b26e3f22 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:47.316348 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:47.331662 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9023c20d-397d-4cd2-9338-7e92f37fcadd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:47.335662 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9023c20d-397d-4cd2-9338-7e92f37fcadd None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:47.335662 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9023c20d-397d-4cd2-9338-7e92f37fcadd None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:47.335662 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9023c20d-397d-4cd2-9338-7e92f37fcadd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:47.380003 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:47.387896 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d17a9c-f7bb-4c0b-8d61-eb1fb7dafcbf None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:47.406783 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9023c20d-397d-4cd2-9338-7e92f37fcadd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:47.408309 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9023c20d-397d-4cd2-9338-7e92f37fcadd None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:47.424415 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bc6e8a-caca-4826-8b97-04c494a17e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:47.425086 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc6e8a-caca-4826-8b97-04c494a17e59 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:47.425374 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc6e8a-caca-4826-8b97-04c494a17e59 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:47.425665 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc6e8a-caca-4826-8b97-04c494a17e59 None admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:47.426415 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bc6e8a-caca-4826-8b97-04c494a17e59 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:29:47.426965 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bc6e8a-caca-4826-8b97-04c494a17e59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:47.428123 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bc6e8a-caca-4826-8b97-04c494a17e59 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:47.436391 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 177/367] 10.222.0.15 () {56 vars in 1111 bytes} [Tue May 31 14:29:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:47.441576 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bc6e8a-caca-4826-8b97-04c494a17e59 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:47.530050 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 191/368] 10.222.0.15 () {58 vars in 1282 bytes} [Tue May 31 14:29:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 31 14:29:47.530614 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:47.532999 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9023c20d-397d-4cd2-9338-7e92f37fcadd None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:47.552669 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bc6e8a-caca-4826-8b97-04c494a17e59 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:47.588164 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf81908-12f4-4cb1-b6bc-7fbac120bf3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:47.588825 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf81908-12f4-4cb1-b6bc-7fbac120bf3a None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:47.589118 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf81908-12f4-4cb1-b6bc-7fbac120bf3a None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:47.589676 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf81908-12f4-4cb1-b6bc-7fbac120bf3a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:47.590520 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf81908-12f4-4cb1-b6bc-7fbac120bf3a None admin] RBAC: Adding query filter params (role.id=7ac88acfdd6d4edaa12064f0d47e1bf9, user.id=3067097454b7441cb89129057174b754, scope.system=all) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:29:47.590872 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf81908-12f4-4cb1-b6bc-7fbac120bf3a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:47.592320 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf81908-12f4-4cb1-b6bc-7fbac120bf3a None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:47.605959 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 178/369] 10.222.0.15 () {56 vars in 1308 bytes} [Tue May 31 14:29:47 2022] GET /identity/v3/role_assignments?user.id=3067097454b7441cb89129057174b754&scope.system=all&role.id=7ac88acfdd6d4edaa12064f0d47e1bf9 => generated 510 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:47.606818 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf81908-12f4-4cb1-b6bc-7fbac120bf3a None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:47.637174 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9023c20d-397d-4cd2-9338-7e92f37fcadd None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:47.643033 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:47.677329 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5e7a23-3b38-4594-8249-86b940e4c7f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:47.680362 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5e7a23-3b38-4594-8249-86b940e4c7f5 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:47.680362 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5e7a23-3b38-4594-8249-86b940e4c7f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:47.680362 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5e7a23-3b38-4594-8249-86b940e4c7f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:47.753718 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:47.760036 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5e7a23-3b38-4594-8249-86b940e4c7f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:47.761562 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5e7a23-3b38-4594-8249-86b940e4c7f5 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:47.793064 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf81908-12f4-4cb1-b6bc-7fbac120bf3a None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:47.878999 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 192/370] 10.222.0.15 () {58 vars in 1282 bytes} [Tue May 31 14:29:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 31 14:29:47.879897 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5e7a23-3b38-4594-8249-86b940e4c7f5 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:47.955437 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94582eb7-47c3-49bd-afb0-14bf54eed567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:47.956184 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94582eb7-47c3-49bd-afb0-14bf54eed567 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:47.956441 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94582eb7-47c3-49bd-afb0-14bf54eed567 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:47.956679 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94582eb7-47c3-49bd-afb0-14bf54eed567 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:47.990535 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:47.996769 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5e7a23-3b38-4594-8249-86b940e4c7f5 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:48.044557 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff83082-cee1-4fee-b3ae-6c26e8ea8465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:48.045365 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff83082-cee1-4fee-b3ae-6c26e8ea8465 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:48.045715 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff83082-cee1-4fee-b3ae-6c26e8ea8465 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:48.045949 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff83082-cee1-4fee-b3ae-6c26e8ea8465 None admin] PATH_INFO: `/v3/projects/a492408a00474ddd952118fdba3219ad` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:48.047455 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff83082-cee1-4fee-b3ae-6c26e8ea8465 None admin] RBAC: Authorizing `identity:get_project(project_id=a492408a00474ddd952118fdba3219ad)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:48.049077 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff83082-cee1-4fee-b3ae-6c26e8ea8465 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:48.052663 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 193/371] 10.222.0.15 () {56 vars in 1186 bytes} [Tue May 31 14:29:47 2022] GET /identity/v3/projects/a492408a00474ddd952118fdba3219ad => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:48.053261 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff83082-cee1-4fee-b3ae-6c26e8ea8465 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:48.075803 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94582eb7-47c3-49bd-afb0-14bf54eed567 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:48.077436 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94582eb7-47c3-49bd-afb0-14bf54eed567 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:48.103023 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:48.181652 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff83082-cee1-4fee-b3ae-6c26e8ea8465 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:48.195578 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 179/372] 10.222.0.15 () {58 vars in 1282 bytes} [Tue May 31 14:29:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 589 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 31 14:29:48.196488 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94582eb7-47c3-49bd-afb0-14bf54eed567 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:48.236008 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454d1901-6fef-4f72-881d-bccfbbf9773b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:48.236923 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d1901-6fef-4f72-881d-bccfbbf9773b None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:48.237206 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d1901-6fef-4f72-881d-bccfbbf9773b None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:48.237492 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d1901-6fef-4f72-881d-bccfbbf9773b None admin] PATH_INFO: `/v3/projects/b38704b3ca584f7ab2bbb66117ff153b` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:48.238801 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454d1901-6fef-4f72-881d-bccfbbf9773b None admin] RBAC: Authorizing `identity:get_project(project_id=b38704b3ca584f7ab2bbb66117ff153b)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:48.240366 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454d1901-6fef-4f72-881d-bccfbbf9773b None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:48.242425 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 194/373] 10.222.0.15 () {56 vars in 1186 bytes} [Tue May 31 14:29:48 2022] GET /identity/v3/projects/b38704b3ca584f7ab2bbb66117ff153b => generated 344 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:48.244328 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454d1901-6fef-4f72-881d-bccfbbf9773b None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:48.282463 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:48.342543 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94582eb7-47c3-49bd-afb0-14bf54eed567 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:48.364439 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:48.364949 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454d1901-6fef-4f72-881d-bccfbbf9773b None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:48.386769 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46abaf8e-2a70-4545-91b9-12197470344c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:48.387759 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46abaf8e-2a70-4545-91b9-12197470344c None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:48.388122 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46abaf8e-2a70-4545-91b9-12197470344c None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:48.388470 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46abaf8e-2a70-4545-91b9-12197470344c None admin] PATH_INFO: `/v3/groups/5f67a89fa42d4683a086676ac79552b7` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:48.389907 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46abaf8e-2a70-4545-91b9-12197470344c None admin] RBAC: Authorizing `identity:get_group(group_id=5f67a89fa42d4683a086676ac79552b7)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:48.391613 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46abaf8e-2a70-4545-91b9-12197470344c None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:48.398481 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 180/374] 10.222.0.15 () {56 vars in 1180 bytes} [Tue May 31 14:29:48 2022] GET /identity/v3/groups/5f67a89fa42d4683a086676ac79552b7 => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:48.399421 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46abaf8e-2a70-4545-91b9-12197470344c None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:48.414732 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f5e7ca-b672-44b2-975b-82c29d08ab0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:48.415602 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f5e7ca-b672-44b2-975b-82c29d08ab0e None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:48.415887 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f5e7ca-b672-44b2-975b-82c29d08ab0e None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:48.416157 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f5e7ca-b672-44b2-975b-82c29d08ab0e None admin] PATH_INFO: `/v3/projects/a492408a00474ddd952118fdba3219ad` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:48.417607 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f5e7ca-b672-44b2-975b-82c29d08ab0e None admin] RBAC: Authorizing `identity:get_project(project_id=a492408a00474ddd952118fdba3219ad)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:48.421057 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f5e7ca-b672-44b2-975b-82c29d08ab0e None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:48.421057 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 195/375] 10.222.0.15 () {56 vars in 1186 bytes} [Tue May 31 14:29:48 2022] GET /identity/v3/projects/a492408a00474ddd952118fdba3219ad => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:48.421933 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c153b7cf-ad03-47f4-a3e7-6180dd903686 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:48.422216 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c153b7cf-ad03-47f4-a3e7-6180dd903686 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:48.422498 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c153b7cf-ad03-47f4-a3e7-6180dd903686 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:48.423854 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 196/376] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:29:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:29:48.424405 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c153b7cf-ad03-47f4-a3e7-6180dd903686 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:48.534276 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46abaf8e-2a70-4545-91b9-12197470344c None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:48.568070 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c153b7cf-ad03-47f4-a3e7-6180dd903686 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:48.569781 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:48.577401 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a826b03-36c8-428a-b51f-8d9247843048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:48.578271 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a826b03-36c8-428a-b51f-8d9247843048 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:48.592546 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a826b03-36c8-428a-b51f-8d9247843048 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:48.592546 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a826b03-36c8-428a-b51f-8d9247843048 None admin] PATH_INFO: `/v3/groups/44b5426da0bb42cca22e5b1d23b3f4e6` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:48.592546 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a826b03-36c8-428a-b51f-8d9247843048 None admin] RBAC: Authorizing `identity:get_group(group_id=44b5426da0bb42cca22e5b1d23b3f4e6)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:48.592546 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a826b03-36c8-428a-b51f-8d9247843048 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:48.592546 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 181/377] 10.222.0.15 () {56 vars in 1180 bytes} [Tue May 31 14:29:48 2022] GET /identity/v3/groups/44b5426da0bb42cca22e5b1d23b3f4e6 => generated 229 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:48.592546 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e17216-fde5-4917-9262-5363319f6918 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:48.593046 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e17216-fde5-4917-9262-5363319f6918 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:48.593046 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e17216-fde5-4917-9262-5363319f6918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:48.608849 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc25c542-94f1-4fce-91d3-505f7a28fb8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:48.609641 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc25c542-94f1-4fce-91d3-505f7a28fb8b None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:48.609975 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc25c542-94f1-4fce-91d3-505f7a28fb8b None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:48.610738 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc25c542-94f1-4fce-91d3-505f7a28fb8b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:48.611217 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-c0e17216-fde5-4917-9262-5363319f6918 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:29:48.611977 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc25c542-94f1-4fce-91d3-505f7a28fb8b None admin] RBAC: Adding query filter params (group.id=5f67a89fa42d4683a086676ac79552b7, role.id=317f725e26bf43648d8235bb1f7c4cb3, scope.project.id=a492408a00474ddd952118fdba3219ad) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:29:48.612459 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-c0e17216-fde5-4917-9262-5363319f6918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:29:48.614377 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc25c542-94f1-4fce-91d3-505f7a28fb8b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:48.615940 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc25c542-94f1-4fce-91d3-505f7a28fb8b None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:48.623418 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 197/378] 10.222.0.15 () {56 vars in 1376 bytes} [Tue May 31 14:29:48 2022] GET /identity/v3/role_assignments?group.id=5f67a89fa42d4683a086676ac79552b7&scope.project.id=a492408a00474ddd952118fdba3219ad&role.id=317f725e26bf43648d8235bb1f7c4cb3 => generated 260 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:48.624545 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc25c542-94f1-4fce-91d3-505f7a28fb8b None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:48.692619 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:48.733475 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 182/379] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:29:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 14:29:48.738932 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e17216-fde5-4917-9262-5363319f6918 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:48.783274 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc25c542-94f1-4fce-91d3-505f7a28fb8b None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:48.838910 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10726511-5269-4c0c-9a2a-766e8dc9e0f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:48.840343 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10726511-5269-4c0c-9a2a-766e8dc9e0f9 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:48.840643 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10726511-5269-4c0c-9a2a-766e8dc9e0f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:48.840922 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10726511-5269-4c0c-9a2a-766e8dc9e0f9 None admin] PATH_INFO: `/v3/groups/5f67a89fa42d4683a086676ac79552b7` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:48.842457 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10726511-5269-4c0c-9a2a-766e8dc9e0f9 None admin] RBAC: Authorizing `identity:get_group(group_id=5f67a89fa42d4683a086676ac79552b7)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:48.844304 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10726511-5269-4c0c-9a2a-766e8dc9e0f9 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:48.847414 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 198/380] 10.222.0.15 () {56 vars in 1180 bytes} [Tue May 31 14:29:48 2022] GET /identity/v3/groups/5f67a89fa42d4683a086676ac79552b7 => generated 226 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:48.848229 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10726511-5269-4c0c-9a2a-766e8dc9e0f9 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:48.882454 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e17216-fde5-4917-9262-5363319f6918 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:48.897360 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:48.922775 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c964b5-dff3-4cef-afc3-4e4018fb84e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:48.923641 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c964b5-dff3-4cef-afc3-4e4018fb84e4 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:48.923927 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c964b5-dff3-4cef-afc3-4e4018fb84e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:48.924206 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c964b5-dff3-4cef-afc3-4e4018fb84e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:48.925033 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c964b5-dff3-4cef-afc3-4e4018fb84e4 None admin] RBAC: Adding query filter params (group.id=44b5426da0bb42cca22e5b1d23b3f4e6, role.id=76c53e2c353644f885028a0226c06146, scope.project.id=b38704b3ca584f7ab2bbb66117ff153b) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:29:48.925341 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c964b5-dff3-4cef-afc3-4e4018fb84e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:48.928880 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c964b5-dff3-4cef-afc3-4e4018fb84e4 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:48.935077 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 183/381] 10.222.0.15 () {56 vars in 1376 bytes} [Tue May 31 14:29:48 2022] GET /identity/v3/role_assignments?group.id=44b5426da0bb42cca22e5b1d23b3f4e6&scope.project.id=b38704b3ca584f7ab2bbb66117ff153b&role.id=76c53e2c353644f885028a0226c06146 => generated 260 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:48.935713 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c964b5-dff3-4cef-afc3-4e4018fb84e4 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:48.988457 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10726511-5269-4c0c-9a2a-766e8dc9e0f9 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:49.036310 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca11ba3b-8701-475f-a3c2-3c8d99cd8ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:49.037210 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca11ba3b-8701-475f-a3c2-3c8d99cd8ce9 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:49.037497 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca11ba3b-8701-475f-a3c2-3c8d99cd8ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:49.037773 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca11ba3b-8701-475f-a3c2-3c8d99cd8ce9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:49.062961 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:49.070732 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca11ba3b-8701-475f-a3c2-3c8d99cd8ce9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 14:29:49.079234 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-ca11ba3b-8701-475f-a3c2-3c8d99cd8ce9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 31 14:29:49.079234 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:29:49.079234 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:29:49.079234 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:29:49.079234 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:29:49.079234 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:29:49.079234 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:29:49.079234 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:29:49.079234 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:29:49.079234 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:29:49.079234 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:29:49.079234 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:29:49.079234 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 14:29:49.079234 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 14:29:49.079234 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 14:29:49.079234 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 14:29:49.080628 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 14:29:49.080628 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 14:29:49.080628 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 14:29:49.080628 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 14:29:49.080628 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:29:49.080628 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:29:49.080628 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:29:49.080628 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:29:49.080628 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:29:49.080628 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:29:49.080628 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:29:49.080628 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:29:49.080628 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:29:49.080628 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:29:49.080628 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:29:49.080628 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:29:49.081640 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:29:49.081640 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:29:49.081640 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:29:49.081640 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:29:49.081640 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 14:29:49.081640 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 14:29:49.081640 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 14:29:49.081640 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 14:29:49.081640 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 14:29:49.081640 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 14:29:49.081640 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 31 14:29:49.081640 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:29:49.082908 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 199/382] 10.222.0.15 () {56 vars in 1099 bytes} [Tue May 31 14:29:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:29:49.084505 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c22e862-2952-4fea-a8c0-c3b205fe29b8 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:49.084855 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c22e862-2952-4fea-a8c0-c3b205fe29b8 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:49.085711 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c22e862-2952-4fea-a8c0-c3b205fe29b8 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:49.087360 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 200/383] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:29:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:29:49.092280 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c22e862-2952-4fea-a8c0-c3b205fe29b8 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:49.141614 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c964b5-dff3-4cef-afc3-4e4018fb84e4 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:49.191000 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1da6d7-63aa-4b99-886f-fa23859e039e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:49.191986 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1da6d7-63aa-4b99-886f-fa23859e039e None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:49.192501 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1da6d7-63aa-4b99-886f-fa23859e039e None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:49.192927 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1da6d7-63aa-4b99-886f-fa23859e039e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:49.195146 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1da6d7-63aa-4b99-886f-fa23859e039e None admin] RBAC: Adding query filter params (group.id=5f67a89fa42d4683a086676ac79552b7, role.id=86e29729720b4d53b2a375a337765a2d, scope.project.id=a492408a00474ddd952118fdba3219ad) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:29:49.195640 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1da6d7-63aa-4b99-886f-fa23859e039e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:49.197662 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1da6d7-63aa-4b99-886f-fa23859e039e None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:49.206919 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 184/384] 10.222.0.15 () {56 vars in 1376 bytes} [Tue May 31 14:29:48 2022] GET /identity/v3/role_assignments?group.id=5f67a89fa42d4683a086676ac79552b7&scope.project.id=a492408a00474ddd952118fdba3219ad&role.id=86e29729720b4d53b2a375a337765a2d => generated 260 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:49.209015 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa41cf-8cfd-4cd9-903d-3d3984c79d07 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:49.209451 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa41cf-8cfd-4cd9-903d-3d3984c79d07 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:49.209873 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa41cf-8cfd-4cd9-903d-3d3984c79d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:49.219524 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:49.228651 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c22e862-2952-4fea-a8c0-c3b205fe29b8 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:49.235531 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-55aa41cf-8cfd-4cd9-903d-3d3984c79d07 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:29:49.236122 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-55aa41cf-8cfd-4cd9-903d-3d3984c79d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:29:49.291713 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e84c699-f459-4352-8c32-91c493105683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:49.292676 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e84c699-f459-4352-8c32-91c493105683 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:49.293104 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e84c699-f459-4352-8c32-91c493105683 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:49.293534 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e84c699-f459-4352-8c32-91c493105683 None admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:49.294435 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e84c699-f459-4352-8c32-91c493105683 None admin] RBAC: Adding query filter params (name=member) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:29:49.298018 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e84c699-f459-4352-8c32-91c493105683 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:49.298879 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e84c699-f459-4352-8c32-91c493105683 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:49.314537 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 201/385] 10.222.0.15 () {56 vars in 1101 bytes} [Tue May 31 14:29:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:49.323645 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e84c699-f459-4352-8c32-91c493105683 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:49.329554 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 185/386] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:29:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 14:29:49.375523 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aa41cf-8cfd-4cd9-903d-3d3984c79d07 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:49.450926 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:49.506260 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e84c699-f459-4352-8c32-91c493105683 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:49.540500 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aa41cf-8cfd-4cd9-903d-3d3984c79d07 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:49.556240 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d434faa-ab38-4326-8e5c-bf8983113d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:49.557124 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d434faa-ab38-4326-8e5c-bf8983113d6e None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:49.557406 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d434faa-ab38-4326-8e5c-bf8983113d6e None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:49.557687 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d434faa-ab38-4326-8e5c-bf8983113d6e None admin] PATH_INFO: `/v3/groups/5f67a89fa42d4683a086676ac79552b7` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:49.563318 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d434faa-ab38-4326-8e5c-bf8983113d6e None admin] RBAC: Authorizing `identity:get_group(group_id=5f67a89fa42d4683a086676ac79552b7)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:49.564788 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d434faa-ab38-4326-8e5c-bf8983113d6e None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:49.566949 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 202/387] 10.222.0.15 () {56 vars in 1180 bytes} [Tue May 31 14:29:49 2022] GET /identity/v3/groups/5f67a89fa42d4683a086676ac79552b7 => generated 226 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:49.575642 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d434faa-ab38-4326-8e5c-bf8983113d6e None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:49.603036 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e9cc51-28e1-4685-b971-8bb9fb601986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:49.603861 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e9cc51-28e1-4685-b971-8bb9fb601986 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:49.604147 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e9cc51-28e1-4685-b971-8bb9fb601986 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:49.604423 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e9cc51-28e1-4685-b971-8bb9fb601986 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:49.626176 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e9cc51-28e1-4685-b971-8bb9fb601986 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 14:29:49.626897 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:49.639975 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-58e9cc51-28e1-4685-b971-8bb9fb601986 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 31 14:29:49.639975 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:29:49.639975 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:29:49.639975 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:29:49.639975 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:29:49.639975 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:29:49.639975 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:29:49.639975 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:29:49.639975 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:29:49.639975 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:29:49.639975 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:29:49.639975 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:29:49.639975 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 14:29:49.639975 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 14:29:49.639975 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 14:29:49.639975 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 14:29:49.643689 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 14:29:49.643689 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 14:29:49.643689 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 14:29:49.643689 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 14:29:49.643689 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:29:49.643689 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:29:49.643689 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:29:49.643689 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:29:49.643689 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:29:49.643689 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:29:49.643689 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:29:49.643689 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:29:49.643689 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:29:49.643689 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:29:49.643689 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:29:49.643689 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:29:49.644514 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:29:49.644514 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:29:49.644514 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:29:49.644514 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:29:49.644514 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 14:29:49.644514 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 14:29:49.644514 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 14:29:49.644514 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 14:29:49.644514 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 14:29:49.644514 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 14:29:49.644514 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 31 14:29:49.644514 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:29:49.645120 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 186/388] 10.222.0.15 () {56 vars in 1114 bytes} [Tue May 31 14:29:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:29:49.650970 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e9cc51-28e1-4685-b971-8bb9fb601986 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:49.778826 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d434faa-ab38-4326-8e5c-bf8983113d6e None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:49.801208 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:49.813102 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e9cc51-28e1-4685-b971-8bb9fb601986 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:49.846718 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a621dc-6caa-4869-9cdb-9fd9300d0981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:49.850382 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a621dc-6caa-4869-9cdb-9fd9300d0981 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:49.850734 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a621dc-6caa-4869-9cdb-9fd9300d0981 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:49.851023 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a621dc-6caa-4869-9cdb-9fd9300d0981 None admin] PATH_INFO: `/v3/projects/6a0fafbf41854f8ab937e416e30b1892` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:49.852296 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a621dc-6caa-4869-9cdb-9fd9300d0981 None admin] RBAC: Authorizing `identity:get_project(project_id=6a0fafbf41854f8ab937e416e30b1892)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:49.854001 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a621dc-6caa-4869-9cdb-9fd9300d0981 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:49.855733 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 203/389] 10.222.0.15 () {56 vars in 1186 bytes} [Tue May 31 14:29:49 2022] GET /identity/v3/projects/6a0fafbf41854f8ab937e416e30b1892 => generated 298 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:49.862440 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a621dc-6caa-4869-9cdb-9fd9300d0981 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:49.883197 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37717042-238f-4594-bca4-82ab549ab9db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:49.883789 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37717042-238f-4594-bca4-82ab549ab9db None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:49.884075 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37717042-238f-4594-bca4-82ab549ab9db None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:49.884353 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37717042-238f-4594-bca4-82ab549ab9db None admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:49.885111 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37717042-238f-4594-bca4-82ab549ab9db None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:29:49.885417 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37717042-238f-4594-bca4-82ab549ab9db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:49.886819 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37717042-238f-4594-bca4-82ab549ab9db None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:49.908443 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 187/390] 10.222.0.15 () {56 vars in 1111 bytes} [Tue May 31 14:29:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:49.915137 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37717042-238f-4594-bca4-82ab549ab9db None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:50.050941 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:50.067494 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a621dc-6caa-4869-9cdb-9fd9300d0981 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:50.107605 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37717042-238f-4594-bca4-82ab549ab9db None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:50.126920 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5865fea9-1c3c-4cab-adeb-6006c9acf729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:50.127839 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5865fea9-1c3c-4cab-adeb-6006c9acf729 None admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:50.128124 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5865fea9-1c3c-4cab-adeb-6006c9acf729 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:50.128403 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5865fea9-1c3c-4cab-adeb-6006c9acf729 None admin] PATH_INFO: `/v3/projects/6a0fafbf41854f8ab937e416e30b1892/groups/5f67a89fa42d4683a086676ac79552b7/roles/317f725e26bf43648d8235bb1f7c4cb3` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:50.130411 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5865fea9-1c3c-4cab-adeb-6006c9acf729 None admin] RBAC: Authorizing `identity:create_grant(project_id=6a0fafbf41854f8ab937e416e30b1892, group_id=5f67a89fa42d4683a086676ac79552b7, role_id=317f725e26bf43648d8235bb1f7c4cb3)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:50.132404 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5865fea9-1c3c-4cab-adeb-6006c9acf729 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:50.156303 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07fc12b-6d6f-49ca-be70-fd9571af0c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:50.156303 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07fc12b-6d6f-49ca-be70-fd9571af0c05 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:50.156303 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07fc12b-6d6f-49ca-be70-fd9571af0c05 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:50.156303 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07fc12b-6d6f-49ca-be70-fd9571af0c05 None admin] PATH_INFO: `/v3/groups/5f67a89fa42d4683a086676ac79552b7` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:50.157484 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07fc12b-6d6f-49ca-be70-fd9571af0c05 None admin] RBAC: Authorizing `identity:get_group(group_id=5f67a89fa42d4683a086676ac79552b7)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:50.159504 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07fc12b-6d6f-49ca-be70-fd9571af0c05 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:50.161724 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 188/391] 10.222.0.15 () {56 vars in 1180 bytes} [Tue May 31 14:29:49 2022] GET /identity/v3/groups/5f67a89fa42d4683a086676ac79552b7 => generated 226 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 14:29:50.167529 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07fc12b-6d6f-49ca-be70-fd9571af0c05 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:50.196541 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:50.222739 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 204/392] 10.222.0.15 () {58 vars in 1442 bytes} [Tue May 31 14:29:49 2022] PUT /identity/v3/projects/6a0fafbf41854f8ab937e416e30b1892/groups/5f67a89fa42d4683a086676ac79552b7/roles/317f725e26bf43648d8235bb1f7c4cb3 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 14:29:50.285869 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07fc12b-6d6f-49ca-be70-fd9571af0c05 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:50.337560 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aeab27-82f7-4292-927b-4b3925d97400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:50.338462 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aeab27-82f7-4292-927b-4b3925d97400 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:50.338771 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aeab27-82f7-4292-927b-4b3925d97400 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:50.339049 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aeab27-82f7-4292-927b-4b3925d97400 None admin] PATH_INFO: `/v3/projects/6a0fafbf41854f8ab937e416e30b1892` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:50.340314 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aeab27-82f7-4292-927b-4b3925d97400 None admin] RBAC: Authorizing `identity:get_project(project_id=6a0fafbf41854f8ab937e416e30b1892)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:50.341803 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aeab27-82f7-4292-927b-4b3925d97400 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:50.343627 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 189/393] 10.222.0.15 () {56 vars in 1186 bytes} [Tue May 31 14:29:50 2022] GET /identity/v3/projects/6a0fafbf41854f8ab937e416e30b1892 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 14:29:50.349626 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5865fea9-1c3c-4cab-adeb-6006c9acf729 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:50.479590 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5865fea9-1c3c-4cab-adeb-6006c9acf729 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:50.522171 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36f37d4-0060-419b-a3c7-6a3a3bb42cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:50.523631 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f37d4-0060-419b-a3c7-6a3a3bb42cdd None admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:50.523917 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f37d4-0060-419b-a3c7-6a3a3bb42cdd None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:50.524191 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f37d4-0060-419b-a3c7-6a3a3bb42cdd None admin] PATH_INFO: `/v3/projects/6a0fafbf41854f8ab937e416e30b1892/groups/5f67a89fa42d4683a086676ac79552b7/roles/86e29729720b4d53b2a375a337765a2d` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:50.531518 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36f37d4-0060-419b-a3c7-6a3a3bb42cdd None admin] RBAC: Authorizing `identity:create_grant(project_id=6a0fafbf41854f8ab937e416e30b1892, group_id=5f67a89fa42d4683a086676ac79552b7, role_id=86e29729720b4d53b2a375a337765a2d)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:50.533146 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36f37d4-0060-419b-a3c7-6a3a3bb42cdd None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:50.609662 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 205/394] 10.222.0.15 () {58 vars in 1442 bytes} [Tue May 31 14:29:50 2022] PUT /identity/v3/projects/6a0fafbf41854f8ab937e416e30b1892/groups/5f67a89fa42d4683a086676ac79552b7/roles/86e29729720b4d53b2a375a337765a2d => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:29:51.468822 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ac7e70-e3a9-49a1-a5c3-5d53262c6a9d None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:51.469331 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ac7e70-e3a9-49a1-a5c3-5d53262c6a9d None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:51.469405 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ac7e70-e3a9-49a1-a5c3-5d53262c6a9d None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:51.470958 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 190/395] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:29:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:29:51.478519 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d25c89f-b315-49c1-b090-385f85645f63 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:51.479060 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d25c89f-b315-49c1-b090-385f85645f63 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:51.479137 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d25c89f-b315-49c1-b090-385f85645f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:51.497605 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-0d25c89f-b315-49c1-b090-385f85645f63 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:29:51.498821 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-0d25c89f-b315-49c1-b090-385f85645f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:29:51.506704 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:51.576364 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 206/396] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:29:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 31 14:29:51.615552 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ac7e70-e3a9-49a1-a5c3-5d53262c6a9d None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:51.733692 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:51.741063 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ac7e70-e3a9-49a1-a5c3-5d53262c6a9d None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:51.785536 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aa84a8-3e7e-4604-9070-85b0a08b35e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:51.786345 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa84a8-3e7e-4604-9070-85b0a08b35e0 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:51.786652 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa84a8-3e7e-4604-9070-85b0a08b35e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:51.786932 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa84a8-3e7e-4604-9070-85b0a08b35e0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:51.799764 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9aa84a8-3e7e-4604-9070-85b0a08b35e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 14:29:51.807616 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-d9aa84a8-3e7e-4604-9070-85b0a08b35e0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 31 14:29:51.807616 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:29:51.807616 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:29:51.807616 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:29:51.807616 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:29:51.807616 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:29:51.807616 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:29:51.807616 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:29:51.807616 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:29:51.807616 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:29:51.807616 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:29:51.807616 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:29:51.807616 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 14:29:51.807616 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 14:29:51.807616 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 14:29:51.807616 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 14:29:51.808509 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 14:29:51.808509 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 14:29:51.808509 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 14:29:51.808509 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 14:29:51.808509 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:29:51.808509 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:29:51.808509 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:29:51.808509 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:29:51.808509 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:29:51.808509 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:29:51.808509 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:29:51.808509 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:29:51.808509 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:29:51.808509 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:29:51.808509 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:29:51.808509 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:29:51.809352 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:29:51.809352 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:29:51.809352 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:29:51.809352 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:29:51.809352 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 14:29:51.809352 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 14:29:51.809352 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 14:29:51.809352 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 14:29:51.809352 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 14:29:51.809352 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 14:29:51.809352 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 31 14:29:51.809352 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:29:51.809352 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 191/397] 10.222.0.15 () {56 vars in 1099 bytes} [Tue May 31 14:29:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:29:51.814809 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d25c89f-b315-49c1-b090-385f85645f63 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:51.942384 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d25c89f-b315-49c1-b090-385f85645f63 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:51.978362 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c8e7db-de3e-47e6-ab22-91f823ddbb4d None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:51.978900 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c8e7db-de3e-47e6-ab22-91f823ddbb4d None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:51.979403 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c8e7db-de3e-47e6-ab22-91f823ddbb4d None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:51.981211 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 192/398] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:29:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:29:51.985967 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c189ce-4028-4a29-8c9e-1f5d61fb67e2 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:51.986344 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c189ce-4028-4a29-8c9e-1f5d61fb67e2 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:51.986545 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c189ce-4028-4a29-8c9e-1f5d61fb67e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:51.989220 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0958fbb-9a4d-40bf-aee4-70812ee54920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:51.989897 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0958fbb-9a4d-40bf-aee4-70812ee54920 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:51.990189 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0958fbb-9a4d-40bf-aee4-70812ee54920 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:51.990466 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0958fbb-9a4d-40bf-aee4-70812ee54920 None admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:51.991242 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0958fbb-9a4d-40bf-aee4-70812ee54920 None admin] RBAC: Adding query filter params (name=member) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:29:51.991579 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0958fbb-9a4d-40bf-aee4-70812ee54920 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:51.992977 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0958fbb-9a4d-40bf-aee4-70812ee54920 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:52.002072 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 207/399] 10.222.0.15 () {56 vars in 1101 bytes} [Tue May 31 14:29:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:52.010050 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0958fbb-9a4d-40bf-aee4-70812ee54920 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:52.013759 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:52.025301 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-d7c189ce-4028-4a29-8c9e-1f5d61fb67e2 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:29:52.026813 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-d7c189ce-4028-4a29-8c9e-1f5d61fb67e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:29:52.120806 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0958fbb-9a4d-40bf-aee4-70812ee54920 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:52.123987 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 193/400] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:29:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 14:29:52.125603 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32795b0-9e70-44ca-9b94-2057649a3d44 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:52.126057 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32795b0-9e70-44ca-9b94-2057649a3d44 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:52.126516 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32795b0-9e70-44ca-9b94-2057649a3d44 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:52.128198 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 194/401] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:29:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:29:52.134142 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a0255d-a578-4580-b9aa-772b90680006 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:52.134658 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a0255d-a578-4580-b9aa-772b90680006 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:52.135114 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a0255d-a578-4580-b9aa-772b90680006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:52.152575 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-b2a0255d-a578-4580-b9aa-772b90680006 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:29:52.154192 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-b2a0255d-a578-4580-b9aa-772b90680006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:29:52.183081 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0313a360-bdcb-4e0c-8926-7baacf532717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:52.184184 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0313a360-bdcb-4e0c-8926-7baacf532717 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:52.184529 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0313a360-bdcb-4e0c-8926-7baacf532717 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:52.184999 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0313a360-bdcb-4e0c-8926-7baacf532717 None admin] PATH_INFO: `/v3/groups/5f67a89fa42d4683a086676ac79552b7` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:52.186237 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0313a360-bdcb-4e0c-8926-7baacf532717 None admin] RBAC: Authorizing `identity:get_group(group_id=5f67a89fa42d4683a086676ac79552b7)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:52.187961 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0313a360-bdcb-4e0c-8926-7baacf532717 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:52.190068 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 208/402] 10.222.0.15 () {56 vars in 1180 bytes} [Tue May 31 14:29:52 2022] GET /identity/v3/groups/5f67a89fa42d4683a086676ac79552b7 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:52.195223 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0313a360-bdcb-4e0c-8926-7baacf532717 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:52.246572 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 195/403] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:29:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 31 14:29:52.246572 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a0255d-a578-4580-b9aa-772b90680006 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:52.259184 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:52.293655 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:52.325097 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0313a360-bdcb-4e0c-8926-7baacf532717 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:52.356331 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a0255d-a578-4580-b9aa-772b90680006 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:52.363083 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376181d1-0b22-4780-86e0-9db4ccba9dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:52.365347 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376181d1-0b22-4780-86e0-9db4ccba9dec None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:52.365347 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376181d1-0b22-4780-86e0-9db4ccba9dec None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:52.365347 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376181d1-0b22-4780-86e0-9db4ccba9dec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:52.375844 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376181d1-0b22-4780-86e0-9db4ccba9dec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 14:29:52.384670 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-376181d1-0b22-4780-86e0-9db4ccba9dec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 31 14:29:52.384670 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:29:52.384670 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:29:52.384670 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:29:52.384670 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:29:52.384670 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:29:52.384670 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:29:52.384670 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:29:52.384670 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:29:52.384670 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:29:52.384670 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:29:52.384670 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:29:52.384670 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 14:29:52.384670 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 14:29:52.384670 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 14:29:52.384670 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 14:29:52.385533 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 14:29:52.385533 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 14:29:52.385533 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 14:29:52.385533 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 14:29:52.385533 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:29:52.385533 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:29:52.385533 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:29:52.385533 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:29:52.385533 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:29:52.385533 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:29:52.385533 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:29:52.385533 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:29:52.385533 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:29:52.385533 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:29:52.385533 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:29:52.385533 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:29:52.386367 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:29:52.386367 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:29:52.386367 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:29:52.386367 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:29:52.386367 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 14:29:52.386367 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 14:29:52.386367 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 14:29:52.386367 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 14:29:52.386367 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 14:29:52.386367 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 14:29:52.386367 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 31 14:29:52.386367 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:29:52.388820 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 209/404] 10.222.0.15 () {56 vars in 1096 bytes} [Tue May 31 14:29:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:29:52.389795 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376181d1-0b22-4780-86e0-9db4ccba9dec None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:52.398812 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517af432-486a-4b6b-839d-9439b4066a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:52.399683 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517af432-486a-4b6b-839d-9439b4066a7b None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:52.399966 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517af432-486a-4b6b-839d-9439b4066a7b None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:52.400239 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517af432-486a-4b6b-839d-9439b4066a7b None admin] PATH_INFO: `/v3/projects/a492408a00474ddd952118fdba3219ad` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:52.401698 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517af432-486a-4b6b-839d-9439b4066a7b None admin] RBAC: Authorizing `identity:get_project(project_id=a492408a00474ddd952118fdba3219ad)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:52.403140 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517af432-486a-4b6b-839d-9439b4066a7b None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:52.409828 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 196/405] 10.222.0.15 () {56 vars in 1186 bytes} [Tue May 31 14:29:52 2022] GET /identity/v3/projects/a492408a00474ddd952118fdba3219ad => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:52.409828 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517af432-486a-4b6b-839d-9439b4066a7b None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:52.500670 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:52.510245 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376181d1-0b22-4780-86e0-9db4ccba9dec None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:52.521927 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517af432-486a-4b6b-839d-9439b4066a7b None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:52.540892 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:52.546737 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a977349-8188-43fb-8f48-96cd8efcf752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:52.547727 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a977349-8188-43fb-8f48-96cd8efcf752 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:52.548206 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a977349-8188-43fb-8f48-96cd8efcf752 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:52.548569 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a977349-8188-43fb-8f48-96cd8efcf752 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:52.560632 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc5c439-d58b-4960-a9bc-9a0a84fe61a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:52.565186 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a977349-8188-43fb-8f48-96cd8efcf752 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 14:29:52.565299 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5c439-d58b-4960-a9bc-9a0a84fe61a3 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:52.565299 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5c439-d58b-4960-a9bc-9a0a84fe61a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:52.565299 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5c439-d58b-4960-a9bc-9a0a84fe61a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:52.565299 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc5c439-d58b-4960-a9bc-9a0a84fe61a3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:29:52.565299 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc5c439-d58b-4960-a9bc-9a0a84fe61a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:52.565299 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc5c439-d58b-4960-a9bc-9a0a84fe61a3 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:52.571190 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-7a977349-8188-43fb-8f48-96cd8efcf752 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 31 14:29:52.571190 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:29:52.571190 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:29:52.571190 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:29:52.571190 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:29:52.571190 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:29:52.571190 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:29:52.571190 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:29:52.571190 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:29:52.571190 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:29:52.571190 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:29:52.571190 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:29:52.571190 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 14:29:52.571190 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 14:29:52.571190 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 14:29:52.571190 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 14:29:52.572309 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 14:29:52.572309 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 14:29:52.572309 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 14:29:52.572309 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 14:29:52.572309 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:29:52.572309 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:29:52.572309 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:29:52.572309 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:29:52.572309 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:29:52.572309 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:29:52.572309 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:29:52.572309 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:29:52.572309 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:29:52.572309 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:29:52.572309 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:29:52.572309 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:29:52.573310 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:29:52.573310 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:29:52.573310 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:29:52.573310 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:29:52.573310 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 14:29:52.573310 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 14:29:52.573310 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 14:29:52.573310 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 14:29:52.573310 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 14:29:52.573310 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 14:29:52.573310 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 31 14:29:52.573310 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:29:52.574852 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 210/406] 10.222.0.15 () {56 vars in 1114 bytes} [Tue May 31 14:29:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:29:52.577404 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 197/407] 10.222.0.15 () {56 vars in 1099 bytes} [Tue May 31 14:29:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:52.579446 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a977349-8188-43fb-8f48-96cd8efcf752 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:52.581079 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc5c439-d58b-4960-a9bc-9a0a84fe61a3 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:52.702675 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a977349-8188-43fb-8f48-96cd8efcf752 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:52.704738 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc5c439-d58b-4960-a9bc-9a0a84fe61a3 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:52.739296 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc31ef04-8efb-446f-82ed-6bde9907f67a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:52.740158 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79595094-bc58-4954-8bb4-4b7684dff61c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:52.740330 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc31ef04-8efb-446f-82ed-6bde9907f67a None admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:52.740705 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc31ef04-8efb-446f-82ed-6bde9907f67a None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:52.741050 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc31ef04-8efb-446f-82ed-6bde9907f67a None admin] PATH_INFO: `/v3/projects/a492408a00474ddd952118fdba3219ad/groups/5f67a89fa42d4683a086676ac79552b7/roles/317f725e26bf43648d8235bb1f7c4cb3` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:52.742098 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79595094-bc58-4954-8bb4-4b7684dff61c None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:52.742579 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79595094-bc58-4954-8bb4-4b7684dff61c None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:52.743024 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79595094-bc58-4954-8bb4-4b7684dff61c None admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:52.743850 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc31ef04-8efb-446f-82ed-6bde9907f67a None admin] RBAC: Authorizing `identity:create_grant(project_id=a492408a00474ddd952118fdba3219ad, group_id=5f67a89fa42d4683a086676ac79552b7, role_id=317f725e26bf43648d8235bb1f7c4cb3)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:52.744125 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79595094-bc58-4954-8bb4-4b7684dff61c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:29:52.744597 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79595094-bc58-4954-8bb4-4b7684dff61c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:52.745501 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc31ef04-8efb-446f-82ed-6bde9907f67a None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:52.746311 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79595094-bc58-4954-8bb4-4b7684dff61c None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:52.755869 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 198/408] 10.222.0.15 () {56 vars in 1111 bytes} [Tue May 31 14:29:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 14:29:52.757082 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79595094-bc58-4954-8bb4-4b7684dff61c None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:52.770789 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:52.858617 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 211/409] 10.222.0.15 () {58 vars in 1442 bytes} [Tue May 31 14:29:52 2022] PUT /identity/v3/projects/a492408a00474ddd952118fdba3219ad/groups/5f67a89fa42d4683a086676ac79552b7/roles/317f725e26bf43648d8235bb1f7c4cb3 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:29:52.860089 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc31ef04-8efb-446f-82ed-6bde9907f67a None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:52.875548 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79595094-bc58-4954-8bb4-4b7684dff61c None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:52.944665 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d1d1a9-fbd8-4dd8-a0ad-0b3b85faab1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:52.945535 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d1d1a9-fbd8-4dd8-a0ad-0b3b85faab1f None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:52.945826 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d1d1a9-fbd8-4dd8-a0ad-0b3b85faab1f None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:52.946099 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d1d1a9-fbd8-4dd8-a0ad-0b3b85faab1f None admin] PATH_INFO: `/v3/groups/44b5426da0bb42cca22e5b1d23b3f4e6` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:52.951538 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d1d1a9-fbd8-4dd8-a0ad-0b3b85faab1f None admin] RBAC: Authorizing `identity:get_group(group_id=44b5426da0bb42cca22e5b1d23b3f4e6)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:52.953100 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d1d1a9-fbd8-4dd8-a0ad-0b3b85faab1f None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:52.958445 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 199/410] 10.222.0.15 () {56 vars in 1180 bytes} [Tue May 31 14:29:52 2022] GET /identity/v3/groups/44b5426da0bb42cca22e5b1d23b3f4e6 => generated 229 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:52.962383 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d1d1a9-fbd8-4dd8-a0ad-0b3b85faab1f None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:52.983776 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:53.075217 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc31ef04-8efb-446f-82ed-6bde9907f67a None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:53.112565 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cb145a-b820-4146-beb9-2680ba0b38b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:53.113455 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb145a-b820-4146-beb9-2680ba0b38b4 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:53.113740 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb145a-b820-4146-beb9-2680ba0b38b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:53.114017 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb145a-b820-4146-beb9-2680ba0b38b4 None admin] PATH_INFO: `/v3/groups/5f67a89fa42d4683a086676ac79552b7` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:53.115265 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cb145a-b820-4146-beb9-2680ba0b38b4 None admin] RBAC: Authorizing `identity:get_group(group_id=5f67a89fa42d4683a086676ac79552b7)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:53.117293 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cb145a-b820-4146-beb9-2680ba0b38b4 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:53.119296 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 212/411] 10.222.0.15 () {56 vars in 1180 bytes} [Tue May 31 14:29:52 2022] GET /identity/v3/groups/5f67a89fa42d4683a086676ac79552b7 => generated 226 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:53.127759 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cb145a-b820-4146-beb9-2680ba0b38b4 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:53.134782 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:53.187854 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d1d1a9-fbd8-4dd8-a0ad-0b3b85faab1f None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:53.248428 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cb145a-b820-4146-beb9-2680ba0b38b4 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:53.256984 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f537c7b-efdc-459f-ad53-5359938fa98d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:53.257908 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f537c7b-efdc-459f-ad53-5359938fa98d None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:53.258194 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f537c7b-efdc-459f-ad53-5359938fa98d None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:53.258598 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f537c7b-efdc-459f-ad53-5359938fa98d None admin] PATH_INFO: `/v3/projects/b38704b3ca584f7ab2bbb66117ff153b` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:53.263473 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f537c7b-efdc-459f-ad53-5359938fa98d None admin] RBAC: Authorizing `identity:get_project(project_id=b38704b3ca584f7ab2bbb66117ff153b)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:53.264939 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f537c7b-efdc-459f-ad53-5359938fa98d None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:53.267187 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 200/412] 10.222.0.15 () {56 vars in 1186 bytes} [Tue May 31 14:29:52 2022] GET /identity/v3/projects/b38704b3ca584f7ab2bbb66117ff153b => generated 344 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:53.274971 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:53.276629 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f537c7b-efdc-459f-ad53-5359938fa98d None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:53.292265 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e29991-e1e7-4ea7-a20b-480df2841d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:53.292265 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e29991-e1e7-4ea7-a20b-480df2841d7e None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:53.294997 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e29991-e1e7-4ea7-a20b-480df2841d7e None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:53.294997 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e29991-e1e7-4ea7-a20b-480df2841d7e None admin] PATH_INFO: `/v3/projects/a492408a00474ddd952118fdba3219ad` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:53.294997 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e29991-e1e7-4ea7-a20b-480df2841d7e None admin] RBAC: Authorizing `identity:get_project(project_id=a492408a00474ddd952118fdba3219ad)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:53.295785 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e29991-e1e7-4ea7-a20b-480df2841d7e None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:53.301951 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 213/413] 10.222.0.15 () {56 vars in 1186 bytes} [Tue May 31 14:29:53 2022] GET /identity/v3/projects/a492408a00474ddd952118fdba3219ad => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:53.304647 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e29991-e1e7-4ea7-a20b-480df2841d7e None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:53.430087 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f537c7b-efdc-459f-ad53-5359938fa98d None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:53.439465 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e29991-e1e7-4ea7-a20b-480df2841d7e None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:53.471385 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c6a91b-1b23-4e90-bbac-d8bc3798cb38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:53.472566 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c6a91b-1b23-4e90-bbac-d8bc3798cb38 None admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:53.472857 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c6a91b-1b23-4e90-bbac-d8bc3798cb38 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:53.473147 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c6a91b-1b23-4e90-bbac-d8bc3798cb38 None admin] PATH_INFO: `/v3/projects/b38704b3ca584f7ab2bbb66117ff153b/groups/44b5426da0bb42cca22e5b1d23b3f4e6/roles/76c53e2c353644f885028a0226c06146` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:53.476481 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c6a91b-1b23-4e90-bbac-d8bc3798cb38 None admin] RBAC: Authorizing `identity:create_grant(project_id=b38704b3ca584f7ab2bbb66117ff153b, group_id=44b5426da0bb42cca22e5b1d23b3f4e6, role_id=76c53e2c353644f885028a0226c06146)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:53.478201 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c6a91b-1b23-4e90-bbac-d8bc3798cb38 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:53.484729 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c135e3f-bca1-4a89-b484-bfdf155e89af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:53.485601 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c135e3f-bca1-4a89-b484-bfdf155e89af None admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:53.485877 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c135e3f-bca1-4a89-b484-bfdf155e89af None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:53.486146 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c135e3f-bca1-4a89-b484-bfdf155e89af None admin] PATH_INFO: `/v3/projects/a492408a00474ddd952118fdba3219ad/groups/5f67a89fa42d4683a086676ac79552b7/roles/86e29729720b4d53b2a375a337765a2d` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:53.488353 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c135e3f-bca1-4a89-b484-bfdf155e89af None admin] RBAC: Authorizing `identity:create_grant(project_id=a492408a00474ddd952118fdba3219ad, group_id=5f67a89fa42d4683a086676ac79552b7, role_id=86e29729720b4d53b2a375a337765a2d)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:53.489794 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c135e3f-bca1-4a89-b484-bfdf155e89af None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:53.548324 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 201/414] 10.222.0.15 () {58 vars in 1442 bytes} [Tue May 31 14:29:53 2022] PUT /identity/v3/projects/b38704b3ca584f7ab2bbb66117ff153b/groups/44b5426da0bb42cca22e5b1d23b3f4e6/roles/76c53e2c353644f885028a0226c06146 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:29:53.550370 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab89960c-7c70-438d-b31b-361a2639d7d1 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:53.550844 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab89960c-7c70-438d-b31b-361a2639d7d1 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:53.551131 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab89960c-7c70-438d-b31b-361a2639d7d1 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:53.552613 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 202/415] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:29:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:29:53.557545 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9e99fa-4de5-462c-bd12-cae612800a76 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:53.557836 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9e99fa-4de5-462c-bd12-cae612800a76 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:53.558179 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9e99fa-4de5-462c-bd12-cae612800a76 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:53.561140 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 203/416] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:29:53 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:29:53.561140 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d24529-ab9f-421b-b671-8b58b4a147c7 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:53.561387 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d24529-ab9f-421b-b671-8b58b4a147c7 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:53.561577 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d24529-ab9f-421b-b671-8b58b4a147c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:53.567181 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:53.578313 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 214/417] 10.222.0.15 () {58 vars in 1442 bytes} [Tue May 31 14:29:53 2022] PUT /identity/v3/projects/a492408a00474ddd952118fdba3219ad/groups/5f67a89fa42d4683a086676ac79552b7/roles/86e29729720b4d53b2a375a337765a2d => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:29:53.580519 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-08d24529-ab9f-421b-b671-8b58b4a147c7 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:29:53.581087 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c78e59c-79d6-48a9-80d1-bf70b80b43e4 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:53.581627 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c78e59c-79d6-48a9-80d1-bf70b80b43e4 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:53.581801 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-08d24529-ab9f-421b-b671-8b58b4a147c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:29:53.582339 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c78e59c-79d6-48a9-80d1-bf70b80b43e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:53.605128 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-2c78e59c-79d6-48a9-80d1-bf70b80b43e4 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:29:53.606823 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-2c78e59c-79d6-48a9-80d1-bf70b80b43e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:29:53.668568 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:53.675934 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 204/418] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:29:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 14:29:53.696273 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 215/419] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:29:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 14:29:53.709383 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d24529-ab9f-421b-b671-8b58b4a147c7 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:53.739654 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c78e59c-79d6-48a9-80d1-bf70b80b43e4 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:53.854088 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d24529-ab9f-421b-b671-8b58b4a147c7 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:53.876134 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c78e59c-79d6-48a9-80d1-bf70b80b43e4 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:53.888402 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:53.894824 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6196e1b5-9843-4d6c-878e-eb04f05abca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:53.895643 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6196e1b5-9843-4d6c-878e-eb04f05abca0 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:53.895935 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6196e1b5-9843-4d6c-878e-eb04f05abca0 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:53.896218 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6196e1b5-9843-4d6c-878e-eb04f05abca0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:53.908786 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6196e1b5-9843-4d6c-878e-eb04f05abca0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 14:29:53.917073 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-6196e1b5-9843-4d6c-878e-eb04f05abca0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 31 14:29:53.917073 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:29:53.917073 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:29:53.917073 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:29:53.917073 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:29:53.917073 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:29:53.917073 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:29:53.917073 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:29:53.917073 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:29:53.917073 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:29:53.917073 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:29:53.917073 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:29:53.917073 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 14:29:53.917073 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 14:29:53.917073 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 14:29:53.917073 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 14:29:53.917989 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 14:29:53.917989 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 14:29:53.917989 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 14:29:53.917989 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 14:29:53.917989 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:29:53.917989 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:29:53.917989 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:29:53.917989 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:29:53.917989 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:29:53.917989 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:29:53.917989 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:29:53.917989 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:29:53.917989 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:29:53.917989 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:29:53.917989 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:29:53.917989 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:29:53.923457 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:29:53.923457 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:29:53.923457 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:29:53.923457 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:29:53.923457 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 14:29:53.923457 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 14:29:53.923457 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 14:29:53.923457 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 14:29:53.923457 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 14:29:53.923457 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 14:29:53.923457 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 31 14:29:53.923457 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:29:53.923457 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 205/420] 10.222.0.15 () {56 vars in 1099 bytes} [Tue May 31 14:29:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:29:53.924817 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63877abf-1f09-43c4-9cd7-e40908d2f42e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:53.925745 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63877abf-1f09-43c4-9cd7-e40908d2f42e None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:53.926044 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63877abf-1f09-43c4-9cd7-e40908d2f42e None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:53.926322 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63877abf-1f09-43c4-9cd7-e40908d2f42e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:53.927693 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6196e1b5-9843-4d6c-878e-eb04f05abca0 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:53.942262 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63877abf-1f09-43c4-9cd7-e40908d2f42e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 14:29:53.954174 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-63877abf-1f09-43c4-9cd7-e40908d2f42e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 31 14:29:53.954174 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:29:53.954174 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:29:53.954174 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:29:53.954174 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:29:53.954174 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:29:53.954174 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:29:53.954174 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:29:53.954174 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:29:53.954174 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:29:53.954174 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:29:53.954174 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:29:53.954174 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 14:29:53.954174 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 14:29:53.954174 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 14:29:53.954174 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 14:29:53.955106 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 14:29:53.955106 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 14:29:53.955106 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 14:29:53.955106 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 14:29:53.955106 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:29:53.955106 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:29:53.955106 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:29:53.955106 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:29:53.955106 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:29:53.955106 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:29:53.955106 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:29:53.955106 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:29:53.955106 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:29:53.955106 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:29:53.955106 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:29:53.955106 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:29:53.955910 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:29:53.955910 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:29:53.955910 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:29:53.955910 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:29:53.955910 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 14:29:53.955910 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 14:29:53.955910 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 14:29:53.955910 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 14:29:53.955910 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 14:29:53.955910 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 14:29:53.955910 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 31 14:29:53.955910 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:29:53.959166 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 216/421] 10.222.0.15 () {56 vars in 1114 bytes} [Tue May 31 14:29:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 14:29:53.962900 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63877abf-1f09-43c4-9cd7-e40908d2f42e None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:54.018965 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:54.098349 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63877abf-1f09-43c4-9cd7-e40908d2f42e None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:54.104714 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6196e1b5-9843-4d6c-878e-eb04f05abca0 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:54.145578 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad4b3ae-1654-4588-a6f6-4d9e61ce2ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:54.146647 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad4b3ae-1654-4588-a6f6-4d9e61ce2ecf None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:54.147126 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad4b3ae-1654-4588-a6f6-4d9e61ce2ecf None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:54.148118 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad4b3ae-1654-4588-a6f6-4d9e61ce2ecf None admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:54.149060 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad4b3ae-1654-4588-a6f6-4d9e61ce2ecf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:29:54.149577 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad4b3ae-1654-4588-a6f6-4d9e61ce2ecf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:54.151187 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad4b3ae-1654-4588-a6f6-4d9e61ce2ecf None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:54.161193 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 217/422] 10.222.0.15 () {56 vars in 1111 bytes} [Tue May 31 14:29:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 14:29:54.167480 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad4b3ae-1654-4588-a6f6-4d9e61ce2ecf None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:54.196221 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfc61fe-e6fd-418b-b7d1-20a9e7ad743b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:54.197020 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfc61fe-e6fd-418b-b7d1-20a9e7ad743b None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:54.197229 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfc61fe-e6fd-418b-b7d1-20a9e7ad743b None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:54.197510 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfc61fe-e6fd-418b-b7d1-20a9e7ad743b None admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:54.198311 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfc61fe-e6fd-418b-b7d1-20a9e7ad743b None admin] RBAC: Adding query filter params (name=member) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:29:54.198654 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfc61fe-e6fd-418b-b7d1-20a9e7ad743b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:54.200040 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfc61fe-e6fd-418b-b7d1-20a9e7ad743b None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:54.216927 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 206/423] 10.222.0.15 () {56 vars in 1101 bytes} [Tue May 31 14:29:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:54.222659 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfc61fe-e6fd-418b-b7d1-20a9e7ad743b None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:54.317845 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:54.336007 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad4b3ae-1654-4588-a6f6-4d9e61ce2ecf None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:54.338862 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:54.371667 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfc61fe-e6fd-418b-b7d1-20a9e7ad743b None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:54.407045 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b38c349-686a-47a4-a032-e41df3c95a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:54.407691 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38c349-686a-47a4-a032-e41df3c95a8f None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:54.407980 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38c349-686a-47a4-a032-e41df3c95a8f None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:54.408270 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38c349-686a-47a4-a032-e41df3c95a8f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:54.435878 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04a2aa5-3713-4d12-99bb-d2445f865a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:54.436878 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04a2aa5-3713-4d12-99bb-d2445f865a40 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:54.437356 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04a2aa5-3713-4d12-99bb-d2445f865a40 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:54.437848 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04a2aa5-3713-4d12-99bb-d2445f865a40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:54.494614 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b38c349-686a-47a4-a032-e41df3c95a8f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:54.496668 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b38c349-686a-47a4-a032-e41df3c95a8f None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:54.514208 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04a2aa5-3713-4d12-99bb-d2445f865a40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:54.517141 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04a2aa5-3713-4d12-99bb-d2445f865a40 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:54.599553 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:54.601674 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:54.604819 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 218/424] 10.222.0.15 () {58 vars in 1282 bytes} [Tue May 31 14:29:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 31 14:29:54.610246 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b38c349-686a-47a4-a032-e41df3c95a8f None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:54.717450 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b38c349-686a-47a4-a032-e41df3c95a8f None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:54.754849 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58717e4-bdb0-418f-b4e0-5080e7825f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:54.756049 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58717e4-bdb0-418f-b4e0-5080e7825f7a None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:54.756336 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58717e4-bdb0-418f-b4e0-5080e7825f7a None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:54.756623 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58717e4-bdb0-418f-b4e0-5080e7825f7a None admin] PATH_INFO: `/v3/projects/6a0fafbf41854f8ab937e416e30b1892` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:54.757853 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58717e4-bdb0-418f-b4e0-5080e7825f7a None admin] RBAC: Authorizing `identity:get_project(project_id=6a0fafbf41854f8ab937e416e30b1892)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:54.759494 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58717e4-bdb0-418f-b4e0-5080e7825f7a None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:54.761540 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 219/425] 10.222.0.15 () {56 vars in 1186 bytes} [Tue May 31 14:29:54 2022] GET /identity/v3/projects/6a0fafbf41854f8ab937e416e30b1892 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 14:29:54.767571 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58717e4-bdb0-418f-b4e0-5080e7825f7a None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:54.773362 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 207/426] 10.222.0.15 () {58 vars in 1282 bytes} [Tue May 31 14:29:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 549 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 31 14:29:54.780180 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04a2aa5-3713-4d12-99bb-d2445f865a40 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:54.898605 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04a2aa5-3713-4d12-99bb-d2445f865a40 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:54.937736 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3488c3f-641c-4155-903d-eaec24225611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:54.939042 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3488c3f-641c-4155-903d-eaec24225611 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:54.939521 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3488c3f-641c-4155-903d-eaec24225611 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:54.939987 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3488c3f-641c-4155-903d-eaec24225611 None admin] PATH_INFO: `/v3/projects/6a0fafbf41854f8ab937e416e30b1892` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:54.941379 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3488c3f-641c-4155-903d-eaec24225611 None admin] RBAC: Authorizing `identity:get_project(project_id=6a0fafbf41854f8ab937e416e30b1892)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:54.944135 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3488c3f-641c-4155-903d-eaec24225611 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:54.947780 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:54.949734 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 208/427] 10.222.0.15 () {56 vars in 1186 bytes} [Tue May 31 14:29:54 2022] GET /identity/v3/projects/6a0fafbf41854f8ab937e416e30b1892 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:54.957633 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3488c3f-641c-4155-903d-eaec24225611 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:55.001844 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58717e4-bdb0-418f-b4e0-5080e7825f7a None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:55.002032 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:55.076796 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c640145-de05-446c-8d10-98d7f7325940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:55.078000 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c640145-de05-446c-8d10-98d7f7325940 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:55.078454 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c640145-de05-446c-8d10-98d7f7325940 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:55.078934 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c640145-de05-446c-8d10-98d7f7325940 None admin] PATH_INFO: `/v3/groups/5f67a89fa42d4683a086676ac79552b7` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:55.080404 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c640145-de05-446c-8d10-98d7f7325940 None admin] RBAC: Authorizing `identity:get_group(group_id=5f67a89fa42d4683a086676ac79552b7)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:55.082010 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c640145-de05-446c-8d10-98d7f7325940 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:55.086670 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 220/428] 10.222.0.15 () {56 vars in 1180 bytes} [Tue May 31 14:29:54 2022] GET /identity/v3/groups/5f67a89fa42d4683a086676ac79552b7 => generated 226 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:55.091527 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c640145-de05-446c-8d10-98d7f7325940 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:55.139054 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3488c3f-641c-4155-903d-eaec24225611 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:55.206486 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f963e8-db69-4fde-a3f0-9dd563f45a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:55.208392 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f963e8-db69-4fde-a3f0-9dd563f45a53 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:55.209046 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f963e8-db69-4fde-a3f0-9dd563f45a53 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:55.212534 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f963e8-db69-4fde-a3f0-9dd563f45a53 None admin] PATH_INFO: `/v3/groups/5f67a89fa42d4683a086676ac79552b7` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:55.214173 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f963e8-db69-4fde-a3f0-9dd563f45a53 None admin] RBAC: Authorizing `identity:get_group(group_id=5f67a89fa42d4683a086676ac79552b7)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:55.215853 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f963e8-db69-4fde-a3f0-9dd563f45a53 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:55.223832 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 209/429] 10.222.0.15 () {56 vars in 1180 bytes} [Tue May 31 14:29:54 2022] GET /identity/v3/groups/5f67a89fa42d4683a086676ac79552b7 => generated 226 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:55.227081 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f963e8-db69-4fde-a3f0-9dd563f45a53 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:55.287716 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c640145-de05-446c-8d10-98d7f7325940 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:55.361278 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc804a1f-78c8-4e7e-95d8-f2c8ab9199d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:55.362233 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc804a1f-78c8-4e7e-95d8-f2c8ab9199d5 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:55.362853 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc804a1f-78c8-4e7e-95d8-f2c8ab9199d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:55.363305 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc804a1f-78c8-4e7e-95d8-f2c8ab9199d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:55.364312 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc804a1f-78c8-4e7e-95d8-f2c8ab9199d5 None admin] RBAC: Adding query filter params (group.id=5f67a89fa42d4683a086676ac79552b7, role.id=86e29729720b4d53b2a375a337765a2d, scope.project.id=6a0fafbf41854f8ab937e416e30b1892) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:29:55.364795 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc804a1f-78c8-4e7e-95d8-f2c8ab9199d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:55.366428 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc804a1f-78c8-4e7e-95d8-f2c8ab9199d5 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:55.374081 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:55.381116 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 221/430] 10.222.0.15 () {56 vars in 1376 bytes} [Tue May 31 14:29:55 2022] GET /identity/v3/role_assignments?group.id=5f67a89fa42d4683a086676ac79552b7&scope.project.id=6a0fafbf41854f8ab937e416e30b1892&role.id=86e29729720b4d53b2a375a337765a2d => generated 611 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 14:29:55.389700 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:55.398674 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f963e8-db69-4fde-a3f0-9dd563f45a53 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:55.449315 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e1bde8-dd36-4a79-8fc4-fddcb922fe1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:55.449983 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e1bde8-dd36-4a79-8fc4-fddcb922fe1f None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:55.450267 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e1bde8-dd36-4a79-8fc4-fddcb922fe1f None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:55.450650 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e1bde8-dd36-4a79-8fc4-fddcb922fe1f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:55.451497 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e1bde8-dd36-4a79-8fc4-fddcb922fe1f None admin] RBAC: Adding query filter params (group.id=5f67a89fa42d4683a086676ac79552b7, role.id=317f725e26bf43648d8235bb1f7c4cb3, scope.project.id=6a0fafbf41854f8ab937e416e30b1892) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:29:55.451807 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e1bde8-dd36-4a79-8fc4-fddcb922fe1f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:55.453498 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e1bde8-dd36-4a79-8fc4-fddcb922fe1f None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:55.467969 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 210/431] 10.222.0.15 () {56 vars in 1376 bytes} [Tue May 31 14:29:55 2022] GET /identity/v3/role_assignments?group.id=5f67a89fa42d4683a086676ac79552b7&scope.project.id=6a0fafbf41854f8ab937e416e30b1892&role.id=317f725e26bf43648d8235bb1f7c4cb3 => generated 611 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 14:29:55.593320 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af5a98-104e-4342-9876-ea4d18b33e63 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:55.593949 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af5a98-104e-4342-9876-ea4d18b33e63 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:55.594430 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af5a98-104e-4342-9876-ea4d18b33e63 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:55.596081 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 222/432] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:29:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:29:55.601999 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311433eb-0f3f-4076-a210-002058e42a1e None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:55.602498 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311433eb-0f3f-4076-a210-002058e42a1e None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:55.602593 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311433eb-0f3f-4076-a210-002058e42a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:55.751153 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-311433eb-0f3f-4076-a210-002058e42a1e None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:29:55.752277 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-311433eb-0f3f-4076-a210-002058e42a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:29:55.829203 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 211/433] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:29:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 14:29:55.853000 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02af5a98-104e-4342-9876-ea4d18b33e63 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:55.962833 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02af5a98-104e-4342-9876-ea4d18b33e63 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:55.999509 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300d5497-728c-4ed2-a82e-d1982d81cbdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:56.000353 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d5497-728c-4ed2-a82e-d1982d81cbdd None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:56.000646 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d5497-728c-4ed2-a82e-d1982d81cbdd None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:56.000925 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d5497-728c-4ed2-a82e-d1982d81cbdd None admin] PATH_INFO: `/v3/roles/member` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:56.016367 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300d5497-728c-4ed2-a82e-d1982d81cbdd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 14:29:56.024353 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-300d5497-728c-4ed2-a82e-d1982d81cbdd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 31 14:29:56.024353 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:29:56.024353 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:29:56.024353 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:29:56.024353 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:29:56.024353 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:29:56.024353 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:29:56.024353 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:29:56.024353 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:29:56.024353 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:29:56.024353 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:29:56.024353 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:29:56.024353 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 14:29:56.024353 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 14:29:56.024353 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 14:29:56.024353 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 14:29:56.025272 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 14:29:56.025272 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 14:29:56.025272 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 14:29:56.025272 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 14:29:56.025272 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:29:56.025272 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:29:56.025272 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:29:56.025272 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:29:56.025272 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:29:56.025272 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:29:56.025272 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:29:56.025272 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:29:56.025272 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:29:56.025272 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:29:56.025272 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:29:56.025272 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:29:56.026125 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:29:56.026125 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:29:56.026125 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:29:56.026125 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:29:56.026125 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 14:29:56.026125 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 14:29:56.026125 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 14:29:56.026125 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 14:29:56.026125 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 14:29:56.026125 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 14:29:56.026125 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 31 14:29:56.026125 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:29:56.026125 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 223/434] 10.222.0.15 () {56 vars in 1099 bytes} [Tue May 31 14:29:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:29:56.031798 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311433eb-0f3f-4076-a210-002058e42a1e None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:56.127056 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:56.152490 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311433eb-0f3f-4076-a210-002058e42a1e None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:56.193607 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcdcf04-ab5c-4b9c-9db7-b2d0b34edd04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:56.194280 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcdcf04-ab5c-4b9c-9db7-b2d0b34edd04 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:56.194579 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcdcf04-ab5c-4b9c-9db7-b2d0b34edd04 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:56.194889 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcdcf04-ab5c-4b9c-9db7-b2d0b34edd04 None admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:56.195628 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcdcf04-ab5c-4b9c-9db7-b2d0b34edd04 None admin] RBAC: Adding query filter params (name=member) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:29:56.195933 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcdcf04-ab5c-4b9c-9db7-b2d0b34edd04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:56.197297 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcdcf04-ab5c-4b9c-9db7-b2d0b34edd04 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:56.206199 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 212/435] 10.222.0.15 () {56 vars in 1101 bytes} [Tue May 31 14:29:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:56.211781 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300d5497-728c-4ed2-a82e-d1982d81cbdd None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:56.213458 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad1fb27-3ee5-4247-8256-2bf4640652c7 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:56.213759 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad1fb27-3ee5-4247-8256-2bf4640652c7 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:56.214042 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad1fb27-3ee5-4247-8256-2bf4640652c7 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:56.215703 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 213/436] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:29:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:29:56.220913 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a2844-005d-41cf-bd23-8d7288b27532 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:56.221205 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a2844-005d-41cf-bd23-8d7288b27532 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:56.221490 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a2844-005d-41cf-bd23-8d7288b27532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:56.239588 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-922a2844-005d-41cf-bd23-8d7288b27532 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:29:56.240793 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-922a2844-005d-41cf-bd23-8d7288b27532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:29:56.299207 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:56.314400 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 214/437] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:29:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 31 14:29:56.337936 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922a2844-005d-41cf-bd23-8d7288b27532 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:56.340328 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300d5497-728c-4ed2-a82e-d1982d81cbdd None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:56.379080 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3286b6d8-67fb-42d5-b000-5a44817820ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:56.380391 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3286b6d8-67fb-42d5-b000-5a44817820ca None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:56.380391 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3286b6d8-67fb-42d5-b000-5a44817820ca None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:56.381299 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3286b6d8-67fb-42d5-b000-5a44817820ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:56.420896 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:56.444744 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922a2844-005d-41cf-bd23-8d7288b27532 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:56.448935 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3286b6d8-67fb-42d5-b000-5a44817820ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:56.450429 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3286b6d8-67fb-42d5-b000-5a44817820ca None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:56.484342 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85514cc8-0314-4a68-be74-6378b3c519da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:56.485187 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85514cc8-0314-4a68-be74-6378b3c519da None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:56.485474 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85514cc8-0314-4a68-be74-6378b3c519da None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:56.485752 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85514cc8-0314-4a68-be74-6378b3c519da None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:56.498351 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85514cc8-0314-4a68-be74-6378b3c519da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 14:29:56.507424 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-85514cc8-0314-4a68-be74-6378b3c519da None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 31 14:29:56.507424 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:29:56.507424 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:29:56.507424 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:29:56.507424 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:29:56.507424 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:29:56.507424 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:29:56.507424 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:29:56.507424 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:29:56.507424 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:29:56.507424 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:29:56.507424 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:29:56.507424 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 14:29:56.507424 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 14:29:56.507424 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 14:29:56.507424 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 14:29:56.508450 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 14:29:56.508450 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 14:29:56.508450 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 14:29:56.508450 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 14:29:56.508450 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:29:56.508450 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:29:56.508450 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:29:56.508450 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:29:56.508450 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:29:56.508450 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:29:56.508450 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:29:56.508450 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:29:56.508450 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:29:56.508450 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:29:56.508450 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:29:56.508450 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:29:56.509252 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:29:56.509252 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:29:56.509252 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:29:56.509252 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:29:56.509252 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 14:29:56.509252 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 14:29:56.509252 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 14:29:56.509252 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 14:29:56.509252 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 14:29:56.509252 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 14:29:56.509252 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 31 14:29:56.509252 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:29:56.509252 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 215/438] 10.222.0.15 () {56 vars in 1096 bytes} [Tue May 31 14:29:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 14:29:56.510364 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ad66d7-20d4-4f99-bb82-7f07cafc6e5c None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:56.510681 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ad66d7-20d4-4f99-bb82-7f07cafc6e5c None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:56.510969 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ad66d7-20d4-4f99-bb82-7f07cafc6e5c None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:56.512351 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 216/439] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:29:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:29:56.515375 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ad66d7-20d4-4f99-bb82-7f07cafc6e5c None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:56.521925 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:56.563891 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 224/440] 10.222.0.15 () {58 vars in 1282 bytes} [Tue May 31 14:29:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 31 14:29:56.565078 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d191a7be-2a58-4f54-8794-e8b41f8eecd1 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:56.565371 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d191a7be-2a58-4f54-8794-e8b41f8eecd1 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:56.565652 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d191a7be-2a58-4f54-8794-e8b41f8eecd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:56.580735 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-d191a7be-2a58-4f54-8794-e8b41f8eecd1 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:29:56.581975 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-d191a7be-2a58-4f54-8794-e8b41f8eecd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:29:56.616220 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ad66d7-20d4-4f99-bb82-7f07cafc6e5c None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:56.646044 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 225/441] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:29:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 14:29:56.646964 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d191a7be-2a58-4f54-8794-e8b41f8eecd1 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:56.656323 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374918bd-6d23-41ed-85fd-4a6ac3ecbb09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:56.657300 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374918bd-6d23-41ed-85fd-4a6ac3ecbb09 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:56.657607 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374918bd-6d23-41ed-85fd-4a6ac3ecbb09 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:56.657886 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374918bd-6d23-41ed-85fd-4a6ac3ecbb09 None admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:56.659006 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374918bd-6d23-41ed-85fd-4a6ac3ecbb09 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:29:56.659741 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374918bd-6d23-41ed-85fd-4a6ac3ecbb09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:56.661077 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374918bd-6d23-41ed-85fd-4a6ac3ecbb09 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:56.669403 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:56.680284 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 217/442] 10.222.0.15 () {56 vars in 1099 bytes} [Tue May 31 14:29:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:56.680284 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374918bd-6d23-41ed-85fd-4a6ac3ecbb09 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:56.738359 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:56.747155 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d191a7be-2a58-4f54-8794-e8b41f8eecd1 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:56.771716 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374918bd-6d23-41ed-85fd-4a6ac3ecbb09 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:56.783876 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65502b3-3be6-4242-94b4-a792230ad76c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:56.785002 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65502b3-3be6-4242-94b4-a792230ad76c None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:56.785286 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65502b3-3be6-4242-94b4-a792230ad76c None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:56.785565 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65502b3-3be6-4242-94b4-a792230ad76c None admin] PATH_INFO: `/v3/projects/a492408a00474ddd952118fdba3219ad` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:56.786768 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65502b3-3be6-4242-94b4-a792230ad76c None admin] RBAC: Authorizing `identity:get_project(project_id=a492408a00474ddd952118fdba3219ad)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:56.788225 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65502b3-3be6-4242-94b4-a792230ad76c None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:56.789919 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 226/443] 10.222.0.15 () {56 vars in 1186 bytes} [Tue May 31 14:29:56 2022] GET /identity/v3/projects/a492408a00474ddd952118fdba3219ad => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:56.790699 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65502b3-3be6-4242-94b4-a792230ad76c None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:56.808039 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cbd373-32bd-4383-8a41-b2a8d37a563d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:56.808844 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cbd373-32bd-4383-8a41-b2a8d37a563d None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:56.809134 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cbd373-32bd-4383-8a41-b2a8d37a563d None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:56.809412 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cbd373-32bd-4383-8a41-b2a8d37a563d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:56.819427 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cbd373-32bd-4383-8a41-b2a8d37a563d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 14:29:56.828109 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-15cbd373-32bd-4383-8a41-b2a8d37a563d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 31 14:29:56.828109 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:29:56.828109 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:29:56.828109 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:29:56.828109 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:29:56.828109 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:29:56.828109 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:29:56.828109 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:29:56.828109 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:29:56.828109 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:29:56.828109 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:29:56.828109 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:29:56.828109 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 14:29:56.828109 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 14:29:56.828109 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 14:29:56.828109 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 14:29:56.828998 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 14:29:56.828998 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 14:29:56.828998 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 14:29:56.828998 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 14:29:56.828998 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:29:56.828998 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:29:56.828998 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:29:56.828998 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:29:56.828998 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:29:56.828998 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:29:56.828998 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:29:56.828998 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:29:56.828998 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:29:56.828998 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:29:56.828998 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:29:56.828998 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:29:56.830171 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:29:56.830171 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:29:56.830171 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:29:56.830171 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:29:56.830171 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 14:29:56.830171 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 14:29:56.830171 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 14:29:56.830171 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 14:29:56.830171 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 14:29:56.830171 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 14:29:56.830171 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 31 14:29:56.830171 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:29:56.830171 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 218/444] 10.222.0.15 () {56 vars in 1114 bytes} [Tue May 31 14:29:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:29:56.831106 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cbd373-32bd-4383-8a41-b2a8d37a563d None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:56.887523 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:56.892924 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65502b3-3be6-4242-94b4-a792230ad76c None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:56.925353 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858d853e-4d5c-4151-8f30-c4da8703d003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:56.925991 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858d853e-4d5c-4151-8f30-c4da8703d003 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:56.926279 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858d853e-4d5c-4151-8f30-c4da8703d003 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:56.926580 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858d853e-4d5c-4151-8f30-c4da8703d003 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:56.928020 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cbd373-32bd-4383-8a41-b2a8d37a563d None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:56.951828 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:56.960170 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86a9df9-7437-452b-9de0-2be7f8b05a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:56.961572 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86a9df9-7437-452b-9de0-2be7f8b05a66 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:56.961855 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86a9df9-7437-452b-9de0-2be7f8b05a66 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:56.962132 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86a9df9-7437-452b-9de0-2be7f8b05a66 None admin] PATH_INFO: `/v3/groups/5f67a89fa42d4683a086676ac79552b7` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:56.963352 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86a9df9-7437-452b-9de0-2be7f8b05a66 None admin] RBAC: Authorizing `identity:get_group(group_id=5f67a89fa42d4683a086676ac79552b7)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:56.964802 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86a9df9-7437-452b-9de0-2be7f8b05a66 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:56.966781 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 219/445] 10.222.0.15 () {56 vars in 1180 bytes} [Tue May 31 14:29:56 2022] GET /identity/v3/groups/5f67a89fa42d4683a086676ac79552b7 => generated 226 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:56.967665 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86a9df9-7437-452b-9de0-2be7f8b05a66 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:56.993420 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858d853e-4d5c-4151-8f30-c4da8703d003 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:56.994895 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858d853e-4d5c-4151-8f30-c4da8703d003 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:57.068926 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86a9df9-7437-452b-9de0-2be7f8b05a66 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:57.091467 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 227/446] 10.222.0.15 () {58 vars in 1282 bytes} [Tue May 31 14:29:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 31 14:29:57.093636 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:57.095418 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858d853e-4d5c-4151-8f30-c4da8703d003 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:57.102509 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1602459-4c3c-47d6-b5a8-5f76ca431cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:57.103196 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1602459-4c3c-47d6-b5a8-5f76ca431cb0 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:57.103481 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1602459-4c3c-47d6-b5a8-5f76ca431cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:57.103760 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1602459-4c3c-47d6-b5a8-5f76ca431cb0 None admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:57.104554 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1602459-4c3c-47d6-b5a8-5f76ca431cb0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:29:57.104868 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1602459-4c3c-47d6-b5a8-5f76ca431cb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:57.106235 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1602459-4c3c-47d6-b5a8-5f76ca431cb0 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:57.114744 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 220/447] 10.222.0.15 () {56 vars in 1111 bytes} [Tue May 31 14:29:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:57.115534 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1602459-4c3c-47d6-b5a8-5f76ca431cb0 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:57.150694 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:57.191441 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858d853e-4d5c-4151-8f30-c4da8703d003 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:57.215985 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1602459-4c3c-47d6-b5a8-5f76ca431cb0 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:57.223904 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2229fb-713c-4570-88fa-9a1ec37d2ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:57.224553 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2229fb-713c-4570-88fa-9a1ec37d2ded None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:57.224844 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2229fb-713c-4570-88fa-9a1ec37d2ded None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:57.225120 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2229fb-713c-4570-88fa-9a1ec37d2ded None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:57.225940 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2229fb-713c-4570-88fa-9a1ec37d2ded None admin] RBAC: Adding query filter params (group.id=5f67a89fa42d4683a086676ac79552b7, role.id=317f725e26bf43648d8235bb1f7c4cb3, scope.project.id=a492408a00474ddd952118fdba3219ad) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:29:57.226255 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2229fb-713c-4570-88fa-9a1ec37d2ded None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:57.227735 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2229fb-713c-4570-88fa-9a1ec37d2ded None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:57.233307 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 228/448] 10.222.0.15 () {56 vars in 1376 bytes} [Tue May 31 14:29:57 2022] GET /identity/v3/role_assignments?group.id=5f67a89fa42d4683a086676ac79552b7&scope.project.id=a492408a00474ddd952118fdba3219ad&role.id=317f725e26bf43648d8235bb1f7c4cb3 => generated 611 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:57.234079 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2229fb-713c-4570-88fa-9a1ec37d2ded None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:57.259808 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008faa10-6eaa-481c-b68e-1bc6183d2226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:57.260699 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008faa10-6eaa-481c-b68e-1bc6183d2226 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:57.260983 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008faa10-6eaa-481c-b68e-1bc6183d2226 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:57.261258 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008faa10-6eaa-481c-b68e-1bc6183d2226 None admin] PATH_INFO: `/v3/projects/b38704b3ca584f7ab2bbb66117ff153b` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:57.262718 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008faa10-6eaa-481c-b68e-1bc6183d2226 None admin] RBAC: Authorizing `identity:get_project(project_id=b38704b3ca584f7ab2bbb66117ff153b)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:57.264325 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008faa10-6eaa-481c-b68e-1bc6183d2226 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:57.266436 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 221/449] 10.222.0.15 () {56 vars in 1186 bytes} [Tue May 31 14:29:57 2022] GET /identity/v3/projects/b38704b3ca584f7ab2bbb66117ff153b => generated 344 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:57.272190 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008faa10-6eaa-481c-b68e-1bc6183d2226 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:57.341239 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:57.355159 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2229fb-713c-4570-88fa-9a1ec37d2ded None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:57.380685 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:57.394006 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cd11a8-9976-4800-8842-036ffedb5323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:57.394883 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cd11a8-9976-4800-8842-036ffedb5323 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:57.395168 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cd11a8-9976-4800-8842-036ffedb5323 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:57.395325 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008faa10-6eaa-481c-b68e-1bc6183d2226 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:57.395448 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cd11a8-9976-4800-8842-036ffedb5323 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:57.432817 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a64dbf-7946-4cc0-a9e3-f16fd3ddb2de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:57.433683 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a64dbf-7946-4cc0-a9e3-f16fd3ddb2de None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:57.433971 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a64dbf-7946-4cc0-a9e3-f16fd3ddb2de None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:57.434245 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a64dbf-7946-4cc0-a9e3-f16fd3ddb2de None admin] PATH_INFO: `/v3/groups/44b5426da0bb42cca22e5b1d23b3f4e6` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:57.435493 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a64dbf-7946-4cc0-a9e3-f16fd3ddb2de None admin] RBAC: Authorizing `identity:get_group(group_id=44b5426da0bb42cca22e5b1d23b3f4e6)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:57.436906 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a64dbf-7946-4cc0-a9e3-f16fd3ddb2de None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:57.438823 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 222/450] 10.222.0.15 () {56 vars in 1180 bytes} [Tue May 31 14:29:57 2022] GET /identity/v3/groups/44b5426da0bb42cca22e5b1d23b3f4e6 => generated 229 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 14:29:57.445523 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a64dbf-7946-4cc0-a9e3-f16fd3ddb2de None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:57.475707 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cd11a8-9976-4800-8842-036ffedb5323 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:57.477723 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cd11a8-9976-4800-8842-036ffedb5323 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:57.560644 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a64dbf-7946-4cc0-a9e3-f16fd3ddb2de None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:57.586242 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:57.592261 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 229/451] 10.222.0.15 () {58 vars in 1282 bytes} [Tue May 31 14:29:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 31 14:29:57.597567 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cd11a8-9976-4800-8842-036ffedb5323 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:57.597699 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81533da-6ba1-491b-a3ea-dc69f39ecec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:57.598406 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81533da-6ba1-491b-a3ea-dc69f39ecec6 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:57.598542 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81533da-6ba1-491b-a3ea-dc69f39ecec6 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:57.606286 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81533da-6ba1-491b-a3ea-dc69f39ecec6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:57.606286 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81533da-6ba1-491b-a3ea-dc69f39ecec6 None admin] RBAC: Adding query filter params (group.id=44b5426da0bb42cca22e5b1d23b3f4e6, role.id=76c53e2c353644f885028a0226c06146, scope.project.id=b38704b3ca584f7ab2bbb66117ff153b) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:29:57.606286 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81533da-6ba1-491b-a3ea-dc69f39ecec6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:57.606286 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81533da-6ba1-491b-a3ea-dc69f39ecec6 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:57.608839 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 223/452] 10.222.0.15 () {56 vars in 1376 bytes} [Tue May 31 14:29:57 2022] GET /identity/v3/role_assignments?group.id=44b5426da0bb42cca22e5b1d23b3f4e6&scope.project.id=b38704b3ca584f7ab2bbb66117ff153b&role.id=76c53e2c353644f885028a0226c06146 => generated 611 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:57.626227 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:57.710449 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cd11a8-9976-4800-8842-036ffedb5323 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:57.746267 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de8d52b-b92a-4c3a-96b6-d10f5cd76fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:57.747177 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de8d52b-b92a-4c3a-96b6-d10f5cd76fa5 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:57.747462 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de8d52b-b92a-4c3a-96b6-d10f5cd76fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:57.747736 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de8d52b-b92a-4c3a-96b6-d10f5cd76fa5 None admin] PATH_INFO: `/v3/projects/a492408a00474ddd952118fdba3219ad` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:57.748958 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de8d52b-b92a-4c3a-96b6-d10f5cd76fa5 None admin] RBAC: Authorizing `identity:get_project(project_id=a492408a00474ddd952118fdba3219ad)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:57.750422 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de8d52b-b92a-4c3a-96b6-d10f5cd76fa5 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:57.752185 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 230/453] 10.222.0.15 () {56 vars in 1186 bytes} [Tue May 31 14:29:57 2022] GET /identity/v3/projects/a492408a00474ddd952118fdba3219ad => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 14:29:57.757939 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81533da-6ba1-491b-a3ea-dc69f39ecec6 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:57.860232 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81533da-6ba1-491b-a3ea-dc69f39ecec6 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:57.892113 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcddb50-0e79-453d-98d8-1551405c6898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:57.892959 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcddb50-0e79-453d-98d8-1551405c6898 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:57.893246 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcddb50-0e79-453d-98d8-1551405c6898 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:57.893523 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcddb50-0e79-453d-98d8-1551405c6898 None admin] PATH_INFO: `/v3/groups/5f67a89fa42d4683a086676ac79552b7` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:57.894717 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcddb50-0e79-453d-98d8-1551405c6898 None admin] RBAC: Authorizing `identity:get_group(group_id=5f67a89fa42d4683a086676ac79552b7)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:57.896145 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcddb50-0e79-453d-98d8-1551405c6898 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:57.897799 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 224/454] 10.222.0.15 () {56 vars in 1180 bytes} [Tue May 31 14:29:57 2022] GET /identity/v3/groups/5f67a89fa42d4683a086676ac79552b7 => generated 226 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:29:57.904035 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de8d52b-b92a-4c3a-96b6-d10f5cd76fa5 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:29:57.989795 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:29:57.998700 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de8d52b-b92a-4c3a-96b6-d10f5cd76fa5 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:29:58.030812 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1cf0ec-f6a6-4ede-bab3-001425c9b47a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:29:58.031452 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1cf0ec-f6a6-4ede-bab3-001425c9b47a None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:29:58.031732 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1cf0ec-f6a6-4ede-bab3-001425c9b47a None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:29:58.032003 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1cf0ec-f6a6-4ede-bab3-001425c9b47a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:29:58.032813 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1cf0ec-f6a6-4ede-bab3-001425c9b47a None admin] RBAC: Adding query filter params (group.id=5f67a89fa42d4683a086676ac79552b7, role.id=86e29729720b4d53b2a375a337765a2d, scope.project.id=a492408a00474ddd952118fdba3219ad) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:29:58.033116 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1cf0ec-f6a6-4ede-bab3-001425c9b47a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:29:58.034897 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1cf0ec-f6a6-4ede-bab3-001425c9b47a None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:29:58.041010 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 231/455] 10.222.0.15 () {56 vars in 1376 bytes} [Tue May 31 14:29:57 2022] GET /identity/v3/role_assignments?group.id=5f67a89fa42d4683a086676ac79552b7&scope.project.id=a492408a00474ddd952118fdba3219ad&role.id=86e29729720b4d53b2a375a337765a2d => generated 611 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:00.763151 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf50bccb-7240-42a2-996e-91f1a21920ea None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:00.763634 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf50bccb-7240-42a2-996e-91f1a21920ea None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:00.763634 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf50bccb-7240-42a2-996e-91f1a21920ea None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:00.765261 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 225/456] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:30:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:30:00.770434 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee86ed-c257-49d0-8c9f-a36cfa96fe75 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:00.771279 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee86ed-c257-49d0-8c9f-a36cfa96fe75 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:00.771766 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee86ed-c257-49d0-8c9f-a36cfa96fe75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:00.794934 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-f4ee86ed-c257-49d0-8c9f-a36cfa96fe75 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:30:00.796444 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-f4ee86ed-c257-49d0-8c9f-a36cfa96fe75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:30:00.889093 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 232/457] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:30:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 14:30:00.941689 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf50bccb-7240-42a2-996e-91f1a21920ea None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:01.030845 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:01.095274 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf50bccb-7240-42a2-996e-91f1a21920ea None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:01.142867 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8030526b-b5e8-49aa-acc1-a045bc6a6e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:01.143702 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8030526b-b5e8-49aa-acc1-a045bc6a6e0c None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:01.143987 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8030526b-b5e8-49aa-acc1-a045bc6a6e0c None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:01.144323 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8030526b-b5e8-49aa-acc1-a045bc6a6e0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:01.167983 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8030526b-b5e8-49aa-acc1-a045bc6a6e0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:01.169482 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8030526b-b5e8-49aa-acc1-a045bc6a6e0c None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:01.189567 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-8030526b-b5e8-49aa-acc1-a045bc6a6e0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:01.189567 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:01.189567 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:01.189567 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:01.189567 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:01.189567 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:01.189567 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:01.189567 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:01.189567 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:01.189567 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:01.189567 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:01.189567 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:01.189567 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 14:30:01.189567 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 14:30:01.189567 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 14:30:01.196247 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 14:30:01.196247 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:01.196247 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:01.196247 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:01.196247 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:01.196247 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:01.196247 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:01.196247 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:01.196247 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:30:01.196247 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:01.196247 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:01.196247 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:01.196247 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:01.196247 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:01.196247 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:01.196247 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:01.196247 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:01.197095 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 14:30:01.197095 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 14:30:01.197095 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:01.197095 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:30:01.197095 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 226/458] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:30:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:01.197370 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ee86ed-c257-49d0-8c9f-a36cfa96fe75 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:01.316043 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:01.332675 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e55a8d-ee51-4693-8a13-0bf3475ae7c6 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:01.332850 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ee86ed-c257-49d0-8c9f-a36cfa96fe75 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:01.333055 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e55a8d-ee51-4693-8a13-0bf3475ae7c6 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:01.333228 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e55a8d-ee51-4693-8a13-0bf3475ae7c6 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:01.342351 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 227/459] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:30:01 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:30:01.352384 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7ac4c8-0073-49b2-bcf6-c3a7faeb2a87 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:01.352680 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7ac4c8-0073-49b2-bcf6-c3a7faeb2a87 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:01.352966 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7ac4c8-0073-49b2-bcf6-c3a7faeb2a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:01.377133 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-5b7ac4c8-0073-49b2-bcf6-c3a7faeb2a87 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:30:01.378576 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-5b7ac4c8-0073-49b2-bcf6-c3a7faeb2a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:30:01.382265 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d23b63-28be-4e16-b066-17a08dd9c11a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:01.383263 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d23b63-28be-4e16-b066-17a08dd9c11a None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:01.383553 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d23b63-28be-4e16-b066-17a08dd9c11a None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:01.383832 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d23b63-28be-4e16-b066-17a08dd9c11a None admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:01.384561 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d23b63-28be-4e16-b066-17a08dd9c11a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:01.384871 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d23b63-28be-4e16-b066-17a08dd9c11a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:01.386266 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d23b63-28be-4e16-b066-17a08dd9c11a None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:01.410639 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 233/460] 10.222.0.15 () {56 vars in 1109 bytes} [Tue May 31 14:30:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:01.415652 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d23b63-28be-4e16-b066-17a08dd9c11a None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:01.452021 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 228/461] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:30:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 14:30:01.505003 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7ac4c8-0073-49b2-bcf6-c3a7faeb2a87 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:01.552085 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:01.561969 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d23b63-28be-4e16-b066-17a08dd9c11a None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:01.601442 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6237ad5e-233c-4f57-836d-276be69b5258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:01.602111 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6237ad5e-233c-4f57-836d-276be69b5258 None admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:01.602396 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6237ad5e-233c-4f57-836d-276be69b5258 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:01.602704 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6237ad5e-233c-4f57-836d-276be69b5258 None admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:01.603415 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6237ad5e-233c-4f57-836d-276be69b5258 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:01.604846 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6237ad5e-233c-4f57-836d-276be69b5258 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:01.616468 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7ac4c8-0073-49b2-bcf6-c3a7faeb2a87 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:01.650886 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c36608-f9e9-48e4-922e-c7f18fd5d668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:01.651675 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c36608-f9e9-48e4-922e-c7f18fd5d668 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:01.651959 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c36608-f9e9-48e4-922e-c7f18fd5d668 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:01.652235 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c36608-f9e9-48e4-922e-c7f18fd5d668 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:01.662923 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c36608-f9e9-48e4-922e-c7f18fd5d668 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:01.664383 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c36608-f9e9-48e4-922e-c7f18fd5d668 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:01.682444 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-94c36608-f9e9-48e4-922e-c7f18fd5d668 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:01.682444 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:01.682444 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:01.682444 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:01.682444 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:01.682444 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:01.682444 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:01.682444 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:01.682444 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:01.682444 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:01.682444 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:01.682444 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:01.682444 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 14:30:01.682444 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 14:30:01.682444 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 14:30:01.683347 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 14:30:01.683347 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:01.683347 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:01.683347 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:01.683347 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:01.683347 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:01.683347 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:01.683347 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:01.683347 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:30:01.683347 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:01.683347 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:01.683347 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:01.683347 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:01.683347 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:01.683347 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:01.683347 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:01.683347 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:01.684197 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 14:30:01.684197 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 14:30:01.684197 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:01.684197 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:30:01.684407 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:01.684492 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 229/462] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:30:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:01.685209 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b17c9-877f-48e4-95dd-a34bb3c5d07f None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:01.685497 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b17c9-877f-48e4-95dd-a34bb3c5d07f None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:01.685825 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b17c9-877f-48e4-95dd-a34bb3c5d07f None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:01.690681 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 230/463] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:30:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:30:01.695746 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdda0d7-9288-4596-8f63-144c84316203 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:01.695746 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdda0d7-9288-4596-8f63-144c84316203 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:01.696001 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 234/464] 10.222.0.15 () {60 vars in 1132 bytes} [Tue May 31 14:30:01 2022] POST /identity/v3/users => generated 246 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:30:01.696076 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdda0d7-9288-4596-8f63-144c84316203 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:01.696144 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6237ad5e-233c-4f57-836d-276be69b5258 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:01.696211 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 231/465] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:30:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:30:01.698661 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7301a861-4f3c-46a8-a5e4-77e5a1645469 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:01.699319 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7301a861-4f3c-46a8-a5e4-77e5a1645469 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:01.699603 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7301a861-4f3c-46a8-a5e4-77e5a1645469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:01.718891 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-7301a861-4f3c-46a8-a5e4-77e5a1645469 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:30:01.720126 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-7301a861-4f3c-46a8-a5e4-77e5a1645469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:30:01.806290 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 232/466] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:30:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 14:30:01.808507 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03639b-3de5-4aea-bcd1-10f99eae1162 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:01.808507 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03639b-3de5-4aea-bcd1-10f99eae1162 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:01.808507 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03639b-3de5-4aea-bcd1-10f99eae1162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:01.838575 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6237ad5e-233c-4f57-836d-276be69b5258 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:01.846674 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-2a03639b-3de5-4aea-bcd1-10f99eae1162 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:30:01.848227 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-2a03639b-3de5-4aea-bcd1-10f99eae1162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:30:01.865063 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:01.881874 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68d2e52-524d-4118-8eeb-f47f2572d135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:01.883434 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d2e52-524d-4118-8eeb-f47f2572d135 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:01.883924 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d2e52-524d-4118-8eeb-f47f2572d135 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:01.884403 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68d2e52-524d-4118-8eeb-f47f2572d135 None admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:01.885454 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68d2e52-524d-4118-8eeb-f47f2572d135 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:01.885986 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68d2e52-524d-4118-8eeb-f47f2572d135 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:01.887817 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68d2e52-524d-4118-8eeb-f47f2572d135 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:01.902257 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 235/467] 10.222.0.15 () {56 vars in 1109 bytes} [Tue May 31 14:30:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:01.907625 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68d2e52-524d-4118-8eeb-f47f2572d135 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:01.934446 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 233/468] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:30:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 14:30:01.935568 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a03639b-3de5-4aea-bcd1-10f99eae1162 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:01.983383 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:02.033332 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68d2e52-524d-4118-8eeb-f47f2572d135 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:02.059470 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a03639b-3de5-4aea-bcd1-10f99eae1162 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:02.074346 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9420f3b6-c417-465b-888d-8210498b24b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:02.075291 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9420f3b6-c417-465b-888d-8210498b24b4 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:02.075569 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9420f3b6-c417-465b-888d-8210498b24b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:02.076028 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9420f3b6-c417-465b-888d-8210498b24b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:02.088317 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9420f3b6-c417-465b-888d-8210498b24b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:02.089779 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9420f3b6-c417-465b-888d-8210498b24b4 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:02.105880 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15baa87d-2db5-41f1-bbfd-5f489de69397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:02.106984 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15baa87d-2db5-41f1-bbfd-5f489de69397 None admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:02.107477 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15baa87d-2db5-41f1-bbfd-5f489de69397 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:02.107960 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15baa87d-2db5-41f1-bbfd-5f489de69397 None admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:02.108920 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15baa87d-2db5-41f1-bbfd-5f489de69397 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:02.109178 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-9420f3b6-c417-465b-888d-8210498b24b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:02.109178 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:02.109178 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:02.109178 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:02.109178 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:02.109178 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:02.109178 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:02.109178 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:02.109178 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:02.109178 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:02.109178 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:02.109178 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:02.109178 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 14:30:02.109178 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 14:30:02.109178 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 14:30:02.109997 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 14:30:02.109997 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:02.109997 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:02.109997 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:02.109997 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:02.109997 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:02.109997 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:02.109997 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:02.109997 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:30:02.109997 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:02.109997 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:02.109997 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:02.109997 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:02.109997 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:02.109997 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:02.109997 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:02.109997 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:02.110922 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 14:30:02.110922 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 14:30:02.110922 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:02.110922 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:30:02.110922 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 236/469] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:30:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:02.111604 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9420f3b6-c417-465b-888d-8210498b24b4 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:02.113460 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15baa87d-2db5-41f1-bbfd-5f489de69397 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:02.202587 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 234/470] 10.222.0.15 () {60 vars in 1132 bytes} [Tue May 31 14:30:01 2022] POST /identity/v3/users => generated 248 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:30:02.202587 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15baa87d-2db5-41f1-bbfd-5f489de69397 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:02.218778 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:02.239797 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9420f3b6-c417-465b-888d-8210498b24b4 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:02.266200 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:02.310749 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27b5041-010e-4c68-8cb2-3b8aa1b1f157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:02.311480 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b5041-010e-4c68-8cb2-3b8aa1b1f157 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:02.311764 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b5041-010e-4c68-8cb2-3b8aa1b1f157 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:02.312040 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b5041-010e-4c68-8cb2-3b8aa1b1f157 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:02.324287 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27b5041-010e-4c68-8cb2-3b8aa1b1f157 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:02.326752 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27b5041-010e-4c68-8cb2-3b8aa1b1f157 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:02.348730 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-b27b5041-010e-4c68-8cb2-3b8aa1b1f157 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:02.348730 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:02.348730 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:02.348730 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:02.348730 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:02.348730 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:02.348730 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:02.348730 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:02.348730 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:02.348730 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:02.348730 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:02.348730 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:02.348730 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 14:30:02.348730 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 14:30:02.348730 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 14:30:02.349660 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 14:30:02.349660 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:02.349660 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:02.349660 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:02.349660 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:02.349660 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:02.349660 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:02.349660 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:02.349660 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:30:02.349660 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:02.349660 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:02.349660 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:02.349660 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:02.349660 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:02.349660 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:02.349660 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:02.349660 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:02.350529 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 14:30:02.350529 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 14:30:02.350529 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:02.350529 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:30:02.350529 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 237/471] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:30:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:02.351997 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34907fdf-4a50-4960-9b6f-5b0fbb6d52fb None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:02.352293 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34907fdf-4a50-4960-9b6f-5b0fbb6d52fb None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:02.352574 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34907fdf-4a50-4960-9b6f-5b0fbb6d52fb None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:02.354004 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 238/472] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:30:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:30:02.360325 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb06a9-855b-4bc7-b8f5-86d6b1a89882 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:02.360616 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb06a9-855b-4bc7-b8f5-86d6b1a89882 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:02.360898 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb06a9-855b-4bc7-b8f5-86d6b1a89882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:02.381160 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15baa87d-2db5-41f1-bbfd-5f489de69397 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:02.385031 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-27fb06a9-855b-4bc7-b8f5-86d6b1a89882 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:30:02.386597 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-27fb06a9-855b-4bc7-b8f5-86d6b1a89882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:30:02.421126 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f1577e-2e3f-478c-98f0-44bf364f4218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:02.421812 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f1577e-2e3f-478c-98f0-44bf364f4218 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:02.422098 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f1577e-2e3f-478c-98f0-44bf364f4218 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:02.422378 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f1577e-2e3f-478c-98f0-44bf364f4218 None admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:02.423146 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f1577e-2e3f-478c-98f0-44bf364f4218 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:02.423453 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f1577e-2e3f-478c-98f0-44bf364f4218 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:02.424877 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f1577e-2e3f-478c-98f0-44bf364f4218 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:02.442575 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 235/473] 10.222.0.15 () {56 vars in 1109 bytes} [Tue May 31 14:30:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:02.442575 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f1577e-2e3f-478c-98f0-44bf364f4218 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:02.475231 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 239/474] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:30:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 14:30:02.476595 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fb06a9-855b-4bc7-b8f5-86d6b1a89882 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:02.520573 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:02.565573 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f1577e-2e3f-478c-98f0-44bf364f4218 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:02.590718 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:02.598133 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fb06a9-855b-4bc7-b8f5-86d6b1a89882 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:02.609872 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3518fe66-5f03-4e77-8b05-199722540db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:02.611157 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3518fe66-5f03-4e77-8b05-199722540db4 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:02.611644 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3518fe66-5f03-4e77-8b05-199722540db4 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:02.612253 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3518fe66-5f03-4e77-8b05-199722540db4 None admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:02.613563 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3518fe66-5f03-4e77-8b05-199722540db4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:02.614372 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3518fe66-5f03-4e77-8b05-199722540db4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:02.616438 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3518fe66-5f03-4e77-8b05-199722540db4 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:02.633259 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 236/475] 10.222.0.15 () {56 vars in 1109 bytes} [Tue May 31 14:30:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:02.634444 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3518fe66-5f03-4e77-8b05-199722540db4 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:02.638808 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1415e4-6263-4d25-bfa0-d073fd9e5bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:02.638808 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1415e4-6263-4d25-bfa0-d073fd9e5bb9 None admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:02.638808 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1415e4-6263-4d25-bfa0-d073fd9e5bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:02.638808 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1415e4-6263-4d25-bfa0-d073fd9e5bb9 None admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:02.639122 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1415e4-6263-4d25-bfa0-d073fd9e5bb9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:02.639122 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1415e4-6263-4d25-bfa0-d073fd9e5bb9 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:02.746700 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 240/476] 10.222.0.15 () {60 vars in 1132 bytes} [Tue May 31 14:30:02 2022] POST /identity/v3/users => generated 248 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:30:02.747516 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1415e4-6263-4d25-bfa0-d073fd9e5bb9 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:02.753428 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3518fe66-5f03-4e77-8b05-199722540db4 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:02.783161 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:02.793471 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ca8e66-77a8-458a-925b-8316b733402b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:02.794149 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca8e66-77a8-458a-925b-8316b733402b None admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:02.794466 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca8e66-77a8-458a-925b-8316b733402b None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:02.794799 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca8e66-77a8-458a-925b-8316b733402b None admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:02.795615 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ca8e66-77a8-458a-925b-8316b733402b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:02.796993 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ca8e66-77a8-458a-925b-8316b733402b None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:02.855379 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.sql.core [None req-25ca8e66-77a8-458a-925b-8316b733402b None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 31 14:30:02.855379 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 31 14:30:02.855379 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [parameters: {'id': 'd48f20e59fab490689dc83a4e54dbf40', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 31 14:30:02.855379 dv-cinder-839793-14-smb devstack@keystone.service[80503]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80503) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 31 14:30:02.886904 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-25ca8e66-77a8-458a-925b-8316b733402b None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 31 14:30:02.886904 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:02.886904 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 31 14:30:02.886904 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application self.dialect.do_execute( May 31 14:30:02.886904 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 31 14:30:02.886904 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 31 14:30:02.886904 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 31 14:30:02.886904 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application result = self._query(query) May 31 14:30:02.886904 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 31 14:30:02.886904 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application conn.query(q) May 31 14:30:02.886904 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 31 14:30:02.886904 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 31 14:30:02.886904 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 31 14:30:02.886904 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application result.read() May 31 14:30:02.886904 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 31 14:30:02.887848 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 31 14:30:02.887848 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 31 14:30:02.887848 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application packet.raise_for_error() May 31 14:30:02.887848 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 31 14:30:02.887848 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 31 14:30:02.887848 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 31 14:30:02.887848 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 31 14:30:02.887848 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 31 14:30:02.887848 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:30:02.887848 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 31 14:30:02.887848 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:30:02.887848 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:02.887848 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 31 14:30:02.887848 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 31 14:30:02.887848 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 31 14:30:02.887848 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return ref.to_dict() May 31 14:30:02.887848 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 31 14:30:02.887848 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application next(self.gen) May 31 14:30:02.888761 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 31 14:30:02.888761 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application yield resource May 31 14:30:02.888761 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 31 14:30:02.888761 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application next(self.gen) May 31 14:30:02.888761 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 31 14:30:02.888761 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application self.session.rollback() May 31 14:30:02.888761 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 31 14:30:02.888761 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application self.force_reraise() May 31 14:30:02.888761 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 31 14:30:02.888761 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise self.value May 31 14:30:02.888761 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 31 14:30:02.888761 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 31 14:30:02.888761 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 31 14:30:02.888761 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application session.commit() May 31 14:30:02.888761 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 31 14:30:02.888761 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 31 14:30:02.888761 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 31 14:30:02.889652 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application self._prepare_impl() May 31 14:30:02.889652 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 31 14:30:02.889652 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application self.session.flush() May 31 14:30:02.889652 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 31 14:30:02.889652 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application self._flush(objects) May 31 14:30:02.889652 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 31 14:30:02.889652 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 31 14:30:02.889652 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 31 14:30:02.889652 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application compat.raise_( May 31 14:30:02.889652 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 31 14:30:02.889652 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception May 31 14:30:02.889652 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 31 14:30:02.889652 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application flush_context.execute() May 31 14:30:02.889652 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 31 14:30:02.889652 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rec.execute(self) May 31 14:30:02.889652 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 31 14:30:02.889652 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 31 14:30:02.890515 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 31 14:30:02.890515 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application _emit_insert_statements( May 31 14:30:02.890515 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 31 14:30:02.890515 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application c = connection._execute_20( May 31 14:30:02.890515 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 31 14:30:02.890515 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 31 14:30:02.890515 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 31 14:30:02.890515 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 31 14:30:02.890515 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 31 14:30:02.890515 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ret = self._execute_context( May 31 14:30:02.890515 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 31 14:30:02.890515 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 31 14:30:02.890515 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 31 14:30:02.890515 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 31 14:30:02.890515 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 31 14:30:02.890515 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception May 31 14:30:02.891392 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 31 14:30:02.891392 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application self.dialect.do_execute( May 31 14:30:02.891392 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 31 14:30:02.891392 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 31 14:30:02.891392 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 31 14:30:02.891392 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application result = self._query(query) May 31 14:30:02.891392 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 31 14:30:02.891392 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application conn.query(q) May 31 14:30:02.891392 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 31 14:30:02.891392 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 31 14:30:02.891392 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 31 14:30:02.891392 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application result.read() May 31 14:30:02.891392 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 31 14:30:02.891392 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 31 14:30:02.891392 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 31 14:30:02.891392 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application packet.raise_for_error() May 31 14:30:02.892189 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 31 14:30:02.892189 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 31 14:30:02.892189 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 31 14:30:02.892189 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 31 14:30:02.892189 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 31 14:30:02.892189 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 31 14:30:02.892189 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [parameters: {'id': 'd48f20e59fab490689dc83a4e54dbf40', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 31 14:30:02.892189 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 31 14:30:02.892189 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:30:02.892189 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 31 14:30:02.892189 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:30:02.892189 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:02.892189 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:02.892189 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:02.892189 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:02.892189 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:02.893008 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:02.893008 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:02.893008 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:02.893008 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:02.893008 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:02.893008 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:02.893008 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 31 14:30:02.893008 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 31 14:30:02.893008 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:02.893008 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:02.893008 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 31 14:30:02.893008 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 31 14:30:02.893008 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 31 14:30:02.893008 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 31 14:30:02.893008 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 31 14:30:02.893008 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:30:02.906314 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 237/477] 10.222.0.15 () {60 vars in 1131 bytes} [Tue May 31 14:30:02 2022] POST /identity/v3/roles => generated 144 bytes in 254 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:02.906314 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ca8e66-77a8-458a-925b-8316b733402b None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:02.906603 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1415e4-6263-4d25-bfa0-d073fd9e5bb9 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:02.971200 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a50a3f-0208-4637-bf29-d5e832aad141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:02.971902 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a50a3f-0208-4637-bf29-d5e832aad141 None admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:02.972187 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a50a3f-0208-4637-bf29-d5e832aad141 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:02.972461 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a50a3f-0208-4637-bf29-d5e832aad141 None admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:02.973164 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a50a3f-0208-4637-bf29-d5e832aad141 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:02.974628 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a50a3f-0208-4637-bf29-d5e832aad141 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:03.052500 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ca8e66-77a8-458a-925b-8316b733402b None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:03.083517 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 241/478] 10.222.0.15 () {60 vars in 1132 bytes} [Tue May 31 14:30:02 2022] POST /identity/v3/users => generated 249 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:30:03.096778 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642ba977-c2b3-490d-b143-9b92425d3a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:03.098185 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ba977-c2b3-490d-b143-9b92425d3a35 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:03.098888 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ba977-c2b3-490d-b143-9b92425d3a35 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:03.099381 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ba977-c2b3-490d-b143-9b92425d3a35 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:03.112387 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642ba977-c2b3-490d-b143-9b92425d3a35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 14:30:03.121831 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-642ba977-c2b3-490d-b143-9b92425d3a35 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 31 14:30:03.121831 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:03.121831 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:03.121831 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:03.121831 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:03.121831 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:03.121831 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:03.121831 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:03.121831 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:03.121831 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:03.121831 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:03.121831 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:03.121831 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 14:30:03.121831 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 14:30:03.121831 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 14:30:03.121831 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 14:30:03.122820 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 14:30:03.122820 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 14:30:03.122820 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 14:30:03.122820 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 14:30:03.122820 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:03.122820 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:03.122820 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:03.122820 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:03.122820 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:03.122820 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:03.122820 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:03.122820 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:30:03.122820 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:03.122820 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:03.122820 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:03.122820 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:03.123638 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:03.123638 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:03.123638 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:03.123638 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:03.123638 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 14:30:03.123638 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 14:30:03.123638 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 14:30:03.123638 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 14:30:03.123638 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 14:30:03.123638 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 14:30:03.123638 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 31 14:30:03.123638 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:30:03.126656 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 238/479] 10.222.0.15 () {56 vars in 1114 bytes} [Tue May 31 14:30:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:03.134620 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a50a3f-0208-4637-bf29-d5e832aad141 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:03.157687 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:03.277182 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a50a3f-0208-4637-bf29-d5e832aad141 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:03.336852 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23501d80-a666-4b8b-a9ad-b148a0a49cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:03.337542 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23501d80-a666-4b8b-a9ad-b148a0a49cec None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:03.337828 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23501d80-a666-4b8b-a9ad-b148a0a49cec None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:03.338108 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23501d80-a666-4b8b-a9ad-b148a0a49cec None admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:03.338934 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23501d80-a666-4b8b-a9ad-b148a0a49cec None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:03.339247 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23501d80-a666-4b8b-a9ad-b148a0a49cec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:03.340629 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23501d80-a666-4b8b-a9ad-b148a0a49cec None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:03.354570 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 242/480] 10.222.0.15 () {56 vars in 1111 bytes} [Tue May 31 14:30:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:04.619307 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368ed064-971a-4c45-859c-aa9933355637 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:04.619796 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368ed064-971a-4c45-859c-aa9933355637 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:04.619796 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368ed064-971a-4c45-859c-aa9933355637 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:04.621407 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 239/481] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:30:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:30:04.631792 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be89df31-25b6-4ad2-8f2b-09bf9744a2f7 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:04.632201 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be89df31-25b6-4ad2-8f2b-09bf9744a2f7 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:04.632372 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be89df31-25b6-4ad2-8f2b-09bf9744a2f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:04.659714 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-be89df31-25b6-4ad2-8f2b-09bf9744a2f7 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:30:04.661171 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-be89df31-25b6-4ad2-8f2b-09bf9744a2f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:30:04.736656 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:04.742878 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 243/482] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:30:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 14:30:04.767115 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368ed064-971a-4c45-859c-aa9933355637 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:04.829475 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:04.894905 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed443ba-7172-427a-b154-0cdd42e1a039 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:04.895208 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed443ba-7172-427a-b154-0cdd42e1a039 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:04.895388 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed443ba-7172-427a-b154-0cdd42e1a039 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:04.896690 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368ed064-971a-4c45-859c-aa9933355637 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:04.896986 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 244/483] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:30:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 31 14:30:04.902043 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc43fe4d-9ff4-4e97-9341-0260a987868e None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:04.902329 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc43fe4d-9ff4-4e97-9341-0260a987868e None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:04.902632 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc43fe4d-9ff4-4e97-9341-0260a987868e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:04.927574 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-bc43fe4d-9ff4-4e97-9341-0260a987868e None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:30:04.928796 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-bc43fe4d-9ff4-4e97-9341-0260a987868e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:30:04.969373 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fd3854-d585-455b-aa05-aee9564b1470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:04.970169 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd3854-d585-455b-aa05-aee9564b1470 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:04.970452 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd3854-d585-455b-aa05-aee9564b1470 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:04.970750 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd3854-d585-455b-aa05-aee9564b1470 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:04.986039 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fd3854-d585-455b-aa05-aee9564b1470 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 14:30:04.994481 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-d2fd3854-d585-455b-aa05-aee9564b1470 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 31 14:30:04.994481 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:04.994481 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:04.994481 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:04.994481 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:04.994481 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:04.994481 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:04.994481 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:04.994481 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:04.994481 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:04.994481 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:04.994481 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:04.994481 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 14:30:04.994481 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 14:30:04.994481 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 14:30:04.994481 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 14:30:04.995437 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 14:30:04.995437 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 14:30:04.995437 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 14:30:04.995437 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 14:30:04.995437 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:04.995437 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:04.995437 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:04.995437 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:04.995437 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:04.995437 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:04.995437 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:04.995437 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:30:04.995437 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:04.995437 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:04.995437 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:04.995437 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:04.996430 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:04.996430 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:04.996430 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:04.996430 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:04.996430 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 14:30:04.996430 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 14:30:04.996430 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 14:30:04.996430 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 14:30:04.996430 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 14:30:04.996430 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 14:30:04.996430 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 31 14:30:04.996430 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:30:04.996430 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 240/484] 10.222.0.15 () {56 vars in 1102 bytes} [Tue May 31 14:30:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:05.007597 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fd3854-d585-455b-aa05-aee9564b1470 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:05.029039 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 245/485] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:30:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 31 14:30:05.060267 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc43fe4d-9ff4-4e97-9341-0260a987868e None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:05.211981 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fd3854-d585-455b-aa05-aee9564b1470 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:05.219656 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:05.244688 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc43fe4d-9ff4-4e97-9341-0260a987868e None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:05.269329 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22b1c45-235f-4b5e-9b80-1904171d0041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:05.270006 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b1c45-235f-4b5e-9b80-1904171d0041 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:05.270287 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b1c45-235f-4b5e-9b80-1904171d0041 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:05.270581 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b1c45-235f-4b5e-9b80-1904171d0041 None admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:05.271316 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22b1c45-235f-4b5e-9b80-1904171d0041 None admin] RBAC: Adding query filter params (name=service) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:05.271618 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22b1c45-235f-4b5e-9b80-1904171d0041 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:05.272984 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22b1c45-235f-4b5e-9b80-1904171d0041 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:05.298534 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 241/486] 10.222.0.15 () {56 vars in 1103 bytes} [Tue May 31 14:30:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:05.303778 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22b1c45-235f-4b5e-9b80-1904171d0041 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:05.415070 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22b1c45-235f-4b5e-9b80-1904171d0041 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:05.487017 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:05.488915 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dc4331-53a8-46f3-8cd2-7694588be2b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:05.489776 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dc4331-53a8-46f3-8cd2-7694588be2b4 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:05.490003 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dc4331-53a8-46f3-8cd2-7694588be2b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:05.490283 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dc4331-53a8-46f3-8cd2-7694588be2b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:05.500618 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21704bc0-7793-4f0b-bc5a-8da4a87b736c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:05.505793 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21704bc0-7793-4f0b-bc5a-8da4a87b736c None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:05.505793 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21704bc0-7793-4f0b-bc5a-8da4a87b736c None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:05.505793 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21704bc0-7793-4f0b-bc5a-8da4a87b736c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:05.513061 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dc4331-53a8-46f3-8cd2-7694588be2b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:05.514724 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dc4331-53a8-46f3-8cd2-7694588be2b4 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:05.521848 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21704bc0-7793-4f0b-bc5a-8da4a87b736c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 14:30:05.534720 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-21704bc0-7793-4f0b-bc5a-8da4a87b736c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 31 14:30:05.534720 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:05.534720 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:05.534720 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:05.534720 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:05.534720 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:05.534720 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:05.534720 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:05.534720 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:05.534720 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:05.534720 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:05.534720 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:05.534720 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 14:30:05.534720 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 14:30:05.534720 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 14:30:05.534720 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 14:30:05.535896 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 14:30:05.535896 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 14:30:05.535896 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 14:30:05.535896 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 14:30:05.535896 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:05.535896 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:05.535896 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:05.535896 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:05.535896 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:05.535896 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:05.535896 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:05.535896 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:30:05.535896 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:05.535896 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:05.535896 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:05.535896 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:05.536677 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:05.536677 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:05.536677 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:05.536677 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:05.536677 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 14:30:05.536677 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 14:30:05.536677 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 14:30:05.536677 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 14:30:05.536677 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 14:30:05.536677 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 14:30:05.536677 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 31 14:30:05.536677 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:30:05.536677 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 246/487] 10.222.0.15 () {56 vars in 1102 bytes} [Tue May 31 14:30:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 477 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 14:30:05.544658 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21704bc0-7793-4f0b-bc5a-8da4a87b736c None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:05.562575 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-83dc4331-53a8-46f3-8cd2-7694588be2b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:05.562575 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:05.562575 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:05.562575 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:05.562575 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:05.562575 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:05.562575 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:05.562575 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:05.562575 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:05.562575 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:05.562575 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:05.562575 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:05.562575 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 14:30:05.562575 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 14:30:05.562575 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 14:30:05.563469 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 14:30:05.563469 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:05.563469 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:05.563469 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:05.563469 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:05.563469 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:05.563469 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:05.563469 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:05.563469 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:30:05.563469 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:05.563469 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:05.563469 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:05.563469 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:05.563469 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:05.563469 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:05.563469 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:05.563469 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:05.564327 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 14:30:05.564327 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 14:30:05.564327 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:05.564327 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:30:05.564327 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 242/488] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:30:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 14:30:05.564327 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dc4331-53a8-46f3-8cd2-7694588be2b4 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:05.604395 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:05.666443 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21704bc0-7793-4f0b-bc5a-8da4a87b736c None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:05.695380 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dc4331-53a8-46f3-8cd2-7694588be2b4 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:05.716979 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4804dbab-3c7c-4b56-87a3-42e6d107f2d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:05.717656 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4804dbab-3c7c-4b56-87a3-42e6d107f2d2 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:05.717948 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4804dbab-3c7c-4b56-87a3-42e6d107f2d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:05.718227 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4804dbab-3c7c-4b56-87a3-42e6d107f2d2 None admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:05.719017 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4804dbab-3c7c-4b56-87a3-42e6d107f2d2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:05.719329 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4804dbab-3c7c-4b56-87a3-42e6d107f2d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:05.721627 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4804dbab-3c7c-4b56-87a3-42e6d107f2d2 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:05.735392 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 247/489] 10.222.0.15 () {56 vars in 1103 bytes} [Tue May 31 14:30:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 14:30:05.736172 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c64ac34-9c3a-4e2c-956b-26c5f2fd26e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:05.736781 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e7c624-b57a-4e38-baf2-c12b8cea791a None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:05.736936 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c64ac34-9c3a-4e2c-956b-26c5f2fd26e7 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:05.737116 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e7c624-b57a-4e38-baf2-c12b8cea791a None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:05.737339 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c64ac34-9c3a-4e2c-956b-26c5f2fd26e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:05.737479 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e7c624-b57a-4e38-baf2-c12b8cea791a None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:05.737737 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c64ac34-9c3a-4e2c-956b-26c5f2fd26e7 None admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:05.738542 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c64ac34-9c3a-4e2c-956b-26c5f2fd26e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:05.738826 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 248/490] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:30:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:30:05.739012 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c64ac34-9c3a-4e2c-956b-26c5f2fd26e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:05.740510 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c64ac34-9c3a-4e2c-956b-26c5f2fd26e7 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:05.742051 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e7c624-b57a-4e38-baf2-c12b8cea791a None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:05.754450 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 243/491] 10.222.0.15 () {56 vars in 1109 bytes} [Tue May 31 14:30:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:05.759085 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f79c09e-b775-4086-96bf-76a7791b3746 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:05.759085 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f79c09e-b775-4086-96bf-76a7791b3746 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:05.759085 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f79c09e-b775-4086-96bf-76a7791b3746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:05.776262 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-3f79c09e-b775-4086-96bf-76a7791b3746 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:30:05.777584 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-3f79c09e-b775-4086-96bf-76a7791b3746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:30:05.816743 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:05.856432 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 244/492] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:30:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 14:30:05.857263 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f79c09e-b775-4086-96bf-76a7791b3746 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:05.875760 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:05.888805 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e7c624-b57a-4e38-baf2-c12b8cea791a None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:05.937600 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c89540a-ed4c-466f-ac5b-2dbc51304d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:05.938408 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c89540a-ed4c-466f-ac5b-2dbc51304d3a None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:05.938718 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c89540a-ed4c-466f-ac5b-2dbc51304d3a None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:05.938994 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c89540a-ed4c-466f-ac5b-2dbc51304d3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:05.950231 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c89540a-ed4c-466f-ac5b-2dbc51304d3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:05.951796 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c89540a-ed4c-466f-ac5b-2dbc51304d3a None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:05.969718 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-1c89540a-ed4c-466f-ac5b-2dbc51304d3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:05.969718 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:05.969718 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:05.969718 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:05.969718 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:05.969718 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:05.969718 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:05.969718 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:05.969718 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:05.969718 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:05.969718 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:05.969718 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:05.969718 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 14:30:05.969718 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 14:30:05.969718 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 14:30:05.970727 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 14:30:05.970727 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:05.970727 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:05.970727 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:05.970727 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:05.970727 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:05.970727 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:05.970727 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:05.970727 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:30:05.970727 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:05.970727 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:05.970727 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:05.970727 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:05.970727 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:05.970727 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:05.970727 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:05.970727 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:05.971587 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 14:30:05.971587 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 14:30:05.971587 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:05.971587 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:30:05.971587 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 249/493] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:30:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 14:30:05.972293 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c89540a-ed4c-466f-ac5b-2dbc51304d3a None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:05.986167 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f79c09e-b775-4086-96bf-76a7791b3746 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:06.031142 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f115f53a-5cce-489a-885d-143ce3e61123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:06.032853 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f115f53a-5cce-489a-885d-143ce3e61123 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:06.033354 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f115f53a-5cce-489a-885d-143ce3e61123 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:06.033984 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f115f53a-5cce-489a-885d-143ce3e61123 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:06.044352 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f115f53a-5cce-489a-885d-143ce3e61123 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:06.045945 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f115f53a-5cce-489a-885d-143ce3e61123 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:06.062761 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-f115f53a-5cce-489a-885d-143ce3e61123 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 31 14:30:06.062761 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:06.062761 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:06.062761 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:06.062761 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:06.062761 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:06.062761 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:06.062761 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:06.062761 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:06.062761 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:06.062761 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:06.062761 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:06.062761 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 14:30:06.062761 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 14:30:06.062761 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 14:30:06.062761 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 14:30:06.063930 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:06.063930 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:06.063930 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 14:30:06.063930 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 14:30:06.063930 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 14:30:06.063930 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 14:30:06.063930 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:06.063930 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:06.063930 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:06.063930 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:06.063930 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:06.063930 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:30:06.063930 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:06.063930 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:06.063930 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:06.063930 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:06.063930 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:06.063930 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:06.065041 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:06.065041 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:06.065041 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 14:30:06.065041 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 14:30:06.065041 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 14:30:06.065041 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 14:30:06.065041 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 14:30:06.065041 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 14:30:06.065041 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 31 14:30:06.065041 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:30:06.065041 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 245/494] 10.222.0.15 () {56 vars in 1093 bytes} [Tue May 31 14:30:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:06.065041 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f115f53a-5cce-489a-885d-143ce3e61123 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:06.092407 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c89540a-ed4c-466f-ac5b-2dbc51304d3a None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:06.094131 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:06.126679 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0273fb9c-a7e8-4df2-8571-69e000a45c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:06.127483 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0273fb9c-a7e8-4df2-8571-69e000a45c1e None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:06.127773 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0273fb9c-a7e8-4df2-8571-69e000a45c1e None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:06.128061 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0273fb9c-a7e8-4df2-8571-69e000a45c1e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:06.138254 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0273fb9c-a7e8-4df2-8571-69e000a45c1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 14:30:06.146206 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-0273fb9c-a7e8-4df2-8571-69e000a45c1e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 31 14:30:06.146206 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:06.146206 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:06.146206 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:06.146206 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:06.146206 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:06.146206 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:06.146206 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:06.146206 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:06.146206 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:06.146206 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:06.146206 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:06.146206 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 14:30:06.146206 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 14:30:06.146206 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 14:30:06.146206 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 14:30:06.147352 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 14:30:06.147352 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 14:30:06.147352 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 14:30:06.147352 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 14:30:06.147352 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:06.147352 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:06.147352 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:06.147352 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:06.147352 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:06.147352 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:06.147352 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:06.147352 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:30:06.147352 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:06.147352 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:06.147352 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:06.147352 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:06.148895 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:06.148895 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:06.148895 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:06.148895 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:06.148895 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 14:30:06.148895 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 14:30:06.148895 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 14:30:06.148895 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 14:30:06.148895 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 14:30:06.148895 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 14:30:06.148895 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 31 14:30:06.148895 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:30:06.153128 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 250/495] 10.222.0.15 () {56 vars in 1102 bytes} [Tue May 31 14:30:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:06.154501 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f0178c-0438-4f15-b405-5b51d5af7e56 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:06.154819 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f0178c-0438-4f15-b405-5b51d5af7e56 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:06.155102 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f0178c-0438-4f15-b405-5b51d5af7e56 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:06.156440 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 251/496] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:30:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:30:06.157137 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f0178c-0438-4f15-b405-5b51d5af7e56 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:06.159079 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:06.186948 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f115f53a-5cce-489a-885d-143ce3e61123 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:06.221997 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b95a1-950e-47e2-a0fa-1222be2aa9e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:06.222692 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b95a1-950e-47e2-a0fa-1222be2aa9e1 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:06.222991 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b95a1-950e-47e2-a0fa-1222be2aa9e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:06.223268 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b95a1-950e-47e2-a0fa-1222be2aa9e1 None admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:06.223984 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2b95a1-950e-47e2-a0fa-1222be2aa9e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:06.224293 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2b95a1-950e-47e2-a0fa-1222be2aa9e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:06.225656 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2b95a1-950e-47e2-a0fa-1222be2aa9e1 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:06.237677 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 246/497] 10.222.0.15 () {56 vars in 1109 bytes} [Tue May 31 14:30:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:06.238460 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b95a1-950e-47e2-a0fa-1222be2aa9e1 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:06.264513 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f0178c-0438-4f15-b405-5b51d5af7e56 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:06.299452 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a45b8f-c413-4e35-bae4-8971abfa3316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:06.300128 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a45b8f-c413-4e35-bae4-8971abfa3316 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:06.300414 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a45b8f-c413-4e35-bae4-8971abfa3316 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:06.300695 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a45b8f-c413-4e35-bae4-8971abfa3316 None admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:06.301521 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a45b8f-c413-4e35-bae4-8971abfa3316 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:06.301845 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a45b8f-c413-4e35-bae4-8971abfa3316 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:06.303298 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a45b8f-c413-4e35-bae4-8971abfa3316 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:06.337955 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b95a1-950e-47e2-a0fa-1222be2aa9e1 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:06.339389 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 252/498] 10.222.0.15 () {56 vars in 1133 bytes} [Tue May 31 14:30:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:06.340582 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f491d9d0-91e3-476c-a7a5-ef212e30c928 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:06.340872 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f491d9d0-91e3-476c-a7a5-ef212e30c928 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:06.341147 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f491d9d0-91e3-476c-a7a5-ef212e30c928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:06.357526 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-f491d9d0-91e3-476c-a7a5-ef212e30c928 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:30:06.358749 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-f491d9d0-91e3-476c-a7a5-ef212e30c928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:30:06.372709 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:06.372834 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9237fa6-d330-494f-b45c-f1455de6e89e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:06.373504 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9237fa6-d330-494f-b45c-f1455de6e89e None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:06.373790 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9237fa6-d330-494f-b45c-f1455de6e89e None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:06.374059 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9237fa6-d330-494f-b45c-f1455de6e89e None admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:06.374866 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9237fa6-d330-494f-b45c-f1455de6e89e None admin] RBAC: Adding query filter params (name=service) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:06.375174 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9237fa6-d330-494f-b45c-f1455de6e89e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:06.376541 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9237fa6-d330-494f-b45c-f1455de6e89e None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:06.377875 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:06.385412 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 247/499] 10.222.0.15 () {56 vars in 1103 bytes} [Tue May 31 14:30:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:06.386705 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9948aad-195d-49c0-96a4-260e38007911 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:06.386996 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9948aad-195d-49c0-96a4-260e38007911 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:06.392800 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9948aad-195d-49c0-96a4-260e38007911 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:06.392800 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 248/500] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:30:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:30:06.392800 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9948aad-195d-49c0-96a4-260e38007911 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:06.426610 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 253/501] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:30:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 14:30:06.427459 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f491d9d0-91e3-476c-a7a5-ef212e30c928 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:06.488605 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9948aad-195d-49c0-96a4-260e38007911 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:06.523053 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8288675b-6cce-45c1-92dc-fd6c23e51d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:06.524414 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8288675b-6cce-45c1-92dc-fd6c23e51d88 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:06.524719 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8288675b-6cce-45c1-92dc-fd6c23e51d88 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:06.524996 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8288675b-6cce-45c1-92dc-fd6c23e51d88 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:06.532148 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8288675b-6cce-45c1-92dc-fd6c23e51d88 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:06.533589 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8288675b-6cce-45c1-92dc-fd6c23e51d88 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:06.534225 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f491d9d0-91e3-476c-a7a5-ef212e30c928 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:06.549859 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-8288675b-6cce-45c1-92dc-fd6c23e51d88 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 31 14:30:06.549859 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:06.549859 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:06.549859 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:06.549859 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:06.549859 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:06.549859 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:06.549859 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:06.549859 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:06.549859 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:06.549859 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:06.549859 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:06.549859 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 14:30:06.549859 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 14:30:06.549859 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 14:30:06.549859 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 14:30:06.550962 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:06.550962 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:06.550962 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 14:30:06.550962 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 14:30:06.550962 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 14:30:06.550962 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 14:30:06.550962 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:06.550962 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:06.550962 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:06.550962 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:06.550962 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:06.550962 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:30:06.550962 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:06.550962 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:06.550962 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:06.550962 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:06.550962 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:06.550962 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:06.551923 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:06.551923 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:06.551923 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 14:30:06.551923 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 14:30:06.551923 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 14:30:06.551923 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 14:30:06.551923 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 14:30:06.551923 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 14:30:06.551923 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 31 14:30:06.551923 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:30:06.551923 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 249/502] 10.222.0.15 () {56 vars in 1099 bytes} [Tue May 31 14:30:06 2022] GET /identity/v3/users/cinder => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:06.551923 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8288675b-6cce-45c1-92dc-fd6c23e51d88 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:06.569679 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8b403a-e804-48dc-8a7f-49e2a0da115d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:06.570872 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8b403a-e804-48dc-8a7f-49e2a0da115d None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:06.571157 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8b403a-e804-48dc-8a7f-49e2a0da115d None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:06.571432 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8b403a-e804-48dc-8a7f-49e2a0da115d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:06.589851 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:06.606303 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:06.637152 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8b403a-e804-48dc-8a7f-49e2a0da115d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:06.638703 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8b403a-e804-48dc-8a7f-49e2a0da115d None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:06.650228 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8288675b-6cce-45c1-92dc-fd6c23e51d88 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:06.683789 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8543006a-862e-40c9-b860-7b44cf807904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:06.684567 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8543006a-862e-40c9-b860-7b44cf807904 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:06.684848 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8543006a-862e-40c9-b860-7b44cf807904 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:06.685125 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8543006a-862e-40c9-b860-7b44cf807904 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:06.695975 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8543006a-862e-40c9-b860-7b44cf807904 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:06.697413 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8543006a-862e-40c9-b860-7b44cf807904 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:06.715179 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-8543006a-862e-40c9-b860-7b44cf807904 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:06.715179 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:06.715179 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:06.715179 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:06.715179 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:06.715179 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:06.715179 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:06.715179 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:06.715179 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:06.715179 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:06.715179 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:06.715179 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:06.715179 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 14:30:06.715179 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 14:30:06.715179 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 14:30:06.716070 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 14:30:06.716070 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:06.716070 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:06.716070 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:06.716070 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:06.716070 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:06.716070 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:06.716070 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:06.716070 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:30:06.716070 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:06.716070 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:06.716070 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:06.716070 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:06.716070 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:06.716070 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:06.716070 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:06.716070 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:06.716919 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 14:30:06.716919 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 14:30:06.716919 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:06.716919 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:30:06.716919 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 250/503] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:30:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:06.717539 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874adeaf-8763-46eb-b0ae-d3c4ca6825e3 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:06.717784 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874adeaf-8763-46eb-b0ae-d3c4ca6825e3 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:06.718059 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874adeaf-8763-46eb-b0ae-d3c4ca6825e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:06.733753 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-874adeaf-8763-46eb-b0ae-d3c4ca6825e3 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:30:06.734954 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-874adeaf-8763-46eb-b0ae-d3c4ca6825e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:30:06.735170 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 254/504] 10.222.0.15 () {58 vars in 1282 bytes} [Tue May 31 14:30:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 31 14:30:06.736012 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8b403a-e804-48dc-8a7f-49e2a0da115d None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:06.786056 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:06.800550 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 251/505] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:30:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 14:30:06.801314 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874adeaf-8763-46eb-b0ae-d3c4ca6825e3 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:06.838262 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8b403a-e804-48dc-8a7f-49e2a0da115d None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:06.848108 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:06.870917 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2660ea-61d1-4fca-8ad7-e3f6368991c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:06.871703 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2660ea-61d1-4fca-8ad7-e3f6368991c2 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:06.871986 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2660ea-61d1-4fca-8ad7-e3f6368991c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:06.872266 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2660ea-61d1-4fca-8ad7-e3f6368991c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:06.884067 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2660ea-61d1-4fca-8ad7-e3f6368991c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:06.885514 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2660ea-61d1-4fca-8ad7-e3f6368991c2 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:06.902219 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-eb2660ea-61d1-4fca-8ad7-e3f6368991c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:06.902219 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:06.902219 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:06.902219 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:06.902219 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:06.902219 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:06.902219 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:06.902219 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:06.902219 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:06.902219 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:06.902219 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:06.902219 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:06.902219 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 14:30:06.902219 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 14:30:06.902219 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 14:30:06.903160 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 14:30:06.903160 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:06.903160 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:06.903160 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:06.903160 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:06.903160 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:06.903160 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:06.903160 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:06.903160 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:30:06.903160 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:06.903160 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:06.903160 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:06.903160 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:06.903160 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:06.903160 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:06.903160 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:06.903160 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:06.903993 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 14:30:06.903993 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 14:30:06.903993 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:06.903993 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:30:06.903993 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 255/506] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:30:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:06.904261 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2660ea-61d1-4fca-8ad7-e3f6368991c2 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:06.912127 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874adeaf-8763-46eb-b0ae-d3c4ca6825e3 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:06.947225 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b017b1ff-09a2-4815-bc69-1d7ba8266267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:06.947894 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b017b1ff-09a2-4815-bc69-1d7ba8266267 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:06.948182 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b017b1ff-09a2-4815-bc69-1d7ba8266267 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:06.948458 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b017b1ff-09a2-4815-bc69-1d7ba8266267 None admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:06.949279 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b017b1ff-09a2-4815-bc69-1d7ba8266267 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:06.949591 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b017b1ff-09a2-4815-bc69-1d7ba8266267 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:06.951081 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b017b1ff-09a2-4815-bc69-1d7ba8266267 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:06.985675 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 252/507] 10.222.0.15 () {56 vars in 1137 bytes} [Tue May 31 14:30:06 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:06.986488 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b017b1ff-09a2-4815-bc69-1d7ba8266267 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:07.002594 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2660ea-61d1-4fca-8ad7-e3f6368991c2 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:07.004110 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:07.037026 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f219a5b-dc72-48af-9557-769a40decf43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:07.037687 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f219a5b-dc72-48af-9557-769a40decf43 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:07.037968 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f219a5b-dc72-48af-9557-769a40decf43 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:07.038240 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f219a5b-dc72-48af-9557-769a40decf43 None admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:07.039019 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f219a5b-dc72-48af-9557-769a40decf43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:07.039320 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f219a5b-dc72-48af-9557-769a40decf43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:07.040669 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f219a5b-dc72-48af-9557-769a40decf43 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:07.051892 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 256/508] 10.222.0.15 () {56 vars in 1109 bytes} [Tue May 31 14:30:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:07.053010 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f219a5b-dc72-48af-9557-769a40decf43 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:07.081429 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:07.087160 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b017b1ff-09a2-4815-bc69-1d7ba8266267 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:07.121252 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b35f9c-2ea1-4038-9d01-3dcb01a97c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:07.122037 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b35f9c-2ea1-4038-9d01-3dcb01a97c05 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:07.122322 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b35f9c-2ea1-4038-9d01-3dcb01a97c05 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:07.122628 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b35f9c-2ea1-4038-9d01-3dcb01a97c05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:07.133509 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b35f9c-2ea1-4038-9d01-3dcb01a97c05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:07.135019 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b35f9c-2ea1-4038-9d01-3dcb01a97c05 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:07.149755 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f219a5b-dc72-48af-9557-769a40decf43 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:07.152517 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-77b35f9c-2ea1-4038-9d01-3dcb01a97c05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:07.152517 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:07.152517 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:07.152517 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:07.152517 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:07.152517 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:07.152517 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:07.152517 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:07.152517 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:07.152517 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:07.152517 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:07.152517 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:07.152517 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 14:30:07.152517 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 14:30:07.152517 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 14:30:07.153353 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 14:30:07.153353 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:07.153353 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:07.153353 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:07.153353 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:07.153353 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:07.153353 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:07.153353 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:07.153353 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:30:07.153353 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:07.153353 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:07.153353 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:07.153353 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:07.153353 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:07.153353 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:07.153353 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:07.153353 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:07.154194 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 14:30:07.154194 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 14:30:07.154194 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:07.154194 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:30:07.154194 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 253/509] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:30:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:07.154465 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b35f9c-2ea1-4038-9d01-3dcb01a97c05 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:07.188295 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d649c2df-8ffd-4ed7-979b-2e826709365c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:07.189085 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d649c2df-8ffd-4ed7-979b-2e826709365c None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:07.189366 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d649c2df-8ffd-4ed7-979b-2e826709365c None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:07.189640 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d649c2df-8ffd-4ed7-979b-2e826709365c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:07.199572 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d649c2df-8ffd-4ed7-979b-2e826709365c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 14:30:07.207271 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-d649c2df-8ffd-4ed7-979b-2e826709365c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 31 14:30:07.207271 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:07.207271 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:07.207271 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:07.207271 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:07.207271 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:07.207271 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:07.207271 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:07.207271 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:07.207271 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:07.207271 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:07.207271 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:07.207271 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 14:30:07.207271 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 14:30:07.207271 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 14:30:07.207271 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 14:30:07.208172 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 14:30:07.208172 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 14:30:07.208172 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 14:30:07.208172 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 14:30:07.208172 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:07.208172 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:07.208172 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:07.208172 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:07.208172 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:07.208172 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:07.208172 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:07.208172 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:30:07.208172 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:07.208172 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:07.208172 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:07.208172 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:07.208956 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:07.208956 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:07.208956 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:07.208956 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:07.208956 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 14:30:07.208956 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 14:30:07.208956 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 14:30:07.208956 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 14:30:07.208956 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 14:30:07.208956 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 14:30:07.208956 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 31 14:30:07.208956 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:30:07.208956 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 257/510] 10.222.0.15 () {56 vars in 1102 bytes} [Tue May 31 14:30:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:07.209630 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d649c2df-8ffd-4ed7-979b-2e826709365c None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:07.236281 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:07.261915 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b35f9c-2ea1-4038-9d01-3dcb01a97c05 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:07.299777 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd92aea-63e0-4c7f-a174-8771290c0aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:07.300438 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd92aea-63e0-4c7f-a174-8771290c0aa1 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:07.300840 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd92aea-63e0-4c7f-a174-8771290c0aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:07.301119 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd92aea-63e0-4c7f-a174-8771290c0aa1 None admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:07.301833 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd92aea-63e0-4c7f-a174-8771290c0aa1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:07.302183 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd92aea-63e0-4c7f-a174-8771290c0aa1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:07.303540 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd92aea-63e0-4c7f-a174-8771290c0aa1 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:07.313670 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d649c2df-8ffd-4ed7-979b-2e826709365c None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:07.317167 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 254/511] 10.222.0.15 () {56 vars in 1109 bytes} [Tue May 31 14:30:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:07.317994 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd92aea-63e0-4c7f-a174-8771290c0aa1 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:07.328824 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:07.348438 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce8efbe-3ad4-4ed0-aec2-fed6958dc0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:07.349082 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce8efbe-3ad4-4ed0-aec2-fed6958dc0d2 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:07.349364 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce8efbe-3ad4-4ed0-aec2-fed6958dc0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:07.349642 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce8efbe-3ad4-4ed0-aec2-fed6958dc0d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:07.416194 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd92aea-63e0-4c7f-a174-8771290c0aa1 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:07.417206 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce8efbe-3ad4-4ed0-aec2-fed6958dc0d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:07.418737 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce8efbe-3ad4-4ed0-aec2-fed6958dc0d2 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:07.441480 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:07.449575 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024acfea-5f2b-4b3f-963a-123529af82de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:07.450354 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024acfea-5f2b-4b3f-963a-123529af82de None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:07.450667 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024acfea-5f2b-4b3f-963a-123529af82de None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:07.450942 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024acfea-5f2b-4b3f-963a-123529af82de None admin] PATH_INFO: `/v3/users/glance` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:07.457824 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024acfea-5f2b-4b3f-963a-123529af82de None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:07.459286 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024acfea-5f2b-4b3f-963a-123529af82de None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:07.474657 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-024acfea-5f2b-4b3f-963a-123529af82de None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 31 14:30:07.474657 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:07.474657 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:07.474657 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:07.474657 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:07.474657 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:07.474657 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:07.474657 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:07.474657 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:07.474657 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:07.474657 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:07.474657 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:07.474657 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 14:30:07.474657 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 14:30:07.474657 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 14:30:07.474657 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 14:30:07.475559 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:07.475559 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:07.475559 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 14:30:07.475559 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 14:30:07.475559 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 14:30:07.475559 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 14:30:07.475559 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:07.475559 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:07.475559 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:07.475559 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:07.475559 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:07.475559 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:30:07.475559 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:07.475559 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:07.475559 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:07.475559 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:07.475559 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:07.475559 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:07.477217 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:07.477217 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:07.477217 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 14:30:07.477217 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 14:30:07.477217 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 14:30:07.477217 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 14:30:07.477217 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 14:30:07.477217 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 14:30:07.477217 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 31 14:30:07.477217 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:30:07.477217 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 255/512] 10.222.0.15 () {56 vars in 1099 bytes} [Tue May 31 14:30:07 2022] GET /identity/v3/users/glance => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:07.478283 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024acfea-5f2b-4b3f-963a-123529af82de None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:07.516633 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 258/513] 10.222.0.15 () {58 vars in 1282 bytes} [Tue May 31 14:30:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 31 14:30:07.517460 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce8efbe-3ad4-4ed0-aec2-fed6958dc0d2 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:07.546273 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:07.584285 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024acfea-5f2b-4b3f-963a-123529af82de None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:07.614502 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce8efbe-3ad4-4ed0-aec2-fed6958dc0d2 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:07.617901 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98d5998-6bca-42cc-aa8f-01aa79fc6457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:07.618582 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d5998-6bca-42cc-aa8f-01aa79fc6457 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:07.618860 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d5998-6bca-42cc-aa8f-01aa79fc6457 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:07.619134 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d5998-6bca-42cc-aa8f-01aa79fc6457 None admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:07.619843 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98d5998-6bca-42cc-aa8f-01aa79fc6457 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:07.620148 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98d5998-6bca-42cc-aa8f-01aa79fc6457 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:07.621525 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98d5998-6bca-42cc-aa8f-01aa79fc6457 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:07.633134 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 256/514] 10.222.0.15 () {56 vars in 1109 bytes} [Tue May 31 14:30:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:07.633919 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98d5998-6bca-42cc-aa8f-01aa79fc6457 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:07.636084 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:07.647924 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec08c1c9-5d98-4bff-a9cb-3776d1a828a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:07.649121 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec08c1c9-5d98-4bff-a9cb-3776d1a828a8 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:07.649405 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec08c1c9-5d98-4bff-a9cb-3776d1a828a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:07.649684 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec08c1c9-5d98-4bff-a9cb-3776d1a828a8 None admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:07.650430 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec08c1c9-5d98-4bff-a9cb-3776d1a828a8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:07.650782 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec08c1c9-5d98-4bff-a9cb-3776d1a828a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:07.652154 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec08c1c9-5d98-4bff-a9cb-3776d1a828a8 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:07.659890 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 259/515] 10.222.0.15 () {56 vars in 1103 bytes} [Tue May 31 14:30:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:07.661080 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec08c1c9-5d98-4bff-a9cb-3776d1a828a8 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:07.733988 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98d5998-6bca-42cc-aa8f-01aa79fc6457 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:07.757050 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec08c1c9-5d98-4bff-a9cb-3776d1a828a8 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:07.759028 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:07.766383 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4831b27-f360-446b-8856-ce1c6fd38fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:07.767085 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4831b27-f360-446b-8856-ce1c6fd38fa6 None admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:07.767363 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4831b27-f360-446b-8856-ce1c6fd38fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:07.768488 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4831b27-f360-446b-8856-ce1c6fd38fa6 None admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:07.768488 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4831b27-f360-446b-8856-ce1c6fd38fa6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:07.769788 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4831b27-f360-446b-8856-ce1c6fd38fa6 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:07.790916 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e40dde9-89a3-4f54-9ad4-c38fcc164741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:07.791633 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e40dde9-89a3-4f54-9ad4-c38fcc164741 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:07.791916 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e40dde9-89a3-4f54-9ad4-c38fcc164741 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:07.792188 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e40dde9-89a3-4f54-9ad4-c38fcc164741 None admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:07.793005 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e40dde9-89a3-4f54-9ad4-c38fcc164741 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:07.793307 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e40dde9-89a3-4f54-9ad4-c38fcc164741 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:07.794733 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e40dde9-89a3-4f54-9ad4-c38fcc164741 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:07.811486 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 260/516] 10.222.0.15 () {56 vars in 1137 bytes} [Tue May 31 14:30:07 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:07.812253 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e40dde9-89a3-4f54-9ad4-c38fcc164741 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:07.853218 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:07.867135 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 257/517] 10.222.0.15 () {60 vars in 1132 bytes} [Tue May 31 14:30:07 2022] POST /identity/v3/users => generated 247 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:30:07.868066 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4831b27-f360-446b-8856-ce1c6fd38fa6 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:07.923753 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e40dde9-89a3-4f54-9ad4-c38fcc164741 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:07.966890 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17658223-9a1b-40f2-8967-03b18e9255b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:07.967706 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17658223-9a1b-40f2-8967-03b18e9255b5 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:07.967992 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17658223-9a1b-40f2-8967-03b18e9255b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:07.968267 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17658223-9a1b-40f2-8967-03b18e9255b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:07.980357 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17658223-9a1b-40f2-8967-03b18e9255b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:07.981985 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17658223-9a1b-40f2-8967-03b18e9255b5 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:07.990102 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4831b27-f360-446b-8856-ce1c6fd38fa6 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:08.002082 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-17658223-9a1b-40f2-8967-03b18e9255b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:08.002082 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:08.002082 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:08.002082 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:08.002082 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:08.002082 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:08.002082 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:08.002082 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:08.002082 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:08.002082 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:08.002082 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:08.002082 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:08.002082 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 14:30:08.002082 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 14:30:08.002082 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 14:30:08.003081 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 14:30:08.003081 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:08.003081 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:08.003081 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:08.003081 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:08.003081 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:08.003081 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:08.003081 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:08.003081 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:30:08.003081 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:08.003081 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:08.003081 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:08.003081 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:08.003081 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:08.003081 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:08.003081 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:08.003081 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:08.004059 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 14:30:08.004059 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 14:30:08.004059 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:08.004059 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:30:08.004296 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 261/518] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:30:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:08.005067 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17658223-9a1b-40f2-8967-03b18e9255b5 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:08.031240 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ae64f5-a5c1-4736-9193-ee1a01535db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:08.032064 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ae64f5-a5c1-4736-9193-ee1a01535db2 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:08.032353 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ae64f5-a5c1-4736-9193-ee1a01535db2 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:08.032635 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ae64f5-a5c1-4736-9193-ee1a01535db2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:08.041869 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ae64f5-a5c1-4736-9193-ee1a01535db2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:08.043396 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ae64f5-a5c1-4736-9193-ee1a01535db2 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:08.059450 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-e3ae64f5-a5c1-4736-9193-ee1a01535db2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 14:30:08.059450 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:08.059450 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:08.059450 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:08.059450 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:08.059450 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:08.059450 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:08.059450 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:08.059450 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:08.059450 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:08.059450 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:08.059450 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:08.059450 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 14:30:08.059450 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 14:30:08.059450 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 14:30:08.060356 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 14:30:08.060356 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:08.060356 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:08.060356 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:08.060356 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:08.060356 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:08.060356 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:08.060356 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:08.060356 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:30:08.060356 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:08.060356 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:08.060356 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:08.060356 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:08.060356 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:08.060356 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:08.060356 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:08.060356 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:08.061730 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 14:30:08.061730 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 14:30:08.061730 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 14:30:08.061730 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 14:30:08.061730 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 14:30:08.061730 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 14:30:08.061730 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 14:30:08.061730 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:30:08.061730 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 258/519] 10.222.0.15 () {56 vars in 1111 bytes} [Tue May 31 14:30:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:08.061730 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ae64f5-a5c1-4736-9193-ee1a01535db2 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:08.118197 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:08.119905 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:08.124463 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17658223-9a1b-40f2-8967-03b18e9255b5 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:08.162778 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe3f66e-e7df-4748-b5e4-ded2d754f247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:08.163568 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe3f66e-e7df-4748-b5e4-ded2d754f247 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:08.163847 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe3f66e-e7df-4748-b5e4-ded2d754f247 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:08.170448 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe3f66e-e7df-4748-b5e4-ded2d754f247 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:08.174676 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe3f66e-e7df-4748-b5e4-ded2d754f247 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:08.176125 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe3f66e-e7df-4748-b5e4-ded2d754f247 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:08.180007 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ae64f5-a5c1-4736-9193-ee1a01535db2 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:08.194333 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-cbe3f66e-e7df-4748-b5e4-ded2d754f247 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:08.194333 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:08.194333 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:08.194333 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:08.194333 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:08.194333 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:08.194333 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:08.194333 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:08.194333 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:08.194333 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:08.194333 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:08.194333 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:08.194333 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 14:30:08.194333 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 14:30:08.194333 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 14:30:08.195951 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 14:30:08.195951 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:08.195951 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:08.195951 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:08.195951 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:08.195951 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:08.195951 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:08.195951 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:08.195951 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:30:08.195951 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:08.195951 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:08.195951 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:08.195951 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:08.195951 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:08.195951 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:08.195951 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:08.195951 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:08.196792 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 14:30:08.196792 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 14:30:08.196792 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:08.196792 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:30:08.196792 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 262/520] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:30:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:08.197070 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe3f66e-e7df-4748-b5e4-ded2d754f247 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:08.222212 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8882c342-fd53-4767-a429-d7018c2dec0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:08.223533 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8882c342-fd53-4767-a429-d7018c2dec0a None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:08.224037 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8882c342-fd53-4767-a429-d7018c2dec0a None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:08.225010 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8882c342-fd53-4767-a429-d7018c2dec0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:08.301358 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe3f66e-e7df-4748-b5e4-ded2d754f247 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:08.301757 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8882c342-fd53-4767-a429-d7018c2dec0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:08.303428 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8882c342-fd53-4767-a429-d7018c2dec0a None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:08.343468 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bf6035-14e6-419d-a308-5950d117c752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:08.344254 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bf6035-14e6-419d-a308-5950d117c752 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:08.344534 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bf6035-14e6-419d-a308-5950d117c752 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:08.344811 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bf6035-14e6-419d-a308-5950d117c752 None admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:08.345532 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bf6035-14e6-419d-a308-5950d117c752 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:08.345838 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bf6035-14e6-419d-a308-5950d117c752 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:08.347247 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bf6035-14e6-419d-a308-5950d117c752 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:08.355666 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:08.359166 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 263/521] 10.222.0.15 () {56 vars in 1109 bytes} [Tue May 31 14:30:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:08.360140 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bf6035-14e6-419d-a308-5950d117c752 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:08.371956 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:08.417788 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 259/522] 10.222.0.15 () {58 vars in 1282 bytes} [Tue May 31 14:30:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 31 14:30:08.418997 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8882c342-fd53-4767-a429-d7018c2dec0a None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:08.479373 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bf6035-14e6-419d-a308-5950d117c752 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:08.513959 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33028e5-decc-4b36-baea-65ec073e1cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:08.514642 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33028e5-decc-4b36-baea-65ec073e1cbd None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:08.514929 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33028e5-decc-4b36-baea-65ec073e1cbd None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:08.515203 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33028e5-decc-4b36-baea-65ec073e1cbd None admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:08.515979 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33028e5-decc-4b36-baea-65ec073e1cbd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:08.516284 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33028e5-decc-4b36-baea-65ec073e1cbd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:08.517717 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33028e5-decc-4b36-baea-65ec073e1cbd None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:08.527755 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8882c342-fd53-4767-a429-d7018c2dec0a None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:08.539905 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 264/523] 10.222.0.15 () {56 vars in 1148 bytes} [Tue May 31 14:30:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:08.539905 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33028e5-decc-4b36-baea-65ec073e1cbd None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:08.571751 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceb6bf7-40a5-4c7f-98c1-da6ff9fa7aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:08.572415 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceb6bf7-40a5-4c7f-98c1-da6ff9fa7aff None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:08.572698 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceb6bf7-40a5-4c7f-98c1-da6ff9fa7aff None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:08.572972 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceb6bf7-40a5-4c7f-98c1-da6ff9fa7aff None admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:08.573686 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceb6bf7-40a5-4c7f-98c1-da6ff9fa7aff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:08.573994 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceb6bf7-40a5-4c7f-98c1-da6ff9fa7aff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:08.575392 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceb6bf7-40a5-4c7f-98c1-da6ff9fa7aff None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:08.589040 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 260/524] 10.222.0.15 () {56 vars in 1109 bytes} [Tue May 31 14:30:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:08.589853 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceb6bf7-40a5-4c7f-98c1-da6ff9fa7aff None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:08.595551 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:08.603944 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:08.641592 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33028e5-decc-4b36-baea-65ec073e1cbd None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:08.677388 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88c57ab-f44d-4885-86cb-83bca7a8add1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:08.678276 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88c57ab-f44d-4885-86cb-83bca7a8add1 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:08.678595 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88c57ab-f44d-4885-86cb-83bca7a8add1 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:08.678877 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88c57ab-f44d-4885-86cb-83bca7a8add1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:08.686374 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88c57ab-f44d-4885-86cb-83bca7a8add1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:08.687853 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88c57ab-f44d-4885-86cb-83bca7a8add1 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:08.697018 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceb6bf7-40a5-4c7f-98c1-da6ff9fa7aff None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:08.702308 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-e88c57ab-f44d-4885-86cb-83bca7a8add1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 14:30:08.702308 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:08.702308 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:08.702308 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:08.702308 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:08.702308 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:08.702308 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:08.702308 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:08.702308 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:08.702308 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:08.702308 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:08.702308 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:08.702308 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 14:30:08.702308 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 14:30:08.702308 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 14:30:08.703179 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 14:30:08.703179 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:08.703179 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:08.703179 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:08.703179 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:08.703179 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:08.703179 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:08.703179 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:08.703179 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:30:08.703179 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:08.703179 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:08.703179 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:08.703179 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:08.703179 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:08.703179 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:08.703179 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:08.703179 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:08.704012 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 14:30:08.704012 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 14:30:08.704012 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 14:30:08.704012 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 14:30:08.704012 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 14:30:08.704012 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 14:30:08.704012 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 14:30:08.704012 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:30:08.704012 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 265/525] 10.222.0.15 () {56 vars in 1111 bytes} [Tue May 31 14:30:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:08.705061 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88c57ab-f44d-4885-86cb-83bca7a8add1 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:08.736506 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5420985e-8220-463b-a446-3558e2d91721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:08.737299 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5420985e-8220-463b-a446-3558e2d91721 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:08.737584 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5420985e-8220-463b-a446-3558e2d91721 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:08.737865 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5420985e-8220-463b-a446-3558e2d91721 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:08.749157 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5420985e-8220-463b-a446-3558e2d91721 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:08.750647 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5420985e-8220-463b-a446-3558e2d91721 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:08.768044 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-5420985e-8220-463b-a446-3558e2d91721 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:08.768044 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:08.768044 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:08.768044 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:08.768044 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:08.768044 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:08.768044 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:08.768044 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:08.768044 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:08.768044 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:08.768044 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:08.768044 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:08.768044 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 14:30:08.768044 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 14:30:08.768044 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 14:30:08.768913 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 14:30:08.768913 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:08.768913 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:08.768913 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:08.768913 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:08.768913 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:08.768913 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:08.768913 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:08.768913 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:30:08.768913 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:08.768913 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:08.768913 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:08.768913 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:08.768913 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:08.768913 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:08.768913 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:08.768913 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:08.769753 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 14:30:08.769753 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 14:30:08.769753 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:08.769753 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:30:08.769753 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 261/526] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:30:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:08.770031 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5420985e-8220-463b-a446-3558e2d91721 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:08.821229 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88c57ab-f44d-4885-86cb-83bca7a8add1 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:08.831864 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:08.846519 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:08.855533 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde0b69f-5f0f-4375-a5ef-0efa0cc83a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:08.856226 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde0b69f-5f0f-4375-a5ef-0efa0cc83a15 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:08.856565 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde0b69f-5f0f-4375-a5ef-0efa0cc83a15 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:08.856849 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde0b69f-5f0f-4375-a5ef-0efa0cc83a15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:08.857668 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde0b69f-5f0f-4375-a5ef-0efa0cc83a15 None admin] RBAC: Adding query filter params (role.id=4fa2a9add9bc4786a62e7b5cae3cc051, scope.project.id=ffff4334538649fdba1beb80cad207fa, user.id=b57768d448e345ad8879bf29f21b48ea) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:08.857976 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde0b69f-5f0f-4375-a5ef-0efa0cc83a15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:08.859441 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde0b69f-5f0f-4375-a5ef-0efa0cc83a15 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:08.864891 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 266/527] 10.222.0.15 () {56 vars in 1374 bytes} [Tue May 31 14:30:08 2022] GET /identity/v3/role_assignments?user.id=b57768d448e345ad8879bf29f21b48ea&scope.project.id=ffff4334538649fdba1beb80cad207fa&role.id=4fa2a9add9bc4786a62e7b5cae3cc051 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:08.865658 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde0b69f-5f0f-4375-a5ef-0efa0cc83a15 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:08.897562 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5420985e-8220-463b-a446-3558e2d91721 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:08.955352 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403aa324-8ecd-4bbe-a952-de56a4197a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:08.956481 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403aa324-8ecd-4bbe-a952-de56a4197a0a None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:08.956948 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403aa324-8ecd-4bbe-a952-de56a4197a0a None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:08.957402 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403aa324-8ecd-4bbe-a952-de56a4197a0a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:08.968575 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403aa324-8ecd-4bbe-a952-de56a4197a0a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:08.970479 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403aa324-8ecd-4bbe-a952-de56a4197a0a None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:08.987036 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-403aa324-8ecd-4bbe-a952-de56a4197a0a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 31 14:30:08.987036 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:08.987036 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:08.987036 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:08.987036 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:08.987036 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:08.987036 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:08.987036 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:08.987036 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:08.987036 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:08.987036 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:08.987036 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:08.987036 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 14:30:08.987036 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 14:30:08.987036 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 14:30:08.987036 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 14:30:08.988014 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:08.988014 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:08.988014 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 14:30:08.988014 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 14:30:08.988014 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 14:30:08.988014 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 14:30:08.988014 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:08.988014 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:08.988014 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:08.988014 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:08.988014 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:08.988014 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:30:08.988014 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:08.988014 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:08.988014 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:08.988014 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:08.988014 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:08.988014 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:08.988932 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:08.988932 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:08.988932 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 14:30:08.988932 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 14:30:08.988932 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 14:30:08.988932 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 14:30:08.988932 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 14:30:08.988932 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 14:30:08.988932 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 31 14:30:08.988932 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:30:08.993820 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 262/528] 10.222.0.15 () {56 vars in 1102 bytes} [Tue May 31 14:30:08 2022] GET /identity/v3/users/neutron => generated 85 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:08.994987 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403aa324-8ecd-4bbe-a952-de56a4197a0a None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:08.997685 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde0b69f-5f0f-4375-a5ef-0efa0cc83a15 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:09.050749 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244a05f1-57a5-44ed-ba97-f5bffcf17cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:09.051800 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244a05f1-57a5-44ed-ba97-f5bffcf17cdb None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:09.052506 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244a05f1-57a5-44ed-ba97-f5bffcf17cdb None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:09.053390 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244a05f1-57a5-44ed-ba97-f5bffcf17cdb None admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:09.054424 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244a05f1-57a5-44ed-ba97-f5bffcf17cdb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:09.054973 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244a05f1-57a5-44ed-ba97-f5bffcf17cdb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:09.057325 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244a05f1-57a5-44ed-ba97-f5bffcf17cdb None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:09.075275 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 267/529] 10.222.0.15 () {56 vars in 1148 bytes} [Tue May 31 14:30:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:09.076611 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244a05f1-57a5-44ed-ba97-f5bffcf17cdb None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:09.116242 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403aa324-8ecd-4bbe-a952-de56a4197a0a None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:09.136748 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:09.139016 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:09.162542 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9796cb69-3dae-45f3-bf1f-cdb97dd962da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:09.163162 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9796cb69-3dae-45f3-bf1f-cdb97dd962da None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:09.163448 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9796cb69-3dae-45f3-bf1f-cdb97dd962da None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:09.163764 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9796cb69-3dae-45f3-bf1f-cdb97dd962da None admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:09.165020 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9796cb69-3dae-45f3-bf1f-cdb97dd962da None admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:09.165329 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9796cb69-3dae-45f3-bf1f-cdb97dd962da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:09.166737 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9796cb69-3dae-45f3-bf1f-cdb97dd962da None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:09.179757 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 263/530] 10.222.0.15 () {56 vars in 1109 bytes} [Tue May 31 14:30:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:09.184631 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9796cb69-3dae-45f3-bf1f-cdb97dd962da None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:09.205114 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244a05f1-57a5-44ed-ba97-f5bffcf17cdb None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:09.246628 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4089d6e5-14f6-4259-b499-0c10dbf2446f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:09.247860 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4089d6e5-14f6-4259-b499-0c10dbf2446f None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:09.248364 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4089d6e5-14f6-4259-b499-0c10dbf2446f None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:09.248830 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4089d6e5-14f6-4259-b499-0c10dbf2446f None admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:09.250245 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4089d6e5-14f6-4259-b499-0c10dbf2446f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:09.250788 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4089d6e5-14f6-4259-b499-0c10dbf2446f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:09.252527 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4089d6e5-14f6-4259-b499-0c10dbf2446f None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:09.277483 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 268/531] 10.222.0.15 () {56 vars in 1139 bytes} [Tue May 31 14:30:09 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:09.279573 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4089d6e5-14f6-4259-b499-0c10dbf2446f None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:09.286147 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9796cb69-3dae-45f3-bf1f-cdb97dd962da None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:09.322317 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326819b9-4219-44bb-9774-296c612891f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:09.322519 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326819b9-4219-44bb-9774-296c612891f5 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:09.322752 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326819b9-4219-44bb-9774-296c612891f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:09.322991 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326819b9-4219-44bb-9774-296c612891f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:09.323814 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326819b9-4219-44bb-9774-296c612891f5 None admin] RBAC: Adding query filter params (role.id=4fa2a9add9bc4786a62e7b5cae3cc051, scope.project.id=ffff4334538649fdba1beb80cad207fa, user.id=afbf718dcd9b4741a926b0a2321bd53e) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:09.324184 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326819b9-4219-44bb-9774-296c612891f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:09.325690 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326819b9-4219-44bb-9774-296c612891f5 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:09.335369 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 264/532] 10.222.0.15 () {56 vars in 1374 bytes} [Tue May 31 14:30:09 2022] GET /identity/v3/role_assignments?user.id=afbf718dcd9b4741a926b0a2321bd53e&scope.project.id=ffff4334538649fdba1beb80cad207fa&role.id=4fa2a9add9bc4786a62e7b5cae3cc051 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:09.335369 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326819b9-4219-44bb-9774-296c612891f5 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:09.433381 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:09.435016 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4089d6e5-14f6-4259-b499-0c10dbf2446f None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:09.448544 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:09.475074 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9e9d10-e9bb-42ec-b0fa-64d21ad2e249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:09.476043 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9e9d10-e9bb-42ec-b0fa-64d21ad2e249 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:09.476734 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9e9d10-e9bb-42ec-b0fa-64d21ad2e249 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:09.477024 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9e9d10-e9bb-42ec-b0fa-64d21ad2e249 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:09.485352 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9e9d10-e9bb-42ec-b0fa-64d21ad2e249 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:09.487018 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9e9d10-e9bb-42ec-b0fa-64d21ad2e249 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:09.505187 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-de9e9d10-e9bb-42ec-b0fa-64d21ad2e249 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 14:30:09.505187 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:09.505187 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:09.505187 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:09.505187 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:09.505187 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:09.505187 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:09.505187 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:09.505187 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:09.505187 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:09.505187 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:09.505187 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:09.505187 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 14:30:09.505187 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 14:30:09.505187 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 14:30:09.506101 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 14:30:09.506101 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:09.506101 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:09.506101 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:09.506101 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:09.506101 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:09.506101 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:09.506101 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:09.506101 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:30:09.506101 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:09.506101 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:09.506101 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:09.506101 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:09.506101 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:09.506101 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:09.506101 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:09.506101 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:09.506989 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 14:30:09.506989 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 14:30:09.506989 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 14:30:09.506989 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 14:30:09.506989 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 14:30:09.506989 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 14:30:09.506989 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 14:30:09.506989 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:30:09.507394 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 269/533] 10.222.0.15 () {56 vars in 1111 bytes} [Tue May 31 14:30:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:09.519655 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9e9d10-e9bb-42ec-b0fa-64d21ad2e249 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:09.542501 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326819b9-4219-44bb-9774-296c612891f5 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:09.584699 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dbdc42-16bd-4f90-9ca0-fa30c6713ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:09.585413 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dbdc42-16bd-4f90-9ca0-fa30c6713ace None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:09.585704 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dbdc42-16bd-4f90-9ca0-fa30c6713ace None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:09.586533 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dbdc42-16bd-4f90-9ca0-fa30c6713ace None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:09.647899 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9e9d10-e9bb-42ec-b0fa-64d21ad2e249 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:09.716776 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dbdc42-16bd-4f90-9ca0-fa30c6713ace None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:09.718979 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e94e870-e85d-4d9c-a804-b0bef6f06b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:09.719645 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e94e870-e85d-4d9c-a804-b0bef6f06b8e None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:09.719929 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e94e870-e85d-4d9c-a804-b0bef6f06b8e None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:09.720202 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e94e870-e85d-4d9c-a804-b0bef6f06b8e None admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:09.720992 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e94e870-e85d-4d9c-a804-b0bef6f06b8e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:09.721300 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e94e870-e85d-4d9c-a804-b0bef6f06b8e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:09.722760 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e94e870-e85d-4d9c-a804-b0bef6f06b8e None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:09.723996 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dbdc42-16bd-4f90-9ca0-fa30c6713ace None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:09.748577 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 270/534] 10.222.0.15 () {56 vars in 1148 bytes} [Tue May 31 14:30:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:09.755828 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e94e870-e85d-4d9c-a804-b0bef6f06b8e None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:09.803223 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:09.806903 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:09.914580 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 265/535] 10.222.0.15 () {58 vars in 1282 bytes} [Tue May 31 14:30:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 579 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 31 14:30:09.917120 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dbdc42-16bd-4f90-9ca0-fa30c6713ace None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:09.925818 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e94e870-e85d-4d9c-a804-b0bef6f06b8e None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:10.002041 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dcc211-fa5f-4ba4-9e17-b80c166430a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:10.003098 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dcc211-fa5f-4ba4-9e17-b80c166430a7 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:10.003627 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dcc211-fa5f-4ba4-9e17-b80c166430a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:10.004095 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dcc211-fa5f-4ba4-9e17-b80c166430a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:10.005214 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dcc211-fa5f-4ba4-9e17-b80c166430a7 None admin] RBAC: Adding query filter params (role.id=4fa2a9add9bc4786a62e7b5cae3cc051, scope.project.id=ffff4334538649fdba1beb80cad207fa, user.id=14ba98b007cc4ae1b20e7f261824b77c) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:10.005746 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dcc211-fa5f-4ba4-9e17-b80c166430a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:10.007516 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dcc211-fa5f-4ba4-9e17-b80c166430a7 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:10.025786 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 271/536] 10.222.0.15 () {56 vars in 1374 bytes} [Tue May 31 14:30:09 2022] GET /identity/v3/role_assignments?user.id=14ba98b007cc4ae1b20e7f261824b77c&scope.project.id=ffff4334538649fdba1beb80cad207fa&role.id=4fa2a9add9bc4786a62e7b5cae3cc051 => generated 259 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 14:30:10.030883 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dbdc42-16bd-4f90-9ca0-fa30c6713ace None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:10.068840 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00db42e8-05f8-4ee0-9c80-795663b56231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:10.069671 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00db42e8-05f8-4ee0-9c80-795663b56231 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:10.069965 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00db42e8-05f8-4ee0-9c80-795663b56231 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:10.070307 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00db42e8-05f8-4ee0-9c80-795663b56231 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:10.081974 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:10.083359 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00db42e8-05f8-4ee0-9c80-795663b56231 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:10.084906 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00db42e8-05f8-4ee0-9c80-795663b56231 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:10.104373 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-00db42e8-05f8-4ee0-9c80-795663b56231 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:10.104373 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:10.104373 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:10.104373 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:10.104373 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:10.104373 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:10.104373 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:10.104373 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:10.104373 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:10.104373 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:10.104373 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:10.104373 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:10.104373 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 14:30:10.104373 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 14:30:10.104373 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 14:30:10.108057 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 14:30:10.108057 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:10.108057 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:10.108057 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:10.108057 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:10.108057 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:10.108057 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:10.108057 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:10.108057 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:30:10.108057 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:10.108057 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:10.108057 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:10.108057 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:10.108057 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:10.108057 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:10.108057 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:10.108057 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:10.108894 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 14:30:10.108894 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 14:30:10.108894 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:10.108894 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:30:10.108894 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 266/537] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:30:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 14:30:10.111244 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dcc211-fa5f-4ba4-9e17-b80c166430a7 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:10.214820 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:10.224810 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dcc211-fa5f-4ba4-9e17-b80c166430a7 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:10.281153 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337cc5ac-013e-491b-b4fc-2b7f9386232d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:10.281826 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337cc5ac-013e-491b-b4fc-2b7f9386232d None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:10.282120 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337cc5ac-013e-491b-b4fc-2b7f9386232d None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:10.282403 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337cc5ac-013e-491b-b4fc-2b7f9386232d None admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:10.283196 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337cc5ac-013e-491b-b4fc-2b7f9386232d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:10.283512 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337cc5ac-013e-491b-b4fc-2b7f9386232d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:10.284930 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337cc5ac-013e-491b-b4fc-2b7f9386232d None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:10.306940 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 272/538] 10.222.0.15 () {56 vars in 1109 bytes} [Tue May 31 14:30:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:10.312503 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00db42e8-05f8-4ee0-9c80-795663b56231 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:10.425876 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00db42e8-05f8-4ee0-9c80-795663b56231 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:10.452594 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce048a9-6e9c-430b-a22a-25d2416d375f None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:10.452897 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce048a9-6e9c-430b-a22a-25d2416d375f None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:10.453164 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce048a9-6e9c-430b-a22a-25d2416d375f None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:10.454683 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 273/539] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:30:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 31 14:30:10.459854 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1961445-ce8f-40f2-9abd-5e71043a001c None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:10.460380 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1961445-ce8f-40f2-9abd-5e71043a001c None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:10.460853 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1961445-ce8f-40f2-9abd-5e71043a001c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:10.466324 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da5f6c1-77ab-4bc9-99d2-b81fa566b8da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:10.467153 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da5f6c1-77ab-4bc9-99d2-b81fa566b8da None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:10.467440 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da5f6c1-77ab-4bc9-99d2-b81fa566b8da None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:10.467723 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da5f6c1-77ab-4bc9-99d2-b81fa566b8da None admin] PATH_INFO: `/v3/projects/service` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:10.474905 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da5f6c1-77ab-4bc9-99d2-b81fa566b8da None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:10.476347 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da5f6c1-77ab-4bc9-99d2-b81fa566b8da None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:10.480298 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-e1961445-ce8f-40f2-9abd-5e71043a001c None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:30:10.481668 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-e1961445-ce8f-40f2-9abd-5e71043a001c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:30:10.491044 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-1da5f6c1-77ab-4bc9-99d2-b81fa566b8da None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 14:30:10.491044 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:10.491044 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:10.491044 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:10.491044 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:10.491044 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:10.491044 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:10.491044 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:10.491044 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:10.491044 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:10.491044 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:10.491044 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:10.491044 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 14:30:10.491044 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 14:30:10.491044 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 14:30:10.491887 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 14:30:10.491887 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:10.491887 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:10.491887 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:10.491887 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:10.491887 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:10.491887 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:10.491887 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:10.491887 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:30:10.491887 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:10.491887 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:10.491887 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:10.491887 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:10.491887 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:10.491887 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:10.491887 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:10.491887 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:10.493329 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 14:30:10.493329 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 14:30:10.493329 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 14:30:10.493329 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 14:30:10.493329 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 14:30:10.493329 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 14:30:10.493329 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 14:30:10.493329 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:30:10.493329 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 267/540] 10.222.0.15 () {56 vars in 1111 bytes} [Tue May 31 14:30:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:10.498652 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da5f6c1-77ab-4bc9-99d2-b81fa566b8da None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:10.558596 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:10.606445 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da5f6c1-77ab-4bc9-99d2-b81fa566b8da None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:10.610020 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 274/541] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:30:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 31 14:30:10.644248 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796be4df-907f-48b2-8b6e-1885a9098685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:10.644927 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796be4df-907f-48b2-8b6e-1885a9098685 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:10.645215 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796be4df-907f-48b2-8b6e-1885a9098685 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:10.645494 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796be4df-907f-48b2-8b6e-1885a9098685 None admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:10.646294 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796be4df-907f-48b2-8b6e-1885a9098685 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:10.646691 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796be4df-907f-48b2-8b6e-1885a9098685 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:10.648204 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796be4df-907f-48b2-8b6e-1885a9098685 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:10.651106 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1961445-ce8f-40f2-9abd-5e71043a001c None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:10.668196 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 268/542] 10.222.0.15 () {56 vars in 1148 bytes} [Tue May 31 14:30:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 14:30:10.673934 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796be4df-907f-48b2-8b6e-1885a9098685 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:10.781411 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796be4df-907f-48b2-8b6e-1885a9098685 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:10.795760 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:10.819767 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d9e69c-b9c9-4d63-961c-dd39343a3292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:10.819767 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9e69c-b9c9-4d63-961c-dd39343a3292 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:10.819767 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9e69c-b9c9-4d63-961c-dd39343a3292 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:10.819767 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9e69c-b9c9-4d63-961c-dd39343a3292 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:10.821153 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d9e69c-b9c9-4d63-961c-dd39343a3292 None admin] RBAC: Adding query filter params (role.id=4fa2a9add9bc4786a62e7b5cae3cc051, scope.project.id=ffff4334538649fdba1beb80cad207fa, user.id=c5262f4b9b2948fdb3b4ab504311453b) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:10.821458 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d9e69c-b9c9-4d63-961c-dd39343a3292 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:10.822971 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d9e69c-b9c9-4d63-961c-dd39343a3292 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:10.829305 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 269/543] 10.222.0.15 () {56 vars in 1374 bytes} [Tue May 31 14:30:10 2022] GET /identity/v3/role_assignments?user.id=c5262f4b9b2948fdb3b4ab504311453b&scope.project.id=ffff4334538649fdba1beb80cad207fa&role.id=4fa2a9add9bc4786a62e7b5cae3cc051 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 14:30:10.847848 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:10.880380 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1961445-ce8f-40f2-9abd-5e71043a001c None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:10.931837 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fbeb2a-2429-4f15-880c-96e2f93e0a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:10.933574 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fbeb2a-2429-4f15-880c-96e2f93e0a43 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:10.934093 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fbeb2a-2429-4f15-880c-96e2f93e0a43 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:10.934582 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fbeb2a-2429-4f15-880c-96e2f93e0a43 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:10.955555 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fbeb2a-2429-4f15-880c-96e2f93e0a43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 14:30:10.963974 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-87fbeb2a-2429-4f15-880c-96e2f93e0a43 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 31 14:30:10.963974 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:10.963974 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:10.963974 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:10.963974 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:10.963974 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:10.963974 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:10.963974 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:10.963974 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:10.963974 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:10.963974 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:10.963974 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:10.963974 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 14:30:10.963974 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 14:30:10.963974 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 14:30:10.963974 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 14:30:10.964927 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 14:30:10.964927 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 14:30:10.964927 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 14:30:10.964927 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 14:30:10.964927 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:10.964927 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:10.964927 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:10.964927 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:10.964927 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:10.964927 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:10.964927 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:10.964927 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:30:10.964927 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:10.964927 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:10.964927 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:10.964927 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:10.965705 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:10.965705 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:10.965705 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:10.965705 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:10.965705 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 14:30:10.965705 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 14:30:10.965705 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 14:30:10.965705 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 14:30:10.965705 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 14:30:10.965705 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 14:30:10.965705 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 31 14:30:10.965705 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:30:10.968263 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 275/544] 10.222.0.15 () {56 vars in 1102 bytes} [Tue May 31 14:30:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 14:30:10.974341 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d9e69c-b9c9-4d63-961c-dd39343a3292 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:11.110890 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d9e69c-b9c9-4d63-961c-dd39343a3292 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:11.152384 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae179f3a-dace-4a23-a2a4-a7f15ec9e44c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:11.153084 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae179f3a-dace-4a23-a2a4-a7f15ec9e44c None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:11.153375 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae179f3a-dace-4a23-a2a4-a7f15ec9e44c None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:11.153656 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae179f3a-dace-4a23-a2a4-a7f15ec9e44c None admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:11.154426 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae179f3a-dace-4a23-a2a4-a7f15ec9e44c None admin] RBAC: Adding query filter params (name=service) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:11.154781 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae179f3a-dace-4a23-a2a4-a7f15ec9e44c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:11.156216 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae179f3a-dace-4a23-a2a4-a7f15ec9e44c None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:11.167397 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 270/545] 10.222.0.15 () {56 vars in 1103 bytes} [Tue May 31 14:30:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:11.173545 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fbeb2a-2429-4f15-880c-96e2f93e0a43 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:11.360171 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fbeb2a-2429-4f15-880c-96e2f93e0a43 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:11.406885 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd2ed54-c706-48fb-8bc7-41cb7b05c5bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:11.407609 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd2ed54-c706-48fb-8bc7-41cb7b05c5bb None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:11.408095 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd2ed54-c706-48fb-8bc7-41cb7b05c5bb None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:11.408376 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd2ed54-c706-48fb-8bc7-41cb7b05c5bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:11.424905 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd2ed54-c706-48fb-8bc7-41cb7b05c5bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:11.426385 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd2ed54-c706-48fb-8bc7-41cb7b05c5bb None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:11.428411 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:11.451521 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-ddd2ed54-c706-48fb-8bc7-41cb7b05c5bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:11.451521 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:11.451521 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:11.451521 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:11.451521 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:11.451521 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:11.451521 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:11.451521 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:11.451521 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:11.451521 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:11.451521 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:11.451521 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:11.451521 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 14:30:11.451521 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 14:30:11.451521 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 14:30:11.452415 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 14:30:11.452415 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:11.452415 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:11.452415 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:11.452415 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:11.452415 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:11.452415 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:11.452415 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:11.452415 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:30:11.452415 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:11.452415 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:11.452415 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:11.452415 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:11.452415 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:11.452415 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:11.452415 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:11.452415 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:11.453252 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 14:30:11.453252 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 14:30:11.453252 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:11.453252 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:30:11.453252 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 276/546] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:30:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:11.463706 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae179f3a-dace-4a23-a2a4-a7f15ec9e44c None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:11.522902 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ef5ce-217c-4c14-8853-ce326d65ecf9 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:11.523263 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ef5ce-217c-4c14-8853-ce326d65ecf9 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:11.524323 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ef5ce-217c-4c14-8853-ce326d65ecf9 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:11.525660 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 277/547] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:30:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 31 14:30:11.540235 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dda076a-ea08-4879-9062-a186cbf077eb None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:11.540879 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dda076a-ea08-4879-9062-a186cbf077eb None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:11.541353 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dda076a-ea08-4879-9062-a186cbf077eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:11.542591 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:11.566793 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-7dda076a-ea08-4879-9062-a186cbf077eb None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:30:11.568782 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-7dda076a-ea08-4879-9062-a186cbf077eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:30:11.658945 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 278/548] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:30:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 31 14:30:11.681648 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dda076a-ea08-4879-9062-a186cbf077eb None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:11.690983 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae179f3a-dace-4a23-a2a4-a7f15ec9e44c None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:11.816282 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dda076a-ea08-4879-9062-a186cbf077eb None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:11.819340 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d8beb5-2802-43c0-98d1-8a640629020c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:11.820203 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d8beb5-2802-43c0-98d1-8a640629020c None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:11.821723 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d8beb5-2802-43c0-98d1-8a640629020c None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:11.822141 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d8beb5-2802-43c0-98d1-8a640629020c None admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:11.823058 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d8beb5-2802-43c0-98d1-8a640629020c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:11.823602 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d8beb5-2802-43c0-98d1-8a640629020c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:11.825140 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d8beb5-2802-43c0-98d1-8a640629020c None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:11.846620 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:11.856980 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 271/549] 10.222.0.15 () {56 vars in 1109 bytes} [Tue May 31 14:30:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 394 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:11.863913 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d8beb5-2802-43c0-98d1-8a640629020c None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:11.864766 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611d1334-c5e0-41e6-a0fd-6245394937f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:11.866614 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611d1334-c5e0-41e6-a0fd-6245394937f6 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:11.869193 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611d1334-c5e0-41e6-a0fd-6245394937f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:11.869637 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611d1334-c5e0-41e6-a0fd-6245394937f6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:11.891695 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611d1334-c5e0-41e6-a0fd-6245394937f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 14:30:11.913548 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-611d1334-c5e0-41e6-a0fd-6245394937f6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 31 14:30:11.913548 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:11.913548 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:11.913548 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:11.913548 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:11.913548 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:11.913548 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:11.913548 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:11.913548 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:11.913548 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:11.913548 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:11.913548 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:11.913548 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 14:30:11.913548 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 14:30:11.913548 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 14:30:11.913548 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 14:30:11.914728 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 14:30:11.914728 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 14:30:11.914728 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 14:30:11.914728 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 14:30:11.914728 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:11.914728 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:11.914728 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:11.914728 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:11.914728 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:11.914728 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:11.914728 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:11.914728 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:30:11.914728 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:11.914728 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:11.914728 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:11.914728 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:11.915739 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:11.915739 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:11.915739 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:11.915739 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:11.915739 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 14:30:11.915739 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 14:30:11.915739 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 14:30:11.915739 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 14:30:11.915739 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 14:30:11.915739 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 14:30:11.915739 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 31 14:30:11.915739 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:30:11.920987 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 279/550] 10.222.0.15 () {56 vars in 1102 bytes} [Tue May 31 14:30:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 14:30:11.927633 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611d1334-c5e0-41e6-a0fd-6245394937f6 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:12.012259 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:12.015946 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d8beb5-2802-43c0-98d1-8a640629020c None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:12.052312 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8781286-0410-4f5a-9b5f-5455959f07f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:12.053121 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8781286-0410-4f5a-9b5f-5455959f07f6 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:12.053406 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8781286-0410-4f5a-9b5f-5455959f07f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:12.053674 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8781286-0410-4f5a-9b5f-5455959f07f6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:12.061955 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8781286-0410-4f5a-9b5f-5455959f07f6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:12.063468 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8781286-0410-4f5a-9b5f-5455959f07f6 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:12.071158 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611d1334-c5e0-41e6-a0fd-6245394937f6 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:12.078132 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-f8781286-0410-4f5a-9b5f-5455959f07f6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 31 14:30:12.078132 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:12.078132 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:12.078132 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:12.078132 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:12.078132 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:12.078132 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:12.078132 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:12.078132 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:12.078132 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:12.078132 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:12.078132 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:12.078132 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 14:30:12.078132 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 14:30:12.078132 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 14:30:12.078132 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 14:30:12.079200 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:12.079200 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:12.079200 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 14:30:12.079200 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 14:30:12.079200 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 14:30:12.079200 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 14:30:12.079200 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:12.079200 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:12.079200 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:12.079200 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:12.079200 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:12.079200 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:30:12.079200 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:12.079200 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:12.079200 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:12.079200 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:12.079200 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:12.079200 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:12.080422 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:12.080422 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:12.080422 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 14:30:12.080422 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 14:30:12.080422 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 14:30:12.080422 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 14:30:12.080422 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 14:30:12.080422 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 14:30:12.080422 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 31 14:30:12.080422 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:30:12.080422 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 272/551] 10.222.0.15 () {56 vars in 1096 bytes} [Tue May 31 14:30:11 2022] GET /identity/v3/users/swift => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:12.081529 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631298dc-bece-4970-9865-760e3a9976e9 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:12.081529 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631298dc-bece-4970-9865-760e3a9976e9 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:12.081529 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631298dc-bece-4970-9865-760e3a9976e9 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:12.086596 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 273/552] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:30:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:30:12.088798 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98d8569-cfa9-4481-900c-520d197fd939 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:12.089271 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98d8569-cfa9-4481-900c-520d197fd939 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:12.089695 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98d8569-cfa9-4481-900c-520d197fd939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:12.108445 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-b98d8569-cfa9-4481-900c-520d197fd939 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:30:12.109906 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-b98d8569-cfa9-4481-900c-520d197fd939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:30:12.121248 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e72a526-15e3-4615-9649-e0d5bc0fc30a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:12.121797 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e72a526-15e3-4615-9649-e0d5bc0fc30a None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:12.122082 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e72a526-15e3-4615-9649-e0d5bc0fc30a None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:12.122353 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e72a526-15e3-4615-9649-e0d5bc0fc30a None admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:12.123133 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e72a526-15e3-4615-9649-e0d5bc0fc30a None admin] RBAC: Adding query filter params (name=service) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:12.123438 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e72a526-15e3-4615-9649-e0d5bc0fc30a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:12.124950 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e72a526-15e3-4615-9649-e0d5bc0fc30a None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:12.138982 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 280/553] 10.222.0.15 () {56 vars in 1103 bytes} [Tue May 31 14:30:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:12.138982 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e72a526-15e3-4615-9649-e0d5bc0fc30a None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:12.188729 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:12.193036 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 274/554] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:30:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 14:30:12.194190 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98d8569-cfa9-4481-900c-520d197fd939 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:12.248596 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e72a526-15e3-4615-9649-e0d5bc0fc30a None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:12.285129 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d95b1a2-23fd-4d0c-8b9a-b754218897e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:12.286053 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d95b1a2-23fd-4d0c-8b9a-b754218897e2 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:12.286342 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d95b1a2-23fd-4d0c-8b9a-b754218897e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:12.286701 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d95b1a2-23fd-4d0c-8b9a-b754218897e2 None admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:12.287588 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d95b1a2-23fd-4d0c-8b9a-b754218897e2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:12.288015 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d95b1a2-23fd-4d0c-8b9a-b754218897e2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:12.290312 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d95b1a2-23fd-4d0c-8b9a-b754218897e2 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:12.315252 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 281/555] 10.222.0.15 () {56 vars in 1135 bytes} [Tue May 31 14:30:12 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:12.316411 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d95b1a2-23fd-4d0c-8b9a-b754218897e2 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:12.316997 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:12.332960 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98d8569-cfa9-4481-900c-520d197fd939 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:12.378863 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb1b3ca-63de-4fba-883f-f7e196b1aeac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:12.379671 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb1b3ca-63de-4fba-883f-f7e196b1aeac None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:12.379951 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb1b3ca-63de-4fba-883f-f7e196b1aeac None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:12.380228 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb1b3ca-63de-4fba-883f-f7e196b1aeac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:12.392436 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb1b3ca-63de-4fba-883f-f7e196b1aeac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:12.394094 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb1b3ca-63de-4fba-883f-f7e196b1aeac None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:12.413928 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-3fb1b3ca-63de-4fba-883f-f7e196b1aeac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:12.413928 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:12.413928 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:12.413928 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:12.413928 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:12.413928 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:12.413928 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:12.413928 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:12.413928 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:12.413928 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:12.413928 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:12.413928 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:12.413928 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 14:30:12.413928 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 14:30:12.413928 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 14:30:12.414964 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 14:30:12.414964 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:12.414964 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:12.414964 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:12.414964 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:12.414964 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:12.414964 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:12.414964 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:12.414964 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:30:12.414964 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:12.414964 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:12.414964 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:12.414964 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:12.414964 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:12.414964 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:12.414964 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:12.414964 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:12.415987 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 14:30:12.415987 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 14:30:12.415987 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:12.415987 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:30:12.415987 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 275/556] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:30:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:12.420695 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb1b3ca-63de-4fba-883f-f7e196b1aeac None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:12.436552 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d95b1a2-23fd-4d0c-8b9a-b754218897e2 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:12.439518 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:12.478468 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce856f9-c9f2-43be-a885-776d20287705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:12.479367 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce856f9-c9f2-43be-a885-776d20287705 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:12.479881 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce856f9-c9f2-43be-a885-776d20287705 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:12.480360 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce856f9-c9f2-43be-a885-776d20287705 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:12.493190 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce856f9-c9f2-43be-a885-776d20287705 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 14:30:12.501825 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-bce856f9-c9f2-43be-a885-776d20287705 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 31 14:30:12.501825 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:12.501825 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:12.501825 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:12.501825 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:12.501825 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:12.501825 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:12.501825 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:12.501825 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:12.501825 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:12.501825 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:12.501825 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:12.501825 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 14:30:12.501825 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 14:30:12.501825 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 14:30:12.501825 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 14:30:12.502949 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 14:30:12.502949 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 14:30:12.502949 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 14:30:12.502949 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 14:30:12.502949 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:12.502949 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:12.502949 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:12.502949 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:12.502949 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:12.502949 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:12.502949 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:12.502949 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:30:12.502949 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:12.502949 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:12.502949 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:12.502949 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:12.504454 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:12.504454 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:12.504454 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:12.504454 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:12.504454 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 14:30:12.504454 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 14:30:12.504454 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 14:30:12.504454 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 14:30:12.504454 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 14:30:12.504454 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 14:30:12.504454 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 31 14:30:12.504454 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:30:12.506998 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 282/557] 10.222.0.15 () {56 vars in 1102 bytes} [Tue May 31 14:30:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:12.508622 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce856f9-c9f2-43be-a885-776d20287705 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:12.532673 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb1b3ca-63de-4fba-883f-f7e196b1aeac None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:12.572159 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c876eb8-c977-4c6e-a881-c307490f9114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:12.572817 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c876eb8-c977-4c6e-a881-c307490f9114 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:12.573104 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c876eb8-c977-4c6e-a881-c307490f9114 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:12.573385 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c876eb8-c977-4c6e-a881-c307490f9114 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:12.585033 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:12.623425 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce856f9-c9f2-43be-a885-776d20287705 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:12.649703 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c876eb8-c977-4c6e-a881-c307490f9114 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:12.651109 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c876eb8-c977-4c6e-a881-c307490f9114 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:12.661608 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cf62ea-09ca-4b9e-be0e-e0dc0fda10a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:12.662752 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cf62ea-09ca-4b9e-be0e-e0dc0fda10a2 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:12.663241 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cf62ea-09ca-4b9e-be0e-e0dc0fda10a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:12.663715 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cf62ea-09ca-4b9e-be0e-e0dc0fda10a2 None admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:12.664673 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cf62ea-09ca-4b9e-be0e-e0dc0fda10a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:12.665289 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cf62ea-09ca-4b9e-be0e-e0dc0fda10a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:12.667026 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cf62ea-09ca-4b9e-be0e-e0dc0fda10a2 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:12.681907 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 283/558] 10.222.0.15 () {56 vars in 1109 bytes} [Tue May 31 14:30:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:12.683264 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cf62ea-09ca-4b9e-be0e-e0dc0fda10a2 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:12.714050 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:12.777766 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 276/559] 10.222.0.15 () {58 vars in 1282 bytes} [Tue May 31 14:30:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 31 14:30:12.783516 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c876eb8-c977-4c6e-a881-c307490f9114 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:12.808086 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cf62ea-09ca-4b9e-be0e-e0dc0fda10a2 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:12.831897 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:12.855936 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8589f52-130c-4507-ac6f-19c920f2638e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:12.856857 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8589f52-130c-4507-ac6f-19c920f2638e None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:12.857517 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8589f52-130c-4507-ac6f-19c920f2638e None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:12.857943 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8589f52-130c-4507-ac6f-19c920f2638e None admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:12.859359 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8589f52-130c-4507-ac6f-19c920f2638e None admin] RBAC: Adding query filter params (name=service) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:12.860079 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8589f52-130c-4507-ac6f-19c920f2638e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:12.862528 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8589f52-130c-4507-ac6f-19c920f2638e None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:12.873777 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 284/560] 10.222.0.15 () {56 vars in 1103 bytes} [Tue May 31 14:30:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:12.875381 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8589f52-130c-4507-ac6f-19c920f2638e None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:12.896014 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c876eb8-c977-4c6e-a881-c307490f9114 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:12.933373 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50a6af4-5f54-431c-b7a6-76e8fadaed0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:12.934578 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50a6af4-5f54-431c-b7a6-76e8fadaed0d None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:12.934929 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50a6af4-5f54-431c-b7a6-76e8fadaed0d None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:12.935315 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50a6af4-5f54-431c-b7a6-76e8fadaed0d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:12.944465 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50a6af4-5f54-431c-b7a6-76e8fadaed0d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:12.946754 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50a6af4-5f54-431c-b7a6-76e8fadaed0d None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:12.962893 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-e50a6af4-5f54-431c-b7a6-76e8fadaed0d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 31 14:30:12.962893 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:12.962893 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:12.962893 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:12.962893 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:12.962893 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:12.962893 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:12.962893 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:12.962893 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:12.962893 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:12.962893 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:12.962893 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:12.962893 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 14:30:12.962893 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 14:30:12.962893 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 14:30:12.962893 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 14:30:12.963950 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:12.963950 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:12.963950 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 14:30:12.963950 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 14:30:12.963950 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 14:30:12.963950 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 14:30:12.963950 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:12.963950 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:12.963950 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:12.963950 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:12.963950 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:12.963950 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:30:12.963950 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:12.963950 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:12.963950 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:12.963950 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:12.963950 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:12.963950 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:12.964956 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:12.964956 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:12.964956 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 14:30:12.964956 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 14:30:12.964956 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 14:30:12.964956 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 14:30:12.964956 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 14:30:12.964956 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 14:30:12.964956 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 31 14:30:12.964956 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:30:12.969178 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 277/561] 10.222.0.15 () {56 vars in 1093 bytes} [Tue May 31 14:30:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:12.970158 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50a6af4-5f54-431c-b7a6-76e8fadaed0d None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:12.976540 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:12.991833 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8589f52-130c-4507-ac6f-19c920f2638e None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:13.027542 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756bbcc9-f4a4-4d96-979f-2aeb0940060b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:13.028645 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756bbcc9-f4a4-4d96-979f-2aeb0940060b None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:13.029112 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756bbcc9-f4a4-4d96-979f-2aeb0940060b None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:13.029566 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756bbcc9-f4a4-4d96-979f-2aeb0940060b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:13.042275 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756bbcc9-f4a4-4d96-979f-2aeb0940060b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:13.044131 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756bbcc9-f4a4-4d96-979f-2aeb0940060b None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:13.062446 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-756bbcc9-f4a4-4d96-979f-2aeb0940060b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:13.062446 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:13.062446 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:13.062446 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:13.062446 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:13.062446 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:13.062446 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:13.062446 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:13.062446 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:13.062446 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:13.062446 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:13.062446 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:13.062446 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 14:30:13.062446 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 14:30:13.062446 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 14:30:13.063358 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 14:30:13.063358 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:13.063358 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:13.063358 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:13.063358 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:13.063358 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:13.063358 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:13.063358 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:13.063358 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:30:13.063358 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:13.063358 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:13.063358 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:13.063358 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:13.063358 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:13.063358 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:13.063358 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:13.063358 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:13.064269 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 14:30:13.064269 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 14:30:13.064269 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:13.064269 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:30:13.066125 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 285/562] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:30:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:13.067196 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756bbcc9-f4a4-4d96-979f-2aeb0940060b None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:13.082377 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:13.085673 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50a6af4-5f54-431c-b7a6-76e8fadaed0d None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:13.121780 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970c9fed-ad3b-4198-a7de-04ac400b6551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:13.123006 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970c9fed-ad3b-4198-a7de-04ac400b6551 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:13.123296 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970c9fed-ad3b-4198-a7de-04ac400b6551 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:13.123727 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970c9fed-ad3b-4198-a7de-04ac400b6551 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:13.135367 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970c9fed-ad3b-4198-a7de-04ac400b6551 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:13.136813 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970c9fed-ad3b-4198-a7de-04ac400b6551 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:13.154347 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-970c9fed-ad3b-4198-a7de-04ac400b6551 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:13.154347 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:13.154347 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:13.154347 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:13.154347 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:13.154347 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:13.154347 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:13.154347 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:13.154347 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:13.154347 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:13.154347 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:13.154347 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:13.154347 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 14:30:13.154347 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 14:30:13.154347 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 14:30:13.155340 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 14:30:13.155340 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:13.155340 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:13.155340 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:13.155340 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:13.155340 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:13.155340 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:13.155340 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:13.155340 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:30:13.155340 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:13.155340 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:13.155340 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:13.155340 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:13.155340 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:13.155340 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:13.155340 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:13.155340 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:13.156269 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 14:30:13.156269 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 14:30:13.156269 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:13.156269 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:30:13.156269 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 278/563] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:30:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:13.156938 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa420f7-e98e-4c68-9513-428ab48d9488 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:13.157172 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa420f7-e98e-4c68-9513-428ab48d9488 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:13.157448 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa420f7-e98e-4c68-9513-428ab48d9488 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:13.159306 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 279/564] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:30:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:30:13.159817 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa420f7-e98e-4c68-9513-428ab48d9488 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:13.183668 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756bbcc9-f4a4-4d96-979f-2aeb0940060b None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:13.219280 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e5ecf0-1682-4146-95b7-50deba1e9795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:13.219967 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e5ecf0-1682-4146-95b7-50deba1e9795 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:13.220260 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e5ecf0-1682-4146-95b7-50deba1e9795 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:13.220653 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e5ecf0-1682-4146-95b7-50deba1e9795 None admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:13.221590 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e5ecf0-1682-4146-95b7-50deba1e9795 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:13.221910 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e5ecf0-1682-4146-95b7-50deba1e9795 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:13.223490 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e5ecf0-1682-4146-95b7-50deba1e9795 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:13.233767 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:13.244685 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 286/565] 10.222.0.15 () {56 vars in 1133 bytes} [Tue May 31 14:30:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:13.245499 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e5ecf0-1682-4146-95b7-50deba1e9795 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:13.279178 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa420f7-e98e-4c68-9513-428ab48d9488 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:13.319600 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295f28f8-6adf-427d-b3c7-20b7921dca99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:13.320273 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f28f8-6adf-427d-b3c7-20b7921dca99 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:13.320607 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f28f8-6adf-427d-b3c7-20b7921dca99 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:13.320909 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f28f8-6adf-427d-b3c7-20b7921dca99 None admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:13.321597 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295f28f8-6adf-427d-b3c7-20b7921dca99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:13.321905 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295f28f8-6adf-427d-b3c7-20b7921dca99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:13.323804 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295f28f8-6adf-427d-b3c7-20b7921dca99 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:13.340406 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 280/566] 10.222.0.15 () {56 vars in 1109 bytes} [Tue May 31 14:30:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:13.340406 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c3e525-0f39-42e1-b587-5ccb5ac71b8e None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:13.340406 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c3e525-0f39-42e1-b587-5ccb5ac71b8e None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:13.340406 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c3e525-0f39-42e1-b587-5ccb5ac71b8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:13.357363 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-c9c3e525-0f39-42e1-b587-5ccb5ac71b8e None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:30:13.358635 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-c9c3e525-0f39-42e1-b587-5ccb5ac71b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:30:13.358748 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e5ecf0-1682-4146-95b7-50deba1e9795 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:13.366589 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:13.395496 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5765a5-79e3-4639-bfcc-7753abf90f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:13.396163 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5765a5-79e3-4639-bfcc-7753abf90f7d None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:13.396447 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5765a5-79e3-4639-bfcc-7753abf90f7d None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:13.396722 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5765a5-79e3-4639-bfcc-7753abf90f7d None admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:13.397434 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5765a5-79e3-4639-bfcc-7753abf90f7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:13.397738 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5765a5-79e3-4639-bfcc-7753abf90f7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:13.401232 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5765a5-79e3-4639-bfcc-7753abf90f7d None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:13.413529 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 287/567] 10.222.0.15 () {56 vars in 1109 bytes} [Tue May 31 14:30:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:13.414824 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5765a5-79e3-4639-bfcc-7753abf90f7d None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:13.439841 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 281/568] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:30:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 14:30:13.440693 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c3e525-0f39-42e1-b587-5ccb5ac71b8e None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:13.494629 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:13.545983 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5765a5-79e3-4639-bfcc-7753abf90f7d None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:13.552146 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c3e525-0f39-42e1-b587-5ccb5ac71b8e None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:13.583231 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bb50b9-f3fe-4071-8af5-03145859c356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:13.584214 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb50b9-f3fe-4071-8af5-03145859c356 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:13.584666 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb50b9-f3fe-4071-8af5-03145859c356 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:13.584850 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb50b9-f3fe-4071-8af5-03145859c356 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:13.591547 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177af27e-a09f-4ac0-953f-bd7b2b5bc2e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:13.592416 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177af27e-a09f-4ac0-953f-bd7b2b5bc2e9 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:13.592702 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177af27e-a09f-4ac0-953f-bd7b2b5bc2e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:13.592977 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177af27e-a09f-4ac0-953f-bd7b2b5bc2e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:13.600978 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bb50b9-f3fe-4071-8af5-03145859c356 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:13.601677 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177af27e-a09f-4ac0-953f-bd7b2b5bc2e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:13.603123 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bb50b9-f3fe-4071-8af5-03145859c356 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:13.604955 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177af27e-a09f-4ac0-953f-bd7b2b5bc2e9 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:13.622198 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-a9bb50b9-f3fe-4071-8af5-03145859c356 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:13.622198 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:13.622198 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:13.622198 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:13.622198 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:13.622198 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:13.622198 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:13.622198 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:13.622198 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:13.622198 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:13.622198 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:13.622198 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:13.622198 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 14:30:13.622198 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 14:30:13.622198 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 14:30:13.623261 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 14:30:13.623261 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:13.623261 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:13.623261 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:13.623261 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:13.623261 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:13.623261 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:13.623261 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:13.623261 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:30:13.623261 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:13.623261 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:13.623261 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:13.623261 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:13.623261 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:13.623261 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:13.623261 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:13.623261 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:13.629321 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 14:30:13.629321 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 14:30:13.629321 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:13.629321 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:30:13.629625 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-177af27e-a09f-4ac0-953f-bd7b2b5bc2e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 14:30:13.629625 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:13.629625 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:13.629625 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:13.629625 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:13.629625 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:13.629625 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:13.629625 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:13.629625 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:13.629625 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:13.629625 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:13.629625 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:13.629625 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 14:30:13.629625 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 14:30:13.629625 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 14:30:13.630473 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 14:30:13.630473 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:13.630473 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:13.630473 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:13.630473 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:13.630473 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:13.630473 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:13.630473 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:13.630473 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:30:13.630473 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:13.630473 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:13.630473 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:13.630473 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:13.630473 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:13.630473 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:13.630473 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:13.630473 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:13.631387 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 14:30:13.631387 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 14:30:13.631387 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 14:30:13.631387 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 14:30:13.631387 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 14:30:13.631387 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 14:30:13.631387 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 14:30:13.631387 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:30:13.631387 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 282/569] 10.222.0.15 () {56 vars in 1111 bytes} [Tue May 31 14:30:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:13.631387 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177af27e-a09f-4ac0-953f-bd7b2b5bc2e9 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:13.631962 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 288/570] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:30:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:13.631962 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bb50b9-f3fe-4071-8af5-03145859c356 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:13.632991 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:13.733936 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177af27e-a09f-4ac0-953f-bd7b2b5bc2e9 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:13.744464 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bb50b9-f3fe-4071-8af5-03145859c356 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:13.754377 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:13.768900 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cd4af7-afcd-45bf-936e-3c8077cf52bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:13.769711 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd4af7-afcd-45bf-936e-3c8077cf52bc None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:13.769989 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd4af7-afcd-45bf-936e-3c8077cf52bc None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:13.770267 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd4af7-afcd-45bf-936e-3c8077cf52bc None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:13.778387 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cd4af7-afcd-45bf-936e-3c8077cf52bc None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:13.779899 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cd4af7-afcd-45bf-936e-3c8077cf52bc None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:13.784313 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275620ae-a3e7-4457-a3af-78bc1905ffb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:13.785416 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275620ae-a3e7-4457-a3af-78bc1905ffb3 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:13.786115 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275620ae-a3e7-4457-a3af-78bc1905ffb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:13.786588 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275620ae-a3e7-4457-a3af-78bc1905ffb3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:13.795725 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-f8cd4af7-afcd-45bf-936e-3c8077cf52bc None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 31 14:30:13.795725 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:13.795725 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:13.795725 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:13.795725 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:13.795725 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:13.795725 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:13.795725 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:13.795725 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:13.795725 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:13.795725 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:13.795725 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:13.795725 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 14:30:13.795725 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 14:30:13.795725 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 14:30:13.795725 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 14:30:13.796835 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:13.796835 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:13.796835 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 14:30:13.796835 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 14:30:13.796835 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 14:30:13.796835 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 14:30:13.796835 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:13.796835 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:13.796835 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:13.796835 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:13.796835 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:13.796835 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:30:13.796835 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:13.796835 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:13.796835 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:13.796835 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:13.796835 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:13.796835 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:13.797819 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:13.797819 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:13.797819 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 14:30:13.797819 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 14:30:13.797819 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 14:30:13.797819 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 14:30:13.797819 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 14:30:13.797819 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 14:30:13.797819 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 31 14:30:13.797819 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:30:13.797819 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 283/571] 10.222.0.15 () {56 vars in 1099 bytes} [Tue May 31 14:30:13 2022] GET /identity/v3/users/cinder => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:13.798441 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cd4af7-afcd-45bf-936e-3c8077cf52bc None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:13.805362 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275620ae-a3e7-4457-a3af-78bc1905ffb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 14:30:13.813645 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-275620ae-a3e7-4457-a3af-78bc1905ffb3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 31 14:30:13.813645 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:13.813645 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:13.813645 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:13.813645 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:13.813645 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:13.813645 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:13.813645 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:13.813645 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:13.813645 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:13.813645 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:13.813645 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:13.813645 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 14:30:13.813645 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 14:30:13.813645 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 14:30:13.813645 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 14:30:13.819962 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 14:30:13.819962 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 14:30:13.819962 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 14:30:13.819962 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 14:30:13.819962 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:13.819962 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:13.819962 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:13.819962 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:13.819962 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:13.819962 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:13.819962 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:13.819962 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:30:13.819962 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:13.819962 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:13.819962 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:13.819962 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:13.822047 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:13.822047 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:13.822047 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:13.822047 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:13.822047 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 14:30:13.822047 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 14:30:13.822047 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 14:30:13.822047 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 14:30:13.822047 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 14:30:13.822047 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 14:30:13.822047 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 31 14:30:13.822047 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:30:13.822047 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 289/572] 10.222.0.15 () {56 vars in 1102 bytes} [Tue May 31 14:30:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:13.822047 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275620ae-a3e7-4457-a3af-78bc1905ffb3 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:13.909375 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cd4af7-afcd-45bf-936e-3c8077cf52bc None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:13.920798 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275620ae-a3e7-4457-a3af-78bc1905ffb3 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:13.943555 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd042d5-6f1b-41d5-8231-94d3a2a05e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:13.944211 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd042d5-6f1b-41d5-8231-94d3a2a05e3a None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:13.944494 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd042d5-6f1b-41d5-8231-94d3a2a05e3a None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:13.944769 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd042d5-6f1b-41d5-8231-94d3a2a05e3a None admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:13.945514 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd042d5-6f1b-41d5-8231-94d3a2a05e3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:13.945819 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd042d5-6f1b-41d5-8231-94d3a2a05e3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:13.947199 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd042d5-6f1b-41d5-8231-94d3a2a05e3a None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:13.955283 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b383f625-b388-4dd7-b4a2-83f9225f268b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:13.956184 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b383f625-b388-4dd7-b4a2-83f9225f268b None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:13.956653 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b383f625-b388-4dd7-b4a2-83f9225f268b None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:13.957110 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b383f625-b388-4dd7-b4a2-83f9225f268b None admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:13.958068 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b383f625-b388-4dd7-b4a2-83f9225f268b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:13.958586 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b383f625-b388-4dd7-b4a2-83f9225f268b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:13.958802 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 284/573] 10.222.0.15 () {56 vars in 1109 bytes} [Tue May 31 14:30:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:13.959591 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd042d5-6f1b-41d5-8231-94d3a2a05e3a None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:13.960631 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b383f625-b388-4dd7-b4a2-83f9225f268b None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:13.972753 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 290/574] 10.222.0.15 () {56 vars in 1148 bytes} [Tue May 31 14:30:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:13.973656 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b383f625-b388-4dd7-b4a2-83f9225f268b None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:14.030434 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:14.058644 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:14.077026 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd042d5-6f1b-41d5-8231-94d3a2a05e3a None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:14.083837 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b383f625-b388-4dd7-b4a2-83f9225f268b None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:14.100908 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:14.116742 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fe8dca-e208-4674-bca2-20cfc42de9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:14.118053 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe8dca-e208-4674-bca2-20cfc42de9d3 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:14.118346 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe8dca-e208-4674-bca2-20cfc42de9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:14.118732 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe8dca-e208-4674-bca2-20cfc42de9d3 None admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:14.119647 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fe8dca-e208-4674-bca2-20cfc42de9d3 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:14.119905 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fe8dca-e208-4674-bca2-20cfc42de9d3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:14.121393 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fe8dca-e208-4674-bca2-20cfc42de9d3 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:14.123209 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7308454-4936-4433-8238-27f929ff5bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:14.123876 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7308454-4936-4433-8238-27f929ff5bb6 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:14.124157 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7308454-4936-4433-8238-27f929ff5bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:14.124438 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7308454-4936-4433-8238-27f929ff5bb6 None admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:14.125173 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7308454-4936-4433-8238-27f929ff5bb6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:14.125533 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7308454-4936-4433-8238-27f929ff5bb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:14.126912 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7308454-4936-4433-8238-27f929ff5bb6 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:14.135080 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 291/575] 10.222.0.15 () {56 vars in 1103 bytes} [Tue May 31 14:30:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:14.135861 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7308454-4936-4433-8238-27f929ff5bb6 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:14.139032 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 285/576] 10.222.0.15 () {56 vars in 1137 bytes} [Tue May 31 14:30:13 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:14.140057 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fe8dca-e208-4674-bca2-20cfc42de9d3 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:14.225670 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:14.235395 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7308454-4936-4433-8238-27f929ff5bb6 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:14.241307 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fe8dca-e208-4674-bca2-20cfc42de9d3 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:14.267926 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4c8202-c413-418b-8ea2-2268fca605d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:14.268705 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4c8202-c413-418b-8ea2-2268fca605d0 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:14.268989 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4c8202-c413-418b-8ea2-2268fca605d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:14.269279 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4c8202-c413-418b-8ea2-2268fca605d0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:14.272143 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94ffb73-4025-4b95-9c47-56af200b5292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:14.272787 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94ffb73-4025-4b95-9c47-56af200b5292 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:14.273068 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94ffb73-4025-4b95-9c47-56af200b5292 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:14.273343 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94ffb73-4025-4b95-9c47-56af200b5292 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:14.274697 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94ffb73-4025-4b95-9c47-56af200b5292 None admin] RBAC: Adding query filter params (role.id=4fa2a9add9bc4786a62e7b5cae3cc051, scope.project.id=ffff4334538649fdba1beb80cad207fa, user.id=e158f461c66e4d779f23fb7760672897) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:14.275010 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94ffb73-4025-4b95-9c47-56af200b5292 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:14.276451 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4c8202-c413-418b-8ea2-2268fca605d0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:14.276566 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94ffb73-4025-4b95-9c47-56af200b5292 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:14.277876 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4c8202-c413-418b-8ea2-2268fca605d0 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:14.282025 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 286/577] 10.222.0.15 () {56 vars in 1374 bytes} [Tue May 31 14:30:14 2022] GET /identity/v3/role_assignments?user.id=e158f461c66e4d779f23fb7760672897&scope.project.id=ffff4334538649fdba1beb80cad207fa&role.id=4fa2a9add9bc4786a62e7b5cae3cc051 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:14.283982 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12df45c3-9bbc-4d8f-9c97-f7ca54901fc7 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:14.283982 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12df45c3-9bbc-4d8f-9c97-f7ca54901fc7 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:14.283982 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12df45c3-9bbc-4d8f-9c97-f7ca54901fc7 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:14.286408 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 287/578] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:30:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:30:14.286408 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12df45c3-9bbc-4d8f-9c97-f7ca54901fc7 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:14.303495 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-bb4c8202-c413-418b-8ea2-2268fca605d0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 14:30:14.303495 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:14.303495 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:14.303495 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:14.303495 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:14.303495 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:14.303495 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:14.303495 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:14.303495 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:14.303495 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:14.303495 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:14.303495 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:14.303495 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 14:30:14.303495 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 14:30:14.303495 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 14:30:14.304495 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 14:30:14.304495 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:14.304495 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:14.304495 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:14.304495 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:14.304495 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:14.304495 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:14.304495 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:14.304495 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:30:14.304495 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:14.304495 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:14.304495 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:14.304495 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:14.304495 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:14.304495 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:14.304495 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:14.304495 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:14.305415 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 14:30:14.305415 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 14:30:14.305415 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 14:30:14.305415 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 14:30:14.305415 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 14:30:14.305415 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 14:30:14.305415 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 14:30:14.305415 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:30:14.305847 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 292/579] 10.222.0.15 () {56 vars in 1111 bytes} [Tue May 31 14:30:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:14.306689 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4c8202-c413-418b-8ea2-2268fca605d0 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:14.345161 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:14.414305 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12df45c3-9bbc-4d8f-9c97-f7ca54901fc7 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:14.429978 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4c8202-c413-418b-8ea2-2268fca605d0 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:14.454583 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfac3c7-5e32-496c-822f-4be25aac491b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:14.455433 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfac3c7-5e32-496c-822f-4be25aac491b None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:14.455714 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfac3c7-5e32-496c-822f-4be25aac491b None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:14.455984 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfac3c7-5e32-496c-822f-4be25aac491b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:14.467899 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfac3c7-5e32-496c-822f-4be25aac491b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:14.469310 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1653237f-b927-4c07-bd3d-001f9baa1954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:14.469446 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfac3c7-5e32-496c-822f-4be25aac491b None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:14.470585 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1653237f-b927-4c07-bd3d-001f9baa1954 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:14.471014 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1653237f-b927-4c07-bd3d-001f9baa1954 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:14.471500 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1653237f-b927-4c07-bd3d-001f9baa1954 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:14.484053 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1653237f-b927-4c07-bd3d-001f9baa1954 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:14.485510 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1653237f-b927-4c07-bd3d-001f9baa1954 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:14.488444 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-1cfac3c7-5e32-496c-822f-4be25aac491b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:14.488444 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:14.488444 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:14.488444 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:14.488444 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:14.488444 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:14.488444 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:14.488444 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:14.488444 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:14.488444 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:14.488444 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:14.488444 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:14.488444 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 14:30:14.488444 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 14:30:14.488444 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 14:30:14.489430 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 14:30:14.489430 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:14.489430 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:14.489430 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:14.489430 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:14.489430 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:14.489430 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:14.489430 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:14.489430 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:30:14.489430 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:14.489430 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:14.489430 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:14.489430 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:14.489430 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:14.489430 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:14.489430 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:14.489430 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:14.490329 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 14:30:14.490329 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 14:30:14.490329 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:14.490329 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:30:14.490329 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 288/580] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:30:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:14.491210 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02166ef-00e6-4a40-82c6-3ad3c0e18109 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:14.491498 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02166ef-00e6-4a40-82c6-3ad3c0e18109 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:14.491783 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02166ef-00e6-4a40-82c6-3ad3c0e18109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:14.509490 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-a02166ef-00e6-4a40-82c6-3ad3c0e18109 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:30:14.509843 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-1653237f-b927-4c07-bd3d-001f9baa1954 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:14.509843 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:14.509843 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:14.509843 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:14.509843 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:14.509843 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:14.509843 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:14.509843 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:14.509843 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:14.509843 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:14.509843 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:14.509843 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:14.509843 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 14:30:14.509843 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 14:30:14.509843 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 14:30:14.510941 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 14:30:14.510941 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:14.510941 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:14.510941 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:14.510941 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:14.510941 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:14.510941 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:14.510941 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:14.510941 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:30:14.510941 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:14.510941 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:14.510941 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:14.510941 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:14.510941 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:14.510941 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:14.510941 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:14.510941 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:14.511890 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 14:30:14.511890 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 14:30:14.511890 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:14.511890 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:30:14.512111 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-a02166ef-00e6-4a40-82c6-3ad3c0e18109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:30:14.514931 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 293/581] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:30:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:14.516065 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1653237f-b927-4c07-bd3d-001f9baa1954 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:14.519523 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:14.594573 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 289/582] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:30:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 14:30:14.594573 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02166ef-00e6-4a40-82c6-3ad3c0e18109 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:14.619811 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:14.636729 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1653237f-b927-4c07-bd3d-001f9baa1954 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:14.672161 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b107c6ea-3915-4f52-8b86-5ec78b1dccca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:14.672945 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b107c6ea-3915-4f52-8b86-5ec78b1dccca None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:14.673293 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b107c6ea-3915-4f52-8b86-5ec78b1dccca None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:14.673640 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b107c6ea-3915-4f52-8b86-5ec78b1dccca None admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:14.674499 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b107c6ea-3915-4f52-8b86-5ec78b1dccca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:14.675084 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b107c6ea-3915-4f52-8b86-5ec78b1dccca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:14.676617 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b107c6ea-3915-4f52-8b86-5ec78b1dccca None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:14.694326 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 294/583] 10.222.0.15 () {56 vars in 1148 bytes} [Tue May 31 14:30:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:14.694326 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b107c6ea-3915-4f52-8b86-5ec78b1dccca None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:14.703208 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02166ef-00e6-4a40-82c6-3ad3c0e18109 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:14.737139 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3187a041-5a9b-4e53-8db9-ee1344681ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:14.737928 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3187a041-5a9b-4e53-8db9-ee1344681ebd None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:14.738304 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3187a041-5a9b-4e53-8db9-ee1344681ebd None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:14.738749 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3187a041-5a9b-4e53-8db9-ee1344681ebd None admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:14.739544 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3187a041-5a9b-4e53-8db9-ee1344681ebd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:14.739990 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3187a041-5a9b-4e53-8db9-ee1344681ebd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:14.741452 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3187a041-5a9b-4e53-8db9-ee1344681ebd None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:14.753180 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 290/584] 10.222.0.15 () {56 vars in 1109 bytes} [Tue May 31 14:30:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:14.754184 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3187a041-5a9b-4e53-8db9-ee1344681ebd None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:14.762875 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:14.805893 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b107c6ea-3915-4f52-8b86-5ec78b1dccca None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:14.843075 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:14.844712 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcadbdee-e8fc-424d-b373-7115e7fea42e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:14.845400 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcadbdee-e8fc-424d-b373-7115e7fea42e None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:14.845771 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcadbdee-e8fc-424d-b373-7115e7fea42e None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:14.846494 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcadbdee-e8fc-424d-b373-7115e7fea42e None admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:14.846982 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcadbdee-e8fc-424d-b373-7115e7fea42e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:14.847354 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcadbdee-e8fc-424d-b373-7115e7fea42e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:14.848883 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcadbdee-e8fc-424d-b373-7115e7fea42e None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:14.858403 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3187a041-5a9b-4e53-8db9-ee1344681ebd None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:14.861045 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 295/585] 10.222.0.15 () {56 vars in 1109 bytes} [Tue May 31 14:30:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:14.861852 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcadbdee-e8fc-424d-b373-7115e7fea42e None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:14.899444 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918b7870-3cf4-4cee-ba75-8a6cc297cd6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:14.900240 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918b7870-3cf4-4cee-ba75-8a6cc297cd6a None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:14.900516 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918b7870-3cf4-4cee-ba75-8a6cc297cd6a None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:14.900789 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918b7870-3cf4-4cee-ba75-8a6cc297cd6a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:14.911796 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918b7870-3cf4-4cee-ba75-8a6cc297cd6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 14:30:14.921560 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-918b7870-3cf4-4cee-ba75-8a6cc297cd6a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 31 14:30:14.921560 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:14.921560 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:14.921560 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:14.921560 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:14.921560 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:14.921560 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:14.921560 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:14.921560 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:14.921560 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:14.921560 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:14.921560 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:14.921560 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 14:30:14.921560 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 14:30:14.921560 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 14:30:14.921560 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 14:30:14.922500 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 14:30:14.922500 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 14:30:14.922500 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 14:30:14.922500 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 14:30:14.922500 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:14.922500 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:14.922500 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:14.922500 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:14.922500 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:14.922500 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:14.922500 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:14.922500 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:30:14.922500 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:14.922500 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:14.922500 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:14.922500 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:14.923419 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:14.923419 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:14.923419 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:14.923419 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:14.923419 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 14:30:14.923419 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 14:30:14.923419 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 14:30:14.923419 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 14:30:14.923419 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 14:30:14.923419 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 14:30:14.923419 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 31 14:30:14.923419 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:30:14.923419 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 291/586] 10.222.0.15 () {56 vars in 1102 bytes} [Tue May 31 14:30:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:14.924122 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918b7870-3cf4-4cee-ba75-8a6cc297cd6a None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:14.968651 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcadbdee-e8fc-424d-b373-7115e7fea42e None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:14.990580 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:15.003886 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d05b13f-fc1f-49ac-969d-f0baaf27b846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:15.004850 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d05b13f-fc1f-49ac-969d-f0baaf27b846 None admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:15.005143 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d05b13f-fc1f-49ac-969d-f0baaf27b846 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:15.005422 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d05b13f-fc1f-49ac-969d-f0baaf27b846 None admin] PATH_INFO: `/v3/projects/ffff4334538649fdba1beb80cad207fa/users/b57768d448e345ad8879bf29f21b48ea/roles/4fa2a9add9bc4786a62e7b5cae3cc051` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:15.020650 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d05b13f-fc1f-49ac-969d-f0baaf27b846 None admin] RBAC: Authorizing `identity:create_grant(project_id=ffff4334538649fdba1beb80cad207fa, user_id=b57768d448e345ad8879bf29f21b48ea, role_id=4fa2a9add9bc4786a62e7b5cae3cc051)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:15.022496 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d05b13f-fc1f-49ac-969d-f0baaf27b846 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:15.040856 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918b7870-3cf4-4cee-ba75-8a6cc297cd6a None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:15.074466 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33194990-8f53-4dae-a54f-d3ca677990e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:15.075309 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33194990-8f53-4dae-a54f-d3ca677990e3 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:15.075617 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33194990-8f53-4dae-a54f-d3ca677990e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:15.075876 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33194990-8f53-4dae-a54f-d3ca677990e3 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:15.083761 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33194990-8f53-4dae-a54f-d3ca677990e3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:15.085910 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33194990-8f53-4dae-a54f-d3ca677990e3 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:15.098668 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 296/587] 10.222.0.15 () {58 vars in 1439 bytes} [Tue May 31 14:30:14 2022] PUT /identity/v3/projects/ffff4334538649fdba1beb80cad207fa/users/b57768d448e345ad8879bf29f21b48ea/roles/4fa2a9add9bc4786a62e7b5cae3cc051 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:30:15.098668 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d05b13f-fc1f-49ac-969d-f0baaf27b846 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:15.108924 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-33194990-8f53-4dae-a54f-d3ca677990e3 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 31 14:30:15.108924 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:15.108924 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:15.108924 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:15.108924 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:15.108924 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:15.108924 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:15.108924 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:15.108924 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:15.108924 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:15.108924 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:15.108924 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:15.108924 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 14:30:15.108924 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 14:30:15.108924 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 14:30:15.108924 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 14:30:15.110023 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:15.110023 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:15.110023 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 14:30:15.110023 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 14:30:15.110023 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 14:30:15.110023 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 14:30:15.110023 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:15.110023 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:15.110023 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:15.110023 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:15.110023 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:15.110023 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:30:15.110023 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:15.110023 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:15.110023 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:15.110023 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:15.110023 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:15.110023 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:15.110997 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:15.110997 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:15.110997 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 14:30:15.110997 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 14:30:15.110997 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 14:30:15.110997 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 14:30:15.110997 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 14:30:15.110997 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 14:30:15.110997 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 31 14:30:15.110997 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:30:15.115037 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 292/588] 10.222.0.15 () {56 vars in 1099 bytes} [Tue May 31 14:30:14 2022] GET /identity/v3/users/glance => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:15.116031 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33194990-8f53-4dae-a54f-d3ca677990e3 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:15.130828 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:15.240944 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d05b13f-fc1f-49ac-969d-f0baaf27b846 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:15.249041 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33194990-8f53-4dae-a54f-d3ca677990e3 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:15.290177 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebd9779-ba47-4f16-af6b-d3fc575a0e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:15.291662 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebd9779-ba47-4f16-af6b-d3fc575a0e52 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:15.292201 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebd9779-ba47-4f16-af6b-d3fc575a0e52 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:15.292585 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebd9779-ba47-4f16-af6b-d3fc575a0e52 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:15.299472 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9432e9-7b6f-437f-89d7-8617eca3d237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:15.303535 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9432e9-7b6f-437f-89d7-8617eca3d237 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:15.303535 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9432e9-7b6f-437f-89d7-8617eca3d237 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:15.303535 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9432e9-7b6f-437f-89d7-8617eca3d237 None admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:15.303535 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9432e9-7b6f-437f-89d7-8617eca3d237 None admin] RBAC: Adding query filter params (name=service) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:15.303535 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9432e9-7b6f-437f-89d7-8617eca3d237 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:15.304814 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9432e9-7b6f-437f-89d7-8617eca3d237 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:15.312731 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebd9779-ba47-4f16-af6b-d3fc575a0e52 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:15.314190 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebd9779-ba47-4f16-af6b-d3fc575a0e52 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:15.319346 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 293/589] 10.222.0.15 () {56 vars in 1103 bytes} [Tue May 31 14:30:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:15.320197 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9432e9-7b6f-437f-89d7-8617eca3d237 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:15.331229 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-5ebd9779-ba47-4f16-af6b-d3fc575a0e52 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 14:30:15.331229 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:15.331229 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:15.331229 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:15.331229 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:15.331229 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:15.331229 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:15.331229 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:15.331229 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:15.331229 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:15.331229 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:15.331229 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:15.331229 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 14:30:15.331229 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 14:30:15.331229 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 14:30:15.332183 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 14:30:15.332183 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:15.332183 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:15.332183 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:15.332183 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:15.332183 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:15.332183 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:15.332183 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:15.332183 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:30:15.332183 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:15.332183 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:15.332183 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:15.332183 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:15.332183 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:15.332183 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:15.332183 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:15.332183 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:15.333124 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 14:30:15.333124 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 14:30:15.333124 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 14:30:15.333124 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 14:30:15.333124 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 14:30:15.333124 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 14:30:15.333124 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 14:30:15.333124 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:30:15.333124 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 297/590] 10.222.0.15 () {56 vars in 1111 bytes} [Tue May 31 14:30:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:15.339665 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebd9779-ba47-4f16-af6b-d3fc575a0e52 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:15.379011 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:15.403038 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:15.440853 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9432e9-7b6f-437f-89d7-8617eca3d237 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:15.473876 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebd9779-ba47-4f16-af6b-d3fc575a0e52 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:15.485903 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43614e2e-9410-4305-925f-d52d7297ffd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:15.486951 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43614e2e-9410-4305-925f-d52d7297ffd9 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:15.487376 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43614e2e-9410-4305-925f-d52d7297ffd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:15.487880 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43614e2e-9410-4305-925f-d52d7297ffd9 None admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:15.488865 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43614e2e-9410-4305-925f-d52d7297ffd9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:15.489336 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43614e2e-9410-4305-925f-d52d7297ffd9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:15.491052 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43614e2e-9410-4305-925f-d52d7297ffd9 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:15.511612 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 294/591] 10.222.0.15 () {56 vars in 1137 bytes} [Tue May 31 14:30:15 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:15.512671 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43614e2e-9410-4305-925f-d52d7297ffd9 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:15.520596 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7c3cc8-fb62-48e2-9216-f8741be788a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:15.521485 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7c3cc8-fb62-48e2-9216-f8741be788a8 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:15.521841 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7c3cc8-fb62-48e2-9216-f8741be788a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:15.522190 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7c3cc8-fb62-48e2-9216-f8741be788a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:15.537958 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7c3cc8-fb62-48e2-9216-f8741be788a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:15.540614 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7c3cc8-fb62-48e2-9216-f8741be788a8 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:15.565534 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-ad7c3cc8-fb62-48e2-9216-f8741be788a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:15.565534 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:15.565534 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:15.565534 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:15.565534 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:15.565534 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:15.565534 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:15.565534 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:15.565534 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:15.565534 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:15.565534 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:15.565534 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:15.565534 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 14:30:15.565534 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 14:30:15.565534 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 14:30:15.566689 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 14:30:15.566689 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:15.566689 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:15.566689 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:15.566689 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:15.566689 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:15.566689 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:15.566689 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:15.566689 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:30:15.566689 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:15.566689 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:15.566689 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:15.566689 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:15.566689 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:15.566689 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:15.566689 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:15.566689 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:15.567790 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 14:30:15.567790 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 14:30:15.567790 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:15.567790 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:30:15.569206 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 298/592] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:30:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:15.570162 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7c3cc8-fb62-48e2-9216-f8741be788a8 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:15.630345 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43614e2e-9410-4305-925f-d52d7297ffd9 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:15.666137 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:15.678579 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55c5b38-c375-46ab-91ec-5dd65a0a4520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:15.679450 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c5b38-c375-46ab-91ec-5dd65a0a4520 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:15.679745 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c5b38-c375-46ab-91ec-5dd65a0a4520 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:15.680056 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c5b38-c375-46ab-91ec-5dd65a0a4520 None admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:15.681097 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55c5b38-c375-46ab-91ec-5dd65a0a4520 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:15.681424 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55c5b38-c375-46ab-91ec-5dd65a0a4520 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:15.683654 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55c5b38-c375-46ab-91ec-5dd65a0a4520 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:15.685224 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:15.699618 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 295/593] 10.222.0.15 () {56 vars in 1148 bytes} [Tue May 31 14:30:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:15.700581 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55c5b38-c375-46ab-91ec-5dd65a0a4520 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:15.705541 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7c3cc8-fb62-48e2-9216-f8741be788a8 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:15.747968 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed97c69-b5b2-4b0b-aa4d-5f732e322860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:15.749404 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed97c69-b5b2-4b0b-aa4d-5f732e322860 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:15.749870 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed97c69-b5b2-4b0b-aa4d-5f732e322860 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:15.750302 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed97c69-b5b2-4b0b-aa4d-5f732e322860 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:15.764709 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed97c69-b5b2-4b0b-aa4d-5f732e322860 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:15.766853 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed97c69-b5b2-4b0b-aa4d-5f732e322860 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:15.788171 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-0ed97c69-b5b2-4b0b-aa4d-5f732e322860 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:15.788171 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:15.788171 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:15.788171 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:15.788171 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:15.788171 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:15.788171 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:15.788171 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:15.788171 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:15.788171 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:15.788171 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:15.788171 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:15.788171 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 14:30:15.788171 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 14:30:15.788171 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 14:30:15.789298 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 14:30:15.789298 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:15.789298 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:15.789298 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:15.789298 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:15.789298 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:15.789298 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:15.789298 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:15.789298 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:30:15.789298 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:15.789298 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:15.789298 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:15.789298 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:15.789298 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:15.789298 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:15.789298 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:15.789298 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:15.790387 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 14:30:15.790387 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 14:30:15.790387 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:15.790387 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:30:15.791921 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 299/594] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:30:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:15.792828 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed97c69-b5b2-4b0b-aa4d-5f732e322860 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:15.831943 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55c5b38-c375-46ab-91ec-5dd65a0a4520 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:15.881258 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa039bf4-f0b5-45a1-af37-6e05017abaff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:15.882445 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa039bf4-f0b5-45a1-af37-6e05017abaff None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:15.882931 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa039bf4-f0b5-45a1-af37-6e05017abaff None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:15.884150 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa039bf4-f0b5-45a1-af37-6e05017abaff None admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:15.885415 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa039bf4-f0b5-45a1-af37-6e05017abaff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:15.885878 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa039bf4-f0b5-45a1-af37-6e05017abaff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:15.887453 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa039bf4-f0b5-45a1-af37-6e05017abaff None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:15.900430 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed97c69-b5b2-4b0b-aa4d-5f732e322860 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:15.905890 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 296/595] 10.222.0.15 () {56 vars in 1109 bytes} [Tue May 31 14:30:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:15.906966 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa039bf4-f0b5-45a1-af37-6e05017abaff None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:15.950613 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d56d37d-5a88-41eb-af96-b27b78de8334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:15.951684 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d56d37d-5a88-41eb-af96-b27b78de8334 None admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:15.952057 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d56d37d-5a88-41eb-af96-b27b78de8334 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:15.952447 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d56d37d-5a88-41eb-af96-b27b78de8334 None admin] PATH_INFO: `/v3/projects/ffff4334538649fdba1beb80cad207fa/users/afbf718dcd9b4741a926b0a2321bd53e/roles/4fa2a9add9bc4786a62e7b5cae3cc051` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:15.957809 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:15.969793 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d56d37d-5a88-41eb-af96-b27b78de8334 None admin] RBAC: Authorizing `identity:create_grant(project_id=ffff4334538649fdba1beb80cad207fa, user_id=afbf718dcd9b4741a926b0a2321bd53e, role_id=4fa2a9add9bc4786a62e7b5cae3cc051)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:15.975187 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d56d37d-5a88-41eb-af96-b27b78de8334 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:15.975309 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:16.026988 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa039bf4-f0b5-45a1-af37-6e05017abaff None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:16.082898 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 300/596] 10.222.0.15 () {58 vars in 1439 bytes} [Tue May 31 14:30:15 2022] PUT /identity/v3/projects/ffff4334538649fdba1beb80cad207fa/users/afbf718dcd9b4741a926b0a2321bd53e/roles/4fa2a9add9bc4786a62e7b5cae3cc051 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:30:16.082898 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d56d37d-5a88-41eb-af96-b27b78de8334 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:16.102460 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f222461-deb8-4029-8315-7dbc2518e4a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:16.103172 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f222461-deb8-4029-8315-7dbc2518e4a9 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:16.103466 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f222461-deb8-4029-8315-7dbc2518e4a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:16.105377 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f222461-deb8-4029-8315-7dbc2518e4a9 None admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:16.105377 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f222461-deb8-4029-8315-7dbc2518e4a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:16.105925 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f222461-deb8-4029-8315-7dbc2518e4a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:16.110584 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f222461-deb8-4029-8315-7dbc2518e4a9 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:16.134674 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 297/597] 10.222.0.15 () {56 vars in 1109 bytes} [Tue May 31 14:30:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:16.138573 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f222461-deb8-4029-8315-7dbc2518e4a9 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:16.310592 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d56d37d-5a88-41eb-af96-b27b78de8334 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:16.386786 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f222461-deb8-4029-8315-7dbc2518e4a9 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:16.393707 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd9009a-a806-4486-ae53-b60fb8e738b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:16.394528 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd9009a-a806-4486-ae53-b60fb8e738b8 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:16.394846 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd9009a-a806-4486-ae53-b60fb8e738b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:16.395130 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd9009a-a806-4486-ae53-b60fb8e738b8 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:16.407450 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:16.411339 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd9009a-a806-4486-ae53-b60fb8e738b8 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:16.413674 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd9009a-a806-4486-ae53-b60fb8e738b8 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:16.438584 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-6dd9009a-a806-4486-ae53-b60fb8e738b8 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 31 14:30:16.438584 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:16.438584 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:16.438584 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:16.438584 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:16.438584 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:16.438584 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:16.438584 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:16.438584 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:16.438584 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:16.438584 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:16.438584 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:16.438584 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 14:30:16.438584 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 14:30:16.438584 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 14:30:16.438584 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 14:30:16.439735 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:16.439735 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:16.439735 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 14:30:16.439735 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 14:30:16.439735 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 14:30:16.439735 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 14:30:16.439735 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:16.439735 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:16.439735 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:16.439735 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:16.439735 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:16.439735 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:30:16.439735 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:16.439735 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:16.439735 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:16.439735 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:16.439735 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:16.439735 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:16.440953 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:16.440953 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:16.440953 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 14:30:16.440953 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 14:30:16.440953 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 14:30:16.440953 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 14:30:16.440953 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 14:30:16.440953 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 14:30:16.440953 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 31 14:30:16.440953 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:30:16.447520 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 301/598] 10.222.0.15 () {56 vars in 1102 bytes} [Tue May 31 14:30:16 2022] GET /identity/v3/users/neutron => generated 85 bytes in 382 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:16.450655 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd9009a-a806-4486-ae53-b60fb8e738b8 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:16.474424 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07158eab-f8f8-42bd-9550-e8a3a09d887f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:16.475355 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07158eab-f8f8-42bd-9550-e8a3a09d887f None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:16.475772 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07158eab-f8f8-42bd-9550-e8a3a09d887f None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:16.476122 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07158eab-f8f8-42bd-9550-e8a3a09d887f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:16.490160 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07158eab-f8f8-42bd-9550-e8a3a09d887f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:16.493166 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07158eab-f8f8-42bd-9550-e8a3a09d887f None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:16.513142 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-07158eab-f8f8-42bd-9550-e8a3a09d887f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 14:30:16.513142 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:16.513142 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:16.513142 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:16.513142 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:16.513142 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:16.513142 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:16.513142 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:16.513142 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:16.513142 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:16.513142 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:16.513142 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:16.513142 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 14:30:16.513142 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 14:30:16.513142 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 14:30:16.514211 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 14:30:16.514211 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:16.514211 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:16.514211 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:16.514211 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:16.514211 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:16.514211 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:16.514211 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:16.514211 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:30:16.514211 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:16.514211 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:16.514211 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:16.514211 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:16.514211 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:16.514211 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:16.514211 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:16.514211 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:16.515397 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 14:30:16.515397 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 14:30:16.515397 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 14:30:16.515397 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 14:30:16.515397 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 14:30:16.515397 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 14:30:16.515397 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 14:30:16.515397 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:30:16.517466 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 298/599] 10.222.0.15 () {56 vars in 1111 bytes} [Tue May 31 14:30:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 381 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:16.530796 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07158eab-f8f8-42bd-9550-e8a3a09d887f None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:16.539936 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:16.662094 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd9009a-a806-4486-ae53-b60fb8e738b8 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:16.708725 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07158eab-f8f8-42bd-9550-e8a3a09d887f None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:16.718717 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003093e4-6cd0-41d5-ae70-c0e9e65b75b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:16.719405 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003093e4-6cd0-41d5-ae70-c0e9e65b75b5 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:16.721494 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003093e4-6cd0-41d5-ae70-c0e9e65b75b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:16.721788 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003093e4-6cd0-41d5-ae70-c0e9e65b75b5 None admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:16.722699 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003093e4-6cd0-41d5-ae70-c0e9e65b75b5 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:16.723017 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003093e4-6cd0-41d5-ae70-c0e9e65b75b5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:16.724461 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003093e4-6cd0-41d5-ae70-c0e9e65b75b5 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:16.747141 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 302/600] 10.222.0.15 () {56 vars in 1139 bytes} [Tue May 31 14:30:16 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:16.748465 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d639437b-d6f8-420b-99af-df665dc9c8bb None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:16.748909 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d639437b-d6f8-420b-99af-df665dc9c8bb None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:16.749014 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d639437b-d6f8-420b-99af-df665dc9c8bb None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:16.754801 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 303/601] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:30:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:30:16.755597 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d639437b-d6f8-420b-99af-df665dc9c8bb None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:16.798579 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3574faf2-6fa8-4fec-bbe9-a7c8487d022d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:16.798579 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3574faf2-6fa8-4fec-bbe9-a7c8487d022d None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:16.798579 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3574faf2-6fa8-4fec-bbe9-a7c8487d022d None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:16.798579 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3574faf2-6fa8-4fec-bbe9-a7c8487d022d None admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:16.799000 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3574faf2-6fa8-4fec-bbe9-a7c8487d022d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:16.799000 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3574faf2-6fa8-4fec-bbe9-a7c8487d022d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:16.802582 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3574faf2-6fa8-4fec-bbe9-a7c8487d022d None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:16.814601 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 299/602] 10.222.0.15 () {56 vars in 1148 bytes} [Tue May 31 14:30:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:16.815566 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f0689-6879-4dda-b923-161f78d0580d None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:16.818594 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f0689-6879-4dda-b923-161f78d0580d None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:16.818594 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f0689-6879-4dda-b923-161f78d0580d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:16.833304 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-ef9f0689-6879-4dda-b923-161f78d0580d None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:30:16.834494 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-ef9f0689-6879-4dda-b923-161f78d0580d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:30:16.857112 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:16.907082 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d639437b-d6f8-420b-99af-df665dc9c8bb None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:16.912289 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:16.920766 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 300/603] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:30:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 14:30:16.921377 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9f0689-6879-4dda-b923-161f78d0580d None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:16.953009 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243e859b-e0b8-4b75-8ba4-99c88fa68a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:16.954334 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243e859b-e0b8-4b75-8ba4-99c88fa68a22 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:16.954971 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243e859b-e0b8-4b75-8ba4-99c88fa68a22 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:16.955510 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243e859b-e0b8-4b75-8ba4-99c88fa68a22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:16.968066 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243e859b-e0b8-4b75-8ba4-99c88fa68a22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:16.969942 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243e859b-e0b8-4b75-8ba4-99c88fa68a22 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:16.990147 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-243e859b-e0b8-4b75-8ba4-99c88fa68a22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:16.990147 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:16.990147 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:16.990147 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:16.990147 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:16.990147 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:16.990147 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:16.990147 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:16.990147 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:16.990147 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:16.990147 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:16.990147 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:16.990147 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 14:30:16.990147 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 14:30:16.990147 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 14:30:16.991158 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 14:30:16.991158 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:16.991158 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:16.991158 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:16.991158 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:16.991158 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:16.991158 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:16.991158 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:16.991158 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:30:16.991158 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:16.991158 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:16.991158 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:16.991158 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:16.991158 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:16.991158 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:16.991158 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:16.991158 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:16.992062 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 14:30:16.992062 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 14:30:16.992062 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:16.992062 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:30:16.994463 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 304/604] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:30:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:16.999861 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243e859b-e0b8-4b75-8ba4-99c88fa68a22 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:17.026115 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9f0689-6879-4dda-b923-161f78d0580d None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:17.061872 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e80c338-aaef-4da6-958d-c1c900c1477f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:17.062782 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e80c338-aaef-4da6-958d-c1c900c1477f None admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:17.063061 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e80c338-aaef-4da6-958d-c1c900c1477f None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:17.063339 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e80c338-aaef-4da6-958d-c1c900c1477f None admin] PATH_INFO: `/v3/projects/ffff4334538649fdba1beb80cad207fa/users/14ba98b007cc4ae1b20e7f261824b77c/roles/4fa2a9add9bc4786a62e7b5cae3cc051` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:17.078846 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e80c338-aaef-4da6-958d-c1c900c1477f None admin] RBAC: Authorizing `identity:create_grant(project_id=ffff4334538649fdba1beb80cad207fa, user_id=14ba98b007cc4ae1b20e7f261824b77c, role_id=4fa2a9add9bc4786a62e7b5cae3cc051)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:17.080319 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e80c338-aaef-4da6-958d-c1c900c1477f None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:17.113914 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243e859b-e0b8-4b75-8ba4-99c88fa68a22 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:17.152447 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af92bde-a0d7-4f2f-984a-ab1046843a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:17.153244 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af92bde-a0d7-4f2f-984a-ab1046843a60 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:17.153524 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af92bde-a0d7-4f2f-984a-ab1046843a60 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:17.153807 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af92bde-a0d7-4f2f-984a-ab1046843a60 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:17.165055 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af92bde-a0d7-4f2f-984a-ab1046843a60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 14:30:17.172951 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-9af92bde-a0d7-4f2f-984a-ab1046843a60 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 31 14:30:17.172951 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:17.172951 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:17.172951 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:17.172951 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:17.172951 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:17.172951 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:17.172951 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:17.172951 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:17.172951 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:17.172951 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:17.172951 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:17.172951 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 14:30:17.172951 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 14:30:17.172951 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 14:30:17.172951 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 14:30:17.173925 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 14:30:17.173925 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 14:30:17.173925 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 14:30:17.173925 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 14:30:17.173925 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:17.173925 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:17.173925 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:17.173925 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:17.173925 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:17.173925 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:17.173925 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:17.173925 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:30:17.173925 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:17.173925 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:17.173925 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:17.173925 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:17.175205 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:17.175205 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:17.175205 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:17.175205 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:17.175205 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 14:30:17.175205 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 14:30:17.175205 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 14:30:17.175205 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 14:30:17.175205 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 14:30:17.175205 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 14:30:17.175205 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 31 14:30:17.175205 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:30:17.175205 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 305/605] 10.222.0.15 () {56 vars in 1102 bytes} [Tue May 31 14:30:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:17.175934 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af92bde-a0d7-4f2f-984a-ab1046843a60 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:17.187012 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 301/606] 10.222.0.15 () {58 vars in 1439 bytes} [Tue May 31 14:30:16 2022] PUT /identity/v3/projects/ffff4334538649fdba1beb80cad207fa/users/14ba98b007cc4ae1b20e7f261824b77c/roles/4fa2a9add9bc4786a62e7b5cae3cc051 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:30:17.187877 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e80c338-aaef-4da6-958d-c1c900c1477f None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:17.199051 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:17.211189 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:17.323262 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af92bde-a0d7-4f2f-984a-ab1046843a60 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:17.374458 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37b6b76-8f09-466e-b858-cf5f759ae48d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:17.375255 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37b6b76-8f09-466e-b858-cf5f759ae48d None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:17.375555 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37b6b76-8f09-466e-b858-cf5f759ae48d None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:17.375930 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37b6b76-8f09-466e-b858-cf5f759ae48d None admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:17.377252 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37b6b76-8f09-466e-b858-cf5f759ae48d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:17.377849 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37b6b76-8f09-466e-b858-cf5f759ae48d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:17.380473 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37b6b76-8f09-466e-b858-cf5f759ae48d None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:17.395241 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 306/607] 10.222.0.15 () {56 vars in 1109 bytes} [Tue May 31 14:30:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:17.401070 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37b6b76-8f09-466e-b858-cf5f759ae48d None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:17.404812 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e80c338-aaef-4da6-958d-c1c900c1477f None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:17.486718 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa7f109-58c6-40d5-8e16-15506e3d8016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:17.487339 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa7f109-58c6-40d5-8e16-15506e3d8016 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:17.487904 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa7f109-58c6-40d5-8e16-15506e3d8016 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:17.487904 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa7f109-58c6-40d5-8e16-15506e3d8016 None admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:17.488625 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa7f109-58c6-40d5-8e16-15506e3d8016 None admin] RBAC: Adding query filter params (name=service) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:17.488927 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa7f109-58c6-40d5-8e16-15506e3d8016 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:17.491483 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa7f109-58c6-40d5-8e16-15506e3d8016 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:17.503221 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 302/608] 10.222.0.15 () {56 vars in 1103 bytes} [Tue May 31 14:30:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:17.512093 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa7f109-58c6-40d5-8e16-15506e3d8016 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:17.533292 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:17.560633 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37b6b76-8f09-466e-b858-cf5f759ae48d None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:17.598892 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607d40ae-e183-4385-bf7a-6437b7fe3005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:17.599936 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d40ae-e183-4385-bf7a-6437b7fe3005 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:17.600363 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d40ae-e183-4385-bf7a-6437b7fe3005 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:17.600780 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d40ae-e183-4385-bf7a-6437b7fe3005 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:17.608343 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:17.609903 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607d40ae-e183-4385-bf7a-6437b7fe3005 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:17.611560 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607d40ae-e183-4385-bf7a-6437b7fe3005 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:17.627207 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-607d40ae-e183-4385-bf7a-6437b7fe3005 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 14:30:17.627207 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:17.627207 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:17.627207 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:17.627207 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:17.627207 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:17.627207 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:17.627207 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:17.627207 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:17.627207 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:17.627207 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:17.627207 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:17.627207 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 14:30:17.627207 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 14:30:17.627207 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 14:30:17.628410 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 14:30:17.628410 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:17.628410 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:17.628410 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:17.628410 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:17.628410 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:17.628410 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:17.628410 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:17.628410 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:30:17.628410 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:17.628410 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:17.628410 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:17.628410 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:17.628410 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:17.628410 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:17.628410 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:17.628410 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:17.629492 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 14:30:17.629492 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 14:30:17.629492 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 14:30:17.629492 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 14:30:17.629492 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 14:30:17.629492 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 14:30:17.629492 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 14:30:17.629492 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:30:17.631828 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 307/609] 10.222.0.15 () {56 vars in 1111 bytes} [Tue May 31 14:30:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:17.642160 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607d40ae-e183-4385-bf7a-6437b7fe3005 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:17.681021 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa7f109-58c6-40d5-8e16-15506e3d8016 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:17.716920 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570860d0-84c7-4d4f-a6a3-32e302014108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:17.717713 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570860d0-84c7-4d4f-a6a3-32e302014108 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:17.717993 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570860d0-84c7-4d4f-a6a3-32e302014108 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:17.718268 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570860d0-84c7-4d4f-a6a3-32e302014108 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:17.730229 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570860d0-84c7-4d4f-a6a3-32e302014108 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:17.732519 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570860d0-84c7-4d4f-a6a3-32e302014108 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:17.755091 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-570860d0-84c7-4d4f-a6a3-32e302014108 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:17.755091 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:17.755091 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:17.755091 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:17.755091 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:17.755091 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:17.755091 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:17.755091 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:17.755091 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:17.755091 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:17.755091 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:17.755091 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:17.755091 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 14:30:17.755091 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 14:30:17.755091 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 14:30:17.756011 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 14:30:17.756011 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:17.756011 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:17.756011 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:17.756011 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:17.756011 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:17.756011 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:17.756011 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:17.756011 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:30:17.756011 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:17.756011 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:17.756011 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:17.756011 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:17.756011 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:17.756011 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:17.756011 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:17.756011 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:17.756904 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 14:30:17.756904 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 14:30:17.756904 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:17.756904 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:30:17.756904 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 303/610] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:30:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:17.758404 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb27ea69-53c5-4772-ab93-6acf430f94a9 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:17.758802 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb27ea69-53c5-4772-ab93-6acf430f94a9 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:17.759196 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb27ea69-53c5-4772-ab93-6acf430f94a9 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:17.765125 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 304/611] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:30:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:30:17.766425 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb27ea69-53c5-4772-ab93-6acf430f94a9 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:17.771438 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607d40ae-e183-4385-bf7a-6437b7fe3005 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:17.812042 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881959de-7325-4b07-a892-e084326213a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:17.812820 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881959de-7325-4b07-a892-e084326213a0 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:17.813211 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881959de-7325-4b07-a892-e084326213a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:17.813560 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881959de-7325-4b07-a892-e084326213a0 None admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:17.814489 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881959de-7325-4b07-a892-e084326213a0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:17.814897 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881959de-7325-4b07-a892-e084326213a0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:17.816438 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881959de-7325-4b07-a892-e084326213a0 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:17.819616 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:17.836082 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 308/612] 10.222.0.15 () {56 vars in 1148 bytes} [Tue May 31 14:30:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:17.837703 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478b9406-683c-43f3-b703-9fcd55a281e5 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:17.838286 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478b9406-683c-43f3-b703-9fcd55a281e5 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:17.838781 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478b9406-683c-43f3-b703-9fcd55a281e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:17.856666 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-478b9406-683c-43f3-b703-9fcd55a281e5 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:30:17.858235 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-478b9406-683c-43f3-b703-9fcd55a281e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:30:17.888158 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb27ea69-53c5-4772-ab93-6acf430f94a9 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:17.915510 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:17.937064 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e28e332-de3a-4629-a7bd-7bf79585df1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:17.938175 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e28e332-de3a-4629-a7bd-7bf79585df1d None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:17.938854 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e28e332-de3a-4629-a7bd-7bf79585df1d None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:17.939440 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e28e332-de3a-4629-a7bd-7bf79585df1d None admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:17.940503 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e28e332-de3a-4629-a7bd-7bf79585df1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:17.940716 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 309/613] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:30:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 14:30:17.941743 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478b9406-683c-43f3-b703-9fcd55a281e5 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:17.946964 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e28e332-de3a-4629-a7bd-7bf79585df1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:17.949286 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e28e332-de3a-4629-a7bd-7bf79585df1d None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:17.972262 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 305/614] 10.222.0.15 () {56 vars in 1109 bytes} [Tue May 31 14:30:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:17.974479 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e28e332-de3a-4629-a7bd-7bf79585df1d None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:18.066854 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478b9406-683c-43f3-b703-9fcd55a281e5 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:18.099972 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:18.110423 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e28e332-de3a-4629-a7bd-7bf79585df1d None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:18.112762 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e51b61-fbc8-424e-9ad8-49ec700b50ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:18.112762 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e51b61-fbc8-424e-9ad8-49ec700b50ed None admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:18.113066 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e51b61-fbc8-424e-9ad8-49ec700b50ed None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:18.113298 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e51b61-fbc8-424e-9ad8-49ec700b50ed None admin] PATH_INFO: `/v3/projects/ffff4334538649fdba1beb80cad207fa/users/c5262f4b9b2948fdb3b4ab504311453b/roles/4fa2a9add9bc4786a62e7b5cae3cc051` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:18.137938 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e51b61-fbc8-424e-9ad8-49ec700b50ed None admin] RBAC: Authorizing `identity:create_grant(project_id=ffff4334538649fdba1beb80cad207fa, user_id=c5262f4b9b2948fdb3b4ab504311453b, role_id=4fa2a9add9bc4786a62e7b5cae3cc051)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:18.139588 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e51b61-fbc8-424e-9ad8-49ec700b50ed None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:18.148081 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f162f3-3c79-43d0-9362-d33fa4036cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:18.149802 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f162f3-3c79-43d0-9362-d33fa4036cf8 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:18.150307 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f162f3-3c79-43d0-9362-d33fa4036cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:18.150847 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f162f3-3c79-43d0-9362-d33fa4036cf8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:18.161811 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f162f3-3c79-43d0-9362-d33fa4036cf8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 14:30:18.170414 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-42f162f3-3c79-43d0-9362-d33fa4036cf8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 31 14:30:18.170414 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:18.170414 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:18.170414 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:18.170414 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:18.170414 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:18.170414 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:18.170414 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:18.170414 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:18.170414 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:18.170414 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:18.170414 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:18.170414 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 14:30:18.170414 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 14:30:18.170414 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 14:30:18.170414 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 14:30:18.171625 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 14:30:18.171625 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 14:30:18.171625 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 14:30:18.171625 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 14:30:18.171625 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:18.171625 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:18.171625 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:18.171625 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:18.171625 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:18.171625 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:18.171625 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:18.171625 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:30:18.171625 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:18.171625 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:18.171625 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:18.171625 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:18.172696 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:18.172696 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:18.172696 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:18.172696 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:18.172696 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 14:30:18.172696 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 14:30:18.172696 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 14:30:18.172696 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 14:30:18.172696 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 14:30:18.172696 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 14:30:18.172696 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 31 14:30:18.172696 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:30:18.178386 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 306/615] 10.222.0.15 () {56 vars in 1102 bytes} [Tue May 31 14:30:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:18.178386 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f162f3-3c79-43d0-9362-d33fa4036cf8 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:18.230787 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 310/616] 10.222.0.15 () {58 vars in 1439 bytes} [Tue May 31 14:30:17 2022] PUT /identity/v3/projects/ffff4334538649fdba1beb80cad207fa/users/c5262f4b9b2948fdb3b4ab504311453b/roles/4fa2a9add9bc4786a62e7b5cae3cc051 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:30:18.232128 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e51b61-fbc8-424e-9ad8-49ec700b50ed None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:18.235315 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:18.364672 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f162f3-3c79-43d0-9362-d33fa4036cf8 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:18.371477 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e51b61-fbc8-424e-9ad8-49ec700b50ed None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:18.417524 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b481d3-6f12-41df-8745-cf7d02d59fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:18.418638 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b481d3-6f12-41df-8745-cf7d02d59fe8 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:18.419056 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b481d3-6f12-41df-8745-cf7d02d59fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:18.419885 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b481d3-6f12-41df-8745-cf7d02d59fe8 None admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:18.420813 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b481d3-6f12-41df-8745-cf7d02d59fe8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:18.421283 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b481d3-6f12-41df-8745-cf7d02d59fe8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:18.422912 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b481d3-6f12-41df-8745-cf7d02d59fe8 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:18.433600 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 311/617] 10.222.0.15 () {56 vars in 1103 bytes} [Tue May 31 14:30:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:18.439669 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b481d3-6f12-41df-8745-cf7d02d59fe8 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:18.472504 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903f3865-a4e7-45c5-b6fa-bd66ebbdeb79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:18.473348 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903f3865-a4e7-45c5-b6fa-bd66ebbdeb79 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:18.473631 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903f3865-a4e7-45c5-b6fa-bd66ebbdeb79 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:18.473913 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903f3865-a4e7-45c5-b6fa-bd66ebbdeb79 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:18.488030 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:18.499493 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903f3865-a4e7-45c5-b6fa-bd66ebbdeb79 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:18.500980 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903f3865-a4e7-45c5-b6fa-bd66ebbdeb79 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:18.531772 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-903f3865-a4e7-45c5-b6fa-bd66ebbdeb79 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 31 14:30:18.531772 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:18.531772 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:18.531772 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:18.531772 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:18.531772 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:18.531772 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:18.531772 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:18.531772 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:18.531772 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:18.531772 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:18.531772 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:18.531772 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 14:30:18.531772 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 14:30:18.531772 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 14:30:18.531772 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 14:30:18.532825 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:18.532825 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:18.532825 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 14:30:18.532825 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 14:30:18.532825 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 14:30:18.532825 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 14:30:18.532825 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:18.532825 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:18.532825 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:18.532825 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:18.532825 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:18.532825 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:30:18.532825 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:18.532825 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:18.532825 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:18.532825 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:18.532825 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:18.532825 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:18.533797 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:18.533797 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:18.533797 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 14:30:18.533797 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 14:30:18.533797 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 14:30:18.533797 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 14:30:18.533797 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 14:30:18.533797 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 14:30:18.533797 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 31 14:30:18.533797 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:30:18.533797 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 307/618] 10.222.0.15 () {56 vars in 1096 bytes} [Tue May 31 14:30:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:18.542418 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903f3865-a4e7-45c5-b6fa-bd66ebbdeb79 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:18.574376 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b481d3-6f12-41df-8745-cf7d02d59fe8 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:18.617445 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0b8d2b-5f87-41db-bec5-a7178db150da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:18.618998 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0b8d2b-5f87-41db-bec5-a7178db150da None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:18.619431 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0b8d2b-5f87-41db-bec5-a7178db150da None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:18.620147 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0b8d2b-5f87-41db-bec5-a7178db150da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:18.634041 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0b8d2b-5f87-41db-bec5-a7178db150da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:18.636175 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0b8d2b-5f87-41db-bec5-a7178db150da None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:18.655766 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903f3865-a4e7-45c5-b6fa-bd66ebbdeb79 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:18.658827 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:18.665358 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-3e0b8d2b-5f87-41db-bec5-a7178db150da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:18.665358 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:18.665358 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:18.665358 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:18.665358 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:18.665358 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:18.665358 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:18.665358 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:18.665358 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:18.665358 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:18.665358 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:18.665358 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:18.665358 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 14:30:18.665358 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 14:30:18.665358 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 14:30:18.667240 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 14:30:18.667240 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:18.667240 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:18.667240 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:18.667240 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:18.667240 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:18.667240 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:18.667240 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:18.667240 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:30:18.667240 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:18.667240 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:18.667240 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:18.667240 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:18.667240 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:18.667240 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:18.667240 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:18.667240 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:18.668338 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 14:30:18.668338 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 14:30:18.668338 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:18.668338 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:30:18.670474 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 312/619] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:30:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 14:30:18.676154 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0b8d2b-5f87-41db-bec5-a7178db150da None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:18.696679 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3b8a41-6de5-4e50-a313-f5f794421c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:18.697692 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3b8a41-6de5-4e50-a313-f5f794421c41 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:18.698134 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3b8a41-6de5-4e50-a313-f5f794421c41 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:18.698514 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3b8a41-6de5-4e50-a313-f5f794421c41 None admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:18.699472 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3b8a41-6de5-4e50-a313-f5f794421c41 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:18.699884 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3b8a41-6de5-4e50-a313-f5f794421c41 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:18.706592 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3b8a41-6de5-4e50-a313-f5f794421c41 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:18.722614 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 308/620] 10.222.0.15 () {56 vars in 1135 bytes} [Tue May 31 14:30:18 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:18.726502 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3b8a41-6de5-4e50-a313-f5f794421c41 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:18.828857 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3b8a41-6de5-4e50-a313-f5f794421c41 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:18.864130 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f180947f-bd80-444f-9e29-412127aad3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:18.865064 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f180947f-bd80-444f-9e29-412127aad3ff None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:18.865555 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f180947f-bd80-444f-9e29-412127aad3ff None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:18.865810 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f180947f-bd80-444f-9e29-412127aad3ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:18.866931 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:18.883500 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0b8d2b-5f87-41db-bec5-a7178db150da None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:18.883670 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f180947f-bd80-444f-9e29-412127aad3ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:18.883670 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f180947f-bd80-444f-9e29-412127aad3ff None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:18.897478 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-f180947f-bd80-444f-9e29-412127aad3ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:18.897478 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:18.897478 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:18.897478 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:18.897478 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:18.897478 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:18.897478 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:18.897478 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:18.897478 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:18.897478 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:18.897478 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:18.897478 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:18.897478 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 14:30:18.897478 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 14:30:18.897478 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 14:30:18.898451 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 14:30:18.898451 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:18.898451 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:18.898451 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:18.898451 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:18.898451 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:18.898451 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:18.898451 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:18.898451 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:30:18.898451 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:18.898451 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:18.898451 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:18.898451 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:18.898451 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:18.898451 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:18.898451 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:18.898451 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:18.899409 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 14:30:18.899409 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 14:30:18.899409 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:18.899409 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:30:18.899409 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 309/621] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:30:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 14:30:18.905223 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c43f282-ca8b-4ee6-9199-12a6503f7f2a None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:18.905579 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c43f282-ca8b-4ee6-9199-12a6503f7f2a None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:18.905932 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c43f282-ca8b-4ee6-9199-12a6503f7f2a None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:18.907574 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 310/622] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:30:18 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:30:18.908365 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c43f282-ca8b-4ee6-9199-12a6503f7f2a None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:18.922365 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:18.923691 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851d2cdd-a0b0-43c9-8690-6a82c5e34d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:18.924479 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851d2cdd-a0b0-43c9-8690-6a82c5e34d34 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:18.924767 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851d2cdd-a0b0-43c9-8690-6a82c5e34d34 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:18.925049 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851d2cdd-a0b0-43c9-8690-6a82c5e34d34 None admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:18.926282 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851d2cdd-a0b0-43c9-8690-6a82c5e34d34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:18.927017 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851d2cdd-a0b0-43c9-8690-6a82c5e34d34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:18.928709 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851d2cdd-a0b0-43c9-8690-6a82c5e34d34 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:18.950644 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 313/623] 10.222.0.15 () {56 vars in 1109 bytes} [Tue May 31 14:30:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 14:30:18.952172 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c129e4-8882-4ffe-9a3a-129b600a2df1 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:18.952624 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c129e4-8882-4ffe-9a3a-129b600a2df1 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:18.953773 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c129e4-8882-4ffe-9a3a-129b600a2df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:18.970918 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-59c129e4-8882-4ffe-9a3a-129b600a2df1 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:30:18.972096 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-59c129e4-8882-4ffe-9a3a-129b600a2df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:30:19.040716 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c43f282-ca8b-4ee6-9199-12a6503f7f2a None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:19.053951 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 314/624] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:30:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 14:30:19.056310 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c129e4-8882-4ffe-9a3a-129b600a2df1 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:19.089391 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5765ffa-c987-4baf-a65c-8118b73dfcd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:19.090326 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5765ffa-c987-4baf-a65c-8118b73dfcd5 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:19.090634 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5765ffa-c987-4baf-a65c-8118b73dfcd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:19.090917 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5765ffa-c987-4baf-a65c-8118b73dfcd5 None admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:19.091801 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5765ffa-c987-4baf-a65c-8118b73dfcd5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:19.092109 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5765ffa-c987-4baf-a65c-8118b73dfcd5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:19.094070 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5765ffa-c987-4baf-a65c-8118b73dfcd5 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:19.108447 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 311/625] 10.222.0.15 () {56 vars in 1109 bytes} [Tue May 31 14:30:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:19.113843 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5765ffa-c987-4baf-a65c-8118b73dfcd5 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:19.163176 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:19.188891 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c129e4-8882-4ffe-9a3a-129b600a2df1 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:19.201304 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:19.229633 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf119c8-bd79-404a-8877-771c461fb8cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:19.230436 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf119c8-bd79-404a-8877-771c461fb8cf None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:19.230761 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf119c8-bd79-404a-8877-771c461fb8cf None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:19.231034 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf119c8-bd79-404a-8877-771c461fb8cf None admin] PATH_INFO: `/v3/users/nova` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:19.240793 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf119c8-bd79-404a-8877-771c461fb8cf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:19.242723 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5765ffa-c987-4baf-a65c-8118b73dfcd5 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:19.242912 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf119c8-bd79-404a-8877-771c461fb8cf None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:19.260595 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-dcf119c8-bd79-404a-8877-771c461fb8cf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 31 14:30:19.260595 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:19.260595 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:19.260595 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:19.260595 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:19.260595 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:19.260595 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:19.260595 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:19.260595 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:19.260595 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:19.260595 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:19.260595 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:19.260595 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 14:30:19.260595 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 14:30:19.260595 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 14:30:19.260595 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 14:30:19.261594 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:19.261594 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:19.261594 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 14:30:19.261594 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 14:30:19.261594 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 14:30:19.261594 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 14:30:19.261594 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:19.261594 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:19.261594 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:19.261594 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:19.261594 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:19.261594 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:30:19.261594 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:19.261594 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:19.261594 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:19.261594 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:19.261594 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:19.261594 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:19.262543 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:19.262543 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:19.262543 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 14:30:19.262543 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 14:30:19.262543 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 14:30:19.262543 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 14:30:19.262543 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 14:30:19.262543 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 14:30:19.262543 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 31 14:30:19.262543 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:30:19.266905 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 315/626] 10.222.0.15 () {56 vars in 1093 bytes} [Tue May 31 14:30:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:19.268043 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf119c8-bd79-404a-8877-771c461fb8cf None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:19.292752 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed16f800-f994-4af2-add8-fac8304dbe79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:19.293973 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed16f800-f994-4af2-add8-fac8304dbe79 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:19.294452 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed16f800-f994-4af2-add8-fac8304dbe79 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:19.294949 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed16f800-f994-4af2-add8-fac8304dbe79 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:19.308363 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed16f800-f994-4af2-add8-fac8304dbe79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 14:30:19.318778 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-ed16f800-f994-4af2-add8-fac8304dbe79 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 31 14:30:19.318778 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:19.318778 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:19.318778 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:19.318778 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:19.318778 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:19.318778 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:19.318778 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:19.318778 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:19.318778 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:19.318778 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:19.318778 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:19.318778 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 14:30:19.318778 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 14:30:19.318778 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 14:30:19.318778 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 14:30:19.319749 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 14:30:19.319749 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 14:30:19.319749 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 14:30:19.319749 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 14:30:19.319749 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:19.319749 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:19.319749 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:19.319749 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:19.319749 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:19.319749 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:19.319749 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:19.319749 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:30:19.319749 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:19.319749 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:19.319749 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:19.319749 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:19.320632 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:19.320632 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:19.320632 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:19.320632 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:19.320632 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 14:30:19.320632 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 14:30:19.320632 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 14:30:19.320632 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 14:30:19.320632 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 14:30:19.320632 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 14:30:19.320632 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 31 14:30:19.320632 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:30:19.323580 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 312/627] 10.222.0.15 () {56 vars in 1102 bytes} [Tue May 31 14:30:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:19.324726 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed16f800-f994-4af2-add8-fac8304dbe79 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:19.418718 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf119c8-bd79-404a-8877-771c461fb8cf None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:19.435495 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed16f800-f994-4af2-add8-fac8304dbe79 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:19.464057 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:19.466535 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a89354-1857-4444-8cc6-73578d2406f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:19.467586 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a89354-1857-4444-8cc6-73578d2406f2 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:19.467877 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a89354-1857-4444-8cc6-73578d2406f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:19.468152 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a89354-1857-4444-8cc6-73578d2406f2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:19.471594 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e5faca-bf15-4319-8bef-21f94f6eb367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:19.472466 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e5faca-bf15-4319-8bef-21f94f6eb367 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:19.472906 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e5faca-bf15-4319-8bef-21f94f6eb367 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:19.473343 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e5faca-bf15-4319-8bef-21f94f6eb367 None admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:19.482327 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e5faca-bf15-4319-8bef-21f94f6eb367 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:19.482327 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e5faca-bf15-4319-8bef-21f94f6eb367 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:19.482515 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a89354-1857-4444-8cc6-73578d2406f2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:19.482704 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e5faca-bf15-4319-8bef-21f94f6eb367 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:19.482782 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a89354-1857-4444-8cc6-73578d2406f2 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:19.482782 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:19.495826 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-b3a89354-1857-4444-8cc6-73578d2406f2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 14:30:19.495826 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:19.495826 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:19.495826 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:19.495826 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:19.495826 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:19.495826 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:19.495826 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:19.495826 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:19.495826 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:19.495826 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:19.495826 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:19.495826 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 14:30:19.495826 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 14:30:19.495826 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 14:30:19.496763 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 14:30:19.496763 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:19.496763 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:19.496763 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:19.496763 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:19.496763 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:19.496763 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:19.496763 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:19.496763 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:30:19.496763 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:19.496763 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:19.496763 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:19.496763 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:19.496763 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:19.496763 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:19.496763 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:19.496763 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:19.497641 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 14:30:19.497641 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 14:30:19.497641 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 14:30:19.497641 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 14:30:19.497641 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 14:30:19.497641 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 14:30:19.497641 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 14:30:19.497641 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:30:19.504705 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 316/629] 10.222.0.15 () {56 vars in 1111 bytes} [Tue May 31 14:30:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:19.504705 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a89354-1857-4444-8cc6-73578d2406f2 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:19.505014 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 313/629] 10.222.0.15 () {56 vars in 1133 bytes} [Tue May 31 14:30:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:19.506047 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e5faca-bf15-4319-8bef-21f94f6eb367 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:19.616105 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e5faca-bf15-4319-8bef-21f94f6eb367 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:19.633496 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a89354-1857-4444-8cc6-73578d2406f2 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:19.653204 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a783a694-fa4f-40f2-ab7a-18e3a3051ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:19.654194 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a783a694-fa4f-40f2-ab7a-18e3a3051ce3 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:19.654701 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a783a694-fa4f-40f2-ab7a-18e3a3051ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:19.655180 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a783a694-fa4f-40f2-ab7a-18e3a3051ce3 None admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:19.656169 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a783a694-fa4f-40f2-ab7a-18e3a3051ce3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:19.656645 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a783a694-fa4f-40f2-ab7a-18e3a3051ce3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:19.658238 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a783a694-fa4f-40f2-ab7a-18e3a3051ce3 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:19.671967 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3a0e4d-9d9c-4506-9173-36a9b52c5804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:19.672251 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 314/630] 10.222.0.15 () {56 vars in 1148 bytes} [Tue May 31 14:30:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:19.672766 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a0e4d-9d9c-4506-9173-36a9b52c5804 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:19.673120 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a0e4d-9d9c-4506-9173-36a9b52c5804 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:19.673465 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a0e4d-9d9c-4506-9173-36a9b52c5804 None admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:19.673894 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a783a694-fa4f-40f2-ab7a-18e3a3051ce3 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:19.674351 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3a0e4d-9d9c-4506-9173-36a9b52c5804 None admin] RBAC: Adding query filter params (name=service) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:19.674746 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3a0e4d-9d9c-4506-9173-36a9b52c5804 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:19.676252 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3a0e4d-9d9c-4506-9173-36a9b52c5804 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:19.684701 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 317/631] 10.222.0.15 () {56 vars in 1103 bytes} [Tue May 31 14:30:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:19.686066 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d672dd7c-2310-42c8-bcfe-4c2dff0aef04 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:19.686428 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d672dd7c-2310-42c8-bcfe-4c2dff0aef04 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:19.687005 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d672dd7c-2310-42c8-bcfe-4c2dff0aef04 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:19.688326 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 318/632] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:30:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:30:19.689089 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d672dd7c-2310-42c8-bcfe-4c2dff0aef04 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:19.728650 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:19.754316 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:19.781912 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a783a694-fa4f-40f2-ab7a-18e3a3051ce3 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:19.804178 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d672dd7c-2310-42c8-bcfe-4c2dff0aef04 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:19.823915 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a43f66-3152-4056-96f5-212bca9e6c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:19.824566 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a43f66-3152-4056-96f5-212bca9e6c9f None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:19.824850 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a43f66-3152-4056-96f5-212bca9e6c9f None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:19.825132 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a43f66-3152-4056-96f5-212bca9e6c9f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:19.846980 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb0fe54-559e-44bd-8c49-ddf256631b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:19.848549 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0fe54-559e-44bd-8c49-ddf256631b36 None admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:19.849011 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0fe54-559e-44bd-8c49-ddf256631b36 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:19.849463 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0fe54-559e-44bd-8c49-ddf256631b36 None admin] PATH_INFO: `/v3/projects/ffff4334538649fdba1beb80cad207fa/users/e158f461c66e4d779f23fb7760672897/roles/4fa2a9add9bc4786a62e7b5cae3cc051` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:19.866808 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb0fe54-559e-44bd-8c49-ddf256631b36 None admin] RBAC: Authorizing `identity:create_grant(project_id=ffff4334538649fdba1beb80cad207fa, user_id=e158f461c66e4d779f23fb7760672897, role_id=4fa2a9add9bc4786a62e7b5cae3cc051)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:19.869300 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb0fe54-559e-44bd-8c49-ddf256631b36 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:19.893462 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a43f66-3152-4056-96f5-212bca9e6c9f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:19.894959 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a43f66-3152-4056-96f5-212bca9e6c9f None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:19.936995 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 319/633] 10.222.0.15 () {58 vars in 1439 bytes} [Tue May 31 14:30:19 2022] PUT /identity/v3/projects/ffff4334538649fdba1beb80cad207fa/users/e158f461c66e4d779f23fb7760672897/roles/4fa2a9add9bc4786a62e7b5cae3cc051 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:30:19.938280 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58637bd2-8732-4081-8d30-19abadd25e94 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:19.938588 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58637bd2-8732-4081-8d30-19abadd25e94 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:19.938866 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58637bd2-8732-4081-8d30-19abadd25e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:19.962010 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-58637bd2-8732-4081-8d30-19abadd25e94 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:30:19.970330 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-58637bd2-8732-4081-8d30-19abadd25e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:30:19.970810 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:20.010385 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 315/634] 10.222.0.15 () {58 vars in 1282 bytes} [Tue May 31 14:30:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 31 14:30:20.011289 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a43f66-3152-4056-96f5-212bca9e6c9f None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:20.062993 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 320/635] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:30:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 14:30:20.063992 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58637bd2-8732-4081-8d30-19abadd25e94 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:20.123410 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:20.144164 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a43f66-3152-4056-96f5-212bca9e6c9f None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:20.189152 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb4aef4-99bf-4ade-9f5d-46d50b705bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:20.189983 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb4aef4-99bf-4ade-9f5d-46d50b705bb3 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:20.190265 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb4aef4-99bf-4ade-9f5d-46d50b705bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:20.190545 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb4aef4-99bf-4ade-9f5d-46d50b705bb3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:20.208710 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58637bd2-8732-4081-8d30-19abadd25e94 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:20.214042 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb4aef4-99bf-4ade-9f5d-46d50b705bb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:20.215556 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb4aef4-99bf-4ade-9f5d-46d50b705bb3 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:20.224919 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:20.234441 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-1fb4aef4-99bf-4ade-9f5d-46d50b705bb3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:20.234441 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:20.234441 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:20.234441 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:20.234441 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:20.234441 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:20.234441 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:20.234441 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:20.234441 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:20.234441 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:20.234441 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:20.234441 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:20.234441 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 14:30:20.234441 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 14:30:20.234441 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 14:30:20.240002 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 14:30:20.240002 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:20.240002 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:20.240002 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:20.240002 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:20.240002 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:20.240002 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:20.240002 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:20.240002 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:30:20.240002 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:20.240002 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:20.240002 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:20.240002 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:20.240002 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:20.240002 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:20.240002 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:20.240002 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:20.240885 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 14:30:20.240885 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 14:30:20.240885 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:20.240885 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:30:20.240885 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 316/636] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:30:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:20.240885 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb4aef4-99bf-4ade-9f5d-46d50b705bb3 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:20.262239 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f2345b-e4ae-4b0c-a83e-2c1767a3ad93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:20.263968 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f2345b-e4ae-4b0c-a83e-2c1767a3ad93 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:20.264778 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f2345b-e4ae-4b0c-a83e-2c1767a3ad93 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:20.265255 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f2345b-e4ae-4b0c-a83e-2c1767a3ad93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:20.280370 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f2345b-e4ae-4b0c-a83e-2c1767a3ad93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:20.282809 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f2345b-e4ae-4b0c-a83e-2c1767a3ad93 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:20.315551 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-a5f2345b-e4ae-4b0c-a83e-2c1767a3ad93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:20.315551 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:20.315551 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:20.315551 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:20.315551 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:20.315551 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:20.315551 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:20.315551 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:20.315551 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:20.315551 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:20.315551 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:20.315551 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:20.315551 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 14:30:20.315551 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 14:30:20.315551 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 14:30:20.316505 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 14:30:20.316505 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:20.316505 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:20.316505 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:20.316505 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:20.316505 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:20.316505 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:20.316505 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:20.316505 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:30:20.316505 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:20.316505 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:20.316505 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:20.316505 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:20.316505 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:20.316505 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:20.316505 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:20.316505 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:20.317378 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 14:30:20.317378 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 14:30:20.317378 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:20.317378 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:30:20.321160 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 321/637] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:30:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:20.322397 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f2345b-e4ae-4b0c-a83e-2c1767a3ad93 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:20.356304 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb4aef4-99bf-4ade-9f5d-46d50b705bb3 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:20.394321 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcf3bf3-fc0e-40af-90c4-504eec28c307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:20.395249 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf3bf3-fc0e-40af-90c4-504eec28c307 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:20.395599 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf3bf3-fc0e-40af-90c4-504eec28c307 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:20.395962 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf3bf3-fc0e-40af-90c4-504eec28c307 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:20.407644 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcf3bf3-fc0e-40af-90c4-504eec28c307 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 14:30:20.416642 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-bfcf3bf3-fc0e-40af-90c4-504eec28c307 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 31 14:30:20.416642 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:20.416642 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:20.416642 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:20.416642 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:20.416642 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:20.416642 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:20.416642 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:20.416642 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:20.416642 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:20.416642 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:20.416642 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:20.416642 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 14:30:20.416642 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 14:30:20.416642 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 14:30:20.416642 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 14:30:20.417679 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 14:30:20.417679 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 14:30:20.417679 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 14:30:20.417679 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 14:30:20.417679 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:20.417679 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:20.417679 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:20.417679 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:20.417679 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:20.417679 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:20.417679 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:20.417679 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:30:20.417679 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:20.417679 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:20.417679 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:20.417679 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:20.418529 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:20.418529 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:20.418529 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:20.418529 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:20.418529 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 14:30:20.418529 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 14:30:20.418529 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 14:30:20.418529 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 14:30:20.418529 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 14:30:20.418529 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 14:30:20.418529 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 31 14:30:20.418529 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:30:20.418529 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 317/638] 10.222.0.15 () {56 vars in 1102 bytes} [Tue May 31 14:30:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:20.419268 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcf3bf3-fc0e-40af-90c4-504eec28c307 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:20.452089 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:20.462929 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f2345b-e4ae-4b0c-a83e-2c1767a3ad93 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:20.487774 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:20.505438 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ef7969-fd56-43b0-a316-4123cc8fe328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:20.506737 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ef7969-fd56-43b0-a316-4123cc8fe328 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:20.507352 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ef7969-fd56-43b0-a316-4123cc8fe328 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:20.510769 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ef7969-fd56-43b0-a316-4123cc8fe328 None admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:20.511703 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ef7969-fd56-43b0-a316-4123cc8fe328 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:20.512157 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ef7969-fd56-43b0-a316-4123cc8fe328 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:20.514516 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ef7969-fd56-43b0-a316-4123cc8fe328 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:20.528999 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 322/639] 10.222.0.15 () {56 vars in 1109 bytes} [Tue May 31 14:30:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:20.530346 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ef7969-fd56-43b0-a316-4123cc8fe328 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:20.540173 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcf3bf3-fc0e-40af-90c4-504eec28c307 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:20.590012 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d9c0ca-aebe-42bb-93e8-909bf003bad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:20.591487 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d9c0ca-aebe-42bb-93e8-909bf003bad7 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:20.592175 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d9c0ca-aebe-42bb-93e8-909bf003bad7 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:20.592854 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d9c0ca-aebe-42bb-93e8-909bf003bad7 None admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:20.594304 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d9c0ca-aebe-42bb-93e8-909bf003bad7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:20.594920 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d9c0ca-aebe-42bb-93e8-909bf003bad7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:20.596497 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d9c0ca-aebe-42bb-93e8-909bf003bad7 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:20.609695 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 318/640] 10.222.0.15 () {56 vars in 1109 bytes} [Tue May 31 14:30:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:20.610935 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d9c0ca-aebe-42bb-93e8-909bf003bad7 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:20.653229 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ef7969-fd56-43b0-a316-4123cc8fe328 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:20.689614 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f09f7ec-a95a-4069-b06c-b5c143747b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:20.691237 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f09f7ec-a95a-4069-b06c-b5c143747b50 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:20.691733 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f09f7ec-a95a-4069-b06c-b5c143747b50 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:20.692215 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f09f7ec-a95a-4069-b06c-b5c143747b50 None admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:20.693603 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f09f7ec-a95a-4069-b06c-b5c143747b50 None admin] RBAC: Adding query filter params (name=service) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:20.694132 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f09f7ec-a95a-4069-b06c-b5c143747b50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:20.696407 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f09f7ec-a95a-4069-b06c-b5c143747b50 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:20.707787 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 323/641] 10.222.0.15 () {56 vars in 1103 bytes} [Tue May 31 14:30:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:20.708926 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f09f7ec-a95a-4069-b06c-b5c143747b50 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:20.725689 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d9c0ca-aebe-42bb-93e8-909bf003bad7 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:20.734450 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:20.755755 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:20.773739 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd3b7e7-7108-4dae-9f63-ffd2ef2ecc4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:20.775180 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3b7e7-7108-4dae-9f63-ffd2ef2ecc4f None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:20.775468 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3b7e7-7108-4dae-9f63-ffd2ef2ecc4f None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:20.775928 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3b7e7-7108-4dae-9f63-ffd2ef2ecc4f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:20.786378 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd3b7e7-7108-4dae-9f63-ffd2ef2ecc4f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:20.787837 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd3b7e7-7108-4dae-9f63-ffd2ef2ecc4f None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:20.805117 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-cdd3b7e7-7108-4dae-9f63-ffd2ef2ecc4f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 31 14:30:20.805117 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:20.805117 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:20.805117 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:20.805117 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:20.805117 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:20.805117 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:20.805117 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:20.805117 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:20.805117 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:20.805117 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:20.805117 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:20.805117 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 14:30:20.805117 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 14:30:20.805117 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 14:30:20.805117 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 14:30:20.806387 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:20.806387 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:20.806387 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 14:30:20.806387 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 14:30:20.806387 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 14:30:20.806387 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 14:30:20.806387 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:20.806387 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:20.806387 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:20.806387 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:20.806387 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:20.806387 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:30:20.806387 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:20.806387 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:20.806387 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:20.806387 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:20.806387 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:20.806387 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:20.807502 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:20.807502 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:20.807502 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 14:30:20.807502 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 14:30:20.807502 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 14:30:20.807502 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 14:30:20.807502 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 14:30:20.807502 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 14:30:20.807502 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 31 14:30:20.807502 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:30:20.807502 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 319/642] 10.222.0.15 () {56 vars in 1099 bytes} [Tue May 31 14:30:20 2022] GET /identity/v3/users/cinder => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:20.808729 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd3b7e7-7108-4dae-9f63-ffd2ef2ecc4f None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:20.843451 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f09f7ec-a95a-4069-b06c-b5c143747b50 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:20.878921 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c8cf04-9c84-40e6-b694-3a60cfa7c2ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:20.879982 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c8cf04-9c84-40e6-b694-3a60cfa7c2ab None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:20.880416 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c8cf04-9c84-40e6-b694-3a60cfa7c2ab None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:20.880863 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c8cf04-9c84-40e6-b694-3a60cfa7c2ab None admin] PATH_INFO: `/v3/projects/service` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:20.888516 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c8cf04-9c84-40e6-b694-3a60cfa7c2ab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:20.890135 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c8cf04-9c84-40e6-b694-3a60cfa7c2ab None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:20.905984 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-34c8cf04-9c84-40e6-b694-3a60cfa7c2ab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 14:30:20.905984 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:20.905984 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:20.905984 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:20.905984 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:20.905984 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:20.905984 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:20.905984 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:20.905984 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:20.905984 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:20.905984 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:20.905984 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:20.905984 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 14:30:20.905984 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 14:30:20.905984 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 14:30:20.907130 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 14:30:20.907130 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:20.907130 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:20.907130 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:20.907130 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:20.907130 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:20.907130 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:20.907130 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:20.907130 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:30:20.907130 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:20.907130 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:20.907130 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:20.907130 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:20.907130 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:20.907130 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:20.907130 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:20.907130 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:20.911746 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 14:30:20.911746 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 14:30:20.911746 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 14:30:20.911746 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 14:30:20.911746 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 14:30:20.911746 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 14:30:20.911746 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 14:30:20.911746 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:30:20.911746 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 324/643] 10.222.0.15 () {56 vars in 1111 bytes} [Tue May 31 14:30:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:20.911746 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5847a8-44ce-4ece-99dd-48ea4e8ae788 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:20.911746 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5847a8-44ce-4ece-99dd-48ea4e8ae788 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:20.912348 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5847a8-44ce-4ece-99dd-48ea4e8ae788 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:20.912348 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 325/644] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:30:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:30:20.912348 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5847a8-44ce-4ece-99dd-48ea4e8ae788 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:20.926540 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd3b7e7-7108-4dae-9f63-ffd2ef2ecc4f None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:20.963483 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a5c461-3c52-4a69-9a71-d0203ffe659f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:20.964202 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a5c461-3c52-4a69-9a71-d0203ffe659f None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:20.964486 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a5c461-3c52-4a69-9a71-d0203ffe659f None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:20.964759 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a5c461-3c52-4a69-9a71-d0203ffe659f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:20.975095 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a5c461-3c52-4a69-9a71-d0203ffe659f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:20.976576 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a5c461-3c52-4a69-9a71-d0203ffe659f None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:20.993436 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:20.994233 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-63a5c461-3c52-4a69-9a71-d0203ffe659f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:20.994233 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:20.994233 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:20.994233 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:20.994233 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:20.994233 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:20.994233 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:20.994233 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:20.994233 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:20.994233 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:20.994233 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:20.994233 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:20.994233 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 14:30:20.994233 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 14:30:20.994233 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 14:30:20.995278 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 14:30:20.995278 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:20.995278 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:20.995278 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:20.995278 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:20.995278 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:20.995278 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:20.995278 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:20.995278 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:30:20.995278 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:20.995278 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:20.995278 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:20.995278 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:20.995278 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:20.995278 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:20.995278 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:20.995278 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:20.996192 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 14:30:20.996192 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 14:30:20.996192 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:20.996192 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:30:20.996192 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 320/645] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:30:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:20.996192 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a5c461-3c52-4a69-9a71-d0203ffe659f None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:21.020341 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5847a8-44ce-4ece-99dd-48ea4e8ae788 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:21.031004 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:21.059362 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9fc70e-ff0a-4b4c-bc84-506f30448d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:21.060168 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9fc70e-ff0a-4b4c-bc84-506f30448d8c None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:21.060559 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9fc70e-ff0a-4b4c-bc84-506f30448d8c None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:21.060839 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9fc70e-ff0a-4b4c-bc84-506f30448d8c None admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:21.061672 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9fc70e-ff0a-4b4c-bc84-506f30448d8c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:21.061979 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9fc70e-ff0a-4b4c-bc84-506f30448d8c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:21.063492 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9fc70e-ff0a-4b4c-bc84-506f30448d8c None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:21.081881 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 326/646] 10.222.0.15 () {56 vars in 1137 bytes} [Tue May 31 14:30:20 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:21.083338 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0256da28-5c26-4838-b5d9-48f794952eeb None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:21.083648 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0256da28-5c26-4838-b5d9-48f794952eeb None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:21.083926 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0256da28-5c26-4838-b5d9-48f794952eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:21.100406 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-0256da28-5c26-4838-b5d9-48f794952eeb None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:30:21.101608 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-0256da28-5c26-4838-b5d9-48f794952eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:30:21.109269 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a5c461-3c52-4a69-9a71-d0203ffe659f None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:21.145953 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e1428b-932b-4e9d-9c14-2e3a1224726f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:21.146842 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e1428b-932b-4e9d-9c14-2e3a1224726f None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:21.146935 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e1428b-932b-4e9d-9c14-2e3a1224726f None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:21.147173 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e1428b-932b-4e9d-9c14-2e3a1224726f None admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:21.147953 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e1428b-932b-4e9d-9c14-2e3a1224726f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:21.148498 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e1428b-932b-4e9d-9c14-2e3a1224726f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:21.149973 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e1428b-932b-4e9d-9c14-2e3a1224726f None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:21.166383 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 321/647] 10.222.0.15 () {56 vars in 1148 bytes} [Tue May 31 14:30:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:21.166383 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e1428b-932b-4e9d-9c14-2e3a1224726f None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:21.186731 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 327/648] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:30:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 14:30:21.188102 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0256da28-5c26-4838-b5d9-48f794952eeb None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:21.257320 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:21.264723 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:21.273556 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e1428b-932b-4e9d-9c14-2e3a1224726f None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:21.299494 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0256da28-5c26-4838-b5d9-48f794952eeb None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:21.312917 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6c9864-12ac-4ea5-8001-c5c2dd555f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:21.313960 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c9864-12ac-4ea5-8001-c5c2dd555f60 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:21.314444 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c9864-12ac-4ea5-8001-c5c2dd555f60 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:21.315271 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c9864-12ac-4ea5-8001-c5c2dd555f60 None admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:21.315997 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6c9864-12ac-4ea5-8001-c5c2dd555f60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:21.316306 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6c9864-12ac-4ea5-8001-c5c2dd555f60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:21.317662 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6c9864-12ac-4ea5-8001-c5c2dd555f60 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:21.332145 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 322/649] 10.222.0.15 () {56 vars in 1109 bytes} [Tue May 31 14:30:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:21.332976 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6c9864-12ac-4ea5-8001-c5c2dd555f60 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:21.343411 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4821914-61b5-4ee7-adb8-7822f94af57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:21.344330 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4821914-61b5-4ee7-adb8-7822f94af57e None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:21.344937 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4821914-61b5-4ee7-adb8-7822f94af57e None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:21.345287 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4821914-61b5-4ee7-adb8-7822f94af57e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:21.417750 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4821914-61b5-4ee7-adb8-7822f94af57e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:21.419524 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4821914-61b5-4ee7-adb8-7822f94af57e None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:21.434486 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6c9864-12ac-4ea5-8001-c5c2dd555f60 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:21.467622 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba25b09-bc72-4876-b08a-ac82aa40c19d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:21.468267 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba25b09-bc72-4876-b08a-ac82aa40c19d None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:21.468553 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba25b09-bc72-4876-b08a-ac82aa40c19d None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:21.468837 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba25b09-bc72-4876-b08a-ac82aa40c19d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:21.469650 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba25b09-bc72-4876-b08a-ac82aa40c19d None admin] RBAC: Adding query filter params (role.id=4fa2a9add9bc4786a62e7b5cae3cc051, scope.project.id=ffff4334538649fdba1beb80cad207fa, user.id=b57768d448e345ad8879bf29f21b48ea) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:21.469961 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba25b09-bc72-4876-b08a-ac82aa40c19d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:21.471405 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba25b09-bc72-4876-b08a-ac82aa40c19d None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:21.486582 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 323/650] 10.222.0.15 () {56 vars in 1374 bytes} [Tue May 31 14:30:21 2022] GET /identity/v3/role_assignments?user.id=b57768d448e345ad8879bf29f21b48ea&scope.project.id=ffff4334538649fdba1beb80cad207fa&role.id=4fa2a9add9bc4786a62e7b5cae3cc051 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:21.486582 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba25b09-bc72-4876-b08a-ac82aa40c19d None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:21.494623 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:21.505249 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:21.547953 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 328/651] 10.222.0.15 () {58 vars in 1282 bytes} [Tue May 31 14:30:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 31 14:30:21.548946 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4821914-61b5-4ee7-adb8-7822f94af57e None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:21.604582 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba25b09-bc72-4876-b08a-ac82aa40c19d None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:21.643174 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fdb119-7ee9-495b-8284-a9d6fbbe305e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:21.644354 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fdb119-7ee9-495b-8284-a9d6fbbe305e None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:21.644549 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fdb119-7ee9-495b-8284-a9d6fbbe305e None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:21.644923 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fdb119-7ee9-495b-8284-a9d6fbbe305e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:21.657372 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fdb119-7ee9-495b-8284-a9d6fbbe305e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 14:30:21.666224 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-84fdb119-7ee9-495b-8284-a9d6fbbe305e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 31 14:30:21.666224 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:21.666224 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:21.666224 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:21.666224 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:21.666224 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:21.666224 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:21.666224 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:21.666224 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:21.666224 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:21.666224 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:21.666224 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:21.666224 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 14:30:21.666224 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 14:30:21.666224 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 14:30:21.666224 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 14:30:21.667369 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 14:30:21.667369 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 14:30:21.667369 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 14:30:21.667369 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 14:30:21.667369 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:21.667369 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:21.667369 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:21.667369 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:21.667369 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:21.667369 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:21.667369 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:21.667369 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:30:21.667369 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:21.667369 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:21.667369 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:21.667369 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:21.668201 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:21.668201 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:21.668201 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:21.668201 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:21.668201 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 14:30:21.668201 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 14:30:21.668201 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 14:30:21.668201 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 14:30:21.668201 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 14:30:21.668201 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 14:30:21.668201 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 31 14:30:21.668201 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:30:21.668846 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 324/652] 10.222.0.15 () {56 vars in 1102 bytes} [Tue May 31 14:30:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:21.669734 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fdb119-7ee9-495b-8284-a9d6fbbe305e None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:21.674770 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4821914-61b5-4ee7-adb8-7822f94af57e None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:21.713973 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be45dbe9-8f85-40e0-839f-c626641ba91a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:21.715193 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be45dbe9-8f85-40e0-839f-c626641ba91a None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:21.715668 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be45dbe9-8f85-40e0-839f-c626641ba91a None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:21.716196 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be45dbe9-8f85-40e0-839f-c626641ba91a None admin] PATH_INFO: `/v3/users/glance` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:21.724960 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be45dbe9-8f85-40e0-839f-c626641ba91a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:21.727211 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be45dbe9-8f85-40e0-839f-c626641ba91a None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:21.746929 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-be45dbe9-8f85-40e0-839f-c626641ba91a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 31 14:30:21.746929 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:21.746929 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:21.746929 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:21.746929 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:21.746929 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:21.746929 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:21.746929 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:21.746929 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:21.746929 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:21.746929 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:21.746929 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:21.746929 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 14:30:21.746929 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 14:30:21.746929 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 14:30:21.746929 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 14:30:21.747917 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:21.747917 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:21.747917 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 14:30:21.747917 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 14:30:21.747917 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 14:30:21.747917 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 14:30:21.747917 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:21.747917 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:21.747917 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:21.747917 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:21.747917 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:21.747917 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:30:21.747917 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:21.747917 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:21.747917 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:21.747917 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:21.747917 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:21.747917 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:21.749336 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:21.749336 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:21.749336 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 14:30:21.749336 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 14:30:21.749336 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 14:30:21.749336 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 14:30:21.749336 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 14:30:21.749336 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 14:30:21.749336 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 31 14:30:21.749336 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:30:21.749336 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 329/653] 10.222.0.15 () {56 vars in 1099 bytes} [Tue May 31 14:30:21 2022] GET /identity/v3/users/glance => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:21.749336 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be45dbe9-8f85-40e0-839f-c626641ba91a None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:21.756319 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:21.777854 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:21.784093 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fdb119-7ee9-495b-8284-a9d6fbbe305e None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:21.832842 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b28a5e-64bd-405c-88bd-7806e7ab4fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:21.833581 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b28a5e-64bd-405c-88bd-7806e7ab4fe4 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:21.833869 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b28a5e-64bd-405c-88bd-7806e7ab4fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:21.834150 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b28a5e-64bd-405c-88bd-7806e7ab4fe4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:21.849564 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b28a5e-64bd-405c-88bd-7806e7ab4fe4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:21.851021 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b28a5e-64bd-405c-88bd-7806e7ab4fe4 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:21.869498 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-c1b28a5e-64bd-405c-88bd-7806e7ab4fe4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:21.869498 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:21.869498 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:21.869498 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:21.869498 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:21.869498 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:21.869498 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:21.869498 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:21.869498 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:21.869498 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:21.869498 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:21.869498 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:21.869498 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 14:30:21.869498 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 14:30:21.869498 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 14:30:21.870431 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 14:30:21.870431 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:21.870431 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:21.870431 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:21.870431 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:21.870431 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:21.870431 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:21.870431 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:21.870431 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:30:21.870431 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:21.870431 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:21.870431 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:21.870431 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:21.870431 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:21.870431 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:21.870431 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:21.870431 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:21.871795 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 14:30:21.871795 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 14:30:21.871795 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:21.871795 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:30:21.872018 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be45dbe9-8f85-40e0-839f-c626641ba91a None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:21.872101 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 325/654] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:30:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:21.872101 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b28a5e-64bd-405c-88bd-7806e7ab4fe4 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:21.923302 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef694cf-f3ae-4e38-9069-48fcc1773523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:21.924682 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef694cf-f3ae-4e38-9069-48fcc1773523 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:21.925071 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef694cf-f3ae-4e38-9069-48fcc1773523 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:21.925454 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef694cf-f3ae-4e38-9069-48fcc1773523 None admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:21.926788 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef694cf-f3ae-4e38-9069-48fcc1773523 None admin] RBAC: Adding query filter params (name=service) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:21.927616 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef694cf-f3ae-4e38-9069-48fcc1773523 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:21.929407 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef694cf-f3ae-4e38-9069-48fcc1773523 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:21.946415 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 330/655] 10.222.0.15 () {56 vars in 1103 bytes} [Tue May 31 14:30:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:21.946840 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef694cf-f3ae-4e38-9069-48fcc1773523 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:22.046579 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b28a5e-64bd-405c-88bd-7806e7ab4fe4 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:22.083173 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:22.095471 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:22.098697 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a483e8-824e-4ce5-8c93-cdc90b6e726f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:22.106919 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a483e8-824e-4ce5-8c93-cdc90b6e726f None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:22.106919 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a483e8-824e-4ce5-8c93-cdc90b6e726f None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:22.106919 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a483e8-824e-4ce5-8c93-cdc90b6e726f None admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:22.106919 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a483e8-824e-4ce5-8c93-cdc90b6e726f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:22.106919 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a483e8-824e-4ce5-8c93-cdc90b6e726f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:22.106919 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a483e8-824e-4ce5-8c93-cdc90b6e726f None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:22.114291 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef694cf-f3ae-4e38-9069-48fcc1773523 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:22.132087 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 326/656] 10.222.0.15 () {56 vars in 1137 bytes} [Tue May 31 14:30:21 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:22.134005 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a483e8-824e-4ce5-8c93-cdc90b6e726f None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:22.158678 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a126aa-b757-4926-b973-61476fc2c99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:22.160474 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a126aa-b757-4926-b973-61476fc2c99e None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:22.160909 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a126aa-b757-4926-b973-61476fc2c99e None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:22.161607 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a126aa-b757-4926-b973-61476fc2c99e None admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:22.162479 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a126aa-b757-4926-b973-61476fc2c99e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:22.163203 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a126aa-b757-4926-b973-61476fc2c99e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:22.165622 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a126aa-b757-4926-b973-61476fc2c99e None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:22.182511 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 331/657] 10.222.0.15 () {56 vars in 1109 bytes} [Tue May 31 14:30:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:22.184128 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a126aa-b757-4926-b973-61476fc2c99e None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:22.266777 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a483e8-824e-4ce5-8c93-cdc90b6e726f None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:22.329324 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a98c38-cfab-43c3-b1f7-559d5e4b1bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:22.335949 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a126aa-b757-4926-b973-61476fc2c99e None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:22.336075 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a98c38-cfab-43c3-b1f7-559d5e4b1bc0 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:22.336075 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a98c38-cfab-43c3-b1f7-559d5e4b1bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:22.336075 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a98c38-cfab-43c3-b1f7-559d5e4b1bc0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:22.343501 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a98c38-cfab-43c3-b1f7-559d5e4b1bc0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:22.345283 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a98c38-cfab-43c3-b1f7-559d5e4b1bc0 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:22.364431 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-73a98c38-cfab-43c3-b1f7-559d5e4b1bc0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:22.364431 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:22.364431 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:22.364431 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:22.364431 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:22.364431 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:22.364431 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:22.364431 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:22.364431 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:22.364431 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:22.364431 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:22.364431 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:22.364431 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 14:30:22.364431 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 14:30:22.364431 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 14:30:22.365371 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 14:30:22.365371 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:22.365371 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:22.365371 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:22.365371 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:22.365371 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:22.365371 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:22.365371 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:22.365371 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:30:22.365371 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:22.365371 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:22.365371 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:22.365371 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:22.365371 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:22.365371 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:22.365371 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:22.365371 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:22.366312 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 14:30:22.366312 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 14:30:22.366312 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:22.366312 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:30:22.368241 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 327/658] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:30:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:22.368892 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a98c38-cfab-43c3-b1f7-559d5e4b1bc0 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:22.370910 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa45b063-5318-4179-bfb3-c092f38ecb38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:22.371831 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa45b063-5318-4179-bfb3-c092f38ecb38 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:22.372190 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa45b063-5318-4179-bfb3-c092f38ecb38 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:22.372691 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa45b063-5318-4179-bfb3-c092f38ecb38 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:22.392033 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:22.414218 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:22.453140 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa45b063-5318-4179-bfb3-c092f38ecb38 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:22.454919 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa45b063-5318-4179-bfb3-c092f38ecb38 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:22.479171 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a98c38-cfab-43c3-b1f7-559d5e4b1bc0 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:22.516250 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aca7926-5f10-4411-8fff-a884ae1aec05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:22.517058 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca7926-5f10-4411-8fff-a884ae1aec05 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:22.517347 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca7926-5f10-4411-8fff-a884ae1aec05 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:22.517630 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca7926-5f10-4411-8fff-a884ae1aec05 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:22.524765 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aca7926-5f10-4411-8fff-a884ae1aec05 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:22.526218 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aca7926-5f10-4411-8fff-a884ae1aec05 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:22.540893 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-4aca7926-5f10-4411-8fff-a884ae1aec05 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 14:30:22.540893 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:22.540893 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:22.540893 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:22.540893 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:22.540893 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:22.540893 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:22.540893 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:22.540893 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:22.540893 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:22.540893 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:22.540893 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:22.540893 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 14:30:22.540893 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 14:30:22.540893 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 14:30:22.541808 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 14:30:22.541808 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:22.541808 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:22.541808 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:22.541808 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:22.541808 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:22.541808 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:22.541808 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:22.541808 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:30:22.541808 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:22.541808 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:22.541808 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:22.541808 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:22.541808 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:22.541808 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:22.541808 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:22.541808 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:22.542739 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 14:30:22.542739 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 14:30:22.542739 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 14:30:22.542739 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 14:30:22.542739 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 14:30:22.542739 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 14:30:22.542739 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 14:30:22.542739 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:30:22.548517 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 328/659] 10.222.0.15 () {56 vars in 1111 bytes} [Tue May 31 14:30:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:22.550662 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44299814-cb2e-41d7-89db-ee84ddd3f92f None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:22.550800 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44299814-cb2e-41d7-89db-ee84ddd3f92f None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:22.551240 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44299814-cb2e-41d7-89db-ee84ddd3f92f None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:22.553732 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 329/660] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:30:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:30:22.557707 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44299814-cb2e-41d7-89db-ee84ddd3f92f None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:22.593450 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 332/661] 10.222.0.15 () {58 vars in 1282 bytes} [Tue May 31 14:30:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 31 14:30:22.595518 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa45b063-5318-4179-bfb3-c092f38ecb38 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:22.645892 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:22.702056 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:22.709773 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44299814-cb2e-41d7-89db-ee84ddd3f92f None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:22.721511 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa45b063-5318-4179-bfb3-c092f38ecb38 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:22.747793 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2b062e-1c23-46e0-8c38-ab6952aea05c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:22.749123 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2b062e-1c23-46e0-8c38-ab6952aea05c None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:22.749467 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2b062e-1c23-46e0-8c38-ab6952aea05c None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:22.749686 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2b062e-1c23-46e0-8c38-ab6952aea05c None admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:22.750446 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2b062e-1c23-46e0-8c38-ab6952aea05c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:22.750841 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2b062e-1c23-46e0-8c38-ab6952aea05c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:22.752516 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2b062e-1c23-46e0-8c38-ab6952aea05c None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:22.765423 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daceeebc-1bc5-4b16-9252-2b955222f423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:22.766388 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daceeebc-1bc5-4b16-9252-2b955222f423 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:22.766916 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daceeebc-1bc5-4b16-9252-2b955222f423 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:22.767115 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 330/662] 10.222.0.15 () {56 vars in 1109 bytes} [Tue May 31 14:30:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:22.767577 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daceeebc-1bc5-4b16-9252-2b955222f423 None admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:22.768382 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f20a0-53d5-4563-8905-d7d408d4b6f0 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:22.768677 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f20a0-53d5-4563-8905-d7d408d4b6f0 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:22.769016 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f20a0-53d5-4563-8905-d7d408d4b6f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:22.769244 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daceeebc-1bc5-4b16-9252-2b955222f423 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:22.769737 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daceeebc-1bc5-4b16-9252-2b955222f423 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:22.772644 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daceeebc-1bc5-4b16-9252-2b955222f423 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:22.791922 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 333/663] 10.222.0.15 () {56 vars in 1148 bytes} [Tue May 31 14:30:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:22.792178 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-196f20a0-53d5-4563-8905-d7d408d4b6f0 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:30:22.792264 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daceeebc-1bc5-4b16-9252-2b955222f423 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:22.792337 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-196f20a0-53d5-4563-8905-d7d408d4b6f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:30:22.879597 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 331/664] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:30:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 14:30:22.881367 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196f20a0-53d5-4563-8905-d7d408d4b6f0 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:22.927692 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daceeebc-1bc5-4b16-9252-2b955222f423 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:22.935444 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:22.963089 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e10dd47-b545-4d53-99cc-358429f9c1bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:22.964322 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e10dd47-b545-4d53-99cc-358429f9c1bb None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:22.964689 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e10dd47-b545-4d53-99cc-358429f9c1bb None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:22.965008 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e10dd47-b545-4d53-99cc-358429f9c1bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:22.977778 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e10dd47-b545-4d53-99cc-358429f9c1bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:22.978711 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:22.981304 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e10dd47-b545-4d53-99cc-358429f9c1bb None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:22.991805 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196f20a0-53d5-4563-8905-d7d408d4b6f0 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:22.999013 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-7e10dd47-b545-4d53-99cc-358429f9c1bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:22.999013 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:22.999013 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:22.999013 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:22.999013 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:22.999013 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:22.999013 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:22.999013 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:22.999013 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:22.999013 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:22.999013 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:22.999013 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:22.999013 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 14:30:22.999013 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 14:30:22.999013 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 14:30:23.000021 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 14:30:23.000021 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:23.000021 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:23.000021 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:23.000021 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:23.000021 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:23.000021 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:23.000021 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:23.000021 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:30:23.000021 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:23.000021 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:23.000021 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:23.000021 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:23.000021 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:23.000021 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:23.000021 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:23.000021 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:23.000904 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 14:30:23.000904 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 14:30:23.000904 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:23.000904 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:30:23.000904 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 334/665] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:30:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:23.001554 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e10dd47-b545-4d53-99cc-358429f9c1bb None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:23.034417 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3809ff-1655-4205-bcd8-fe090c73f1ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:23.035496 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3809ff-1655-4205-bcd8-fe090c73f1ca None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:23.035777 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3809ff-1655-4205-bcd8-fe090c73f1ca None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:23.036054 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3809ff-1655-4205-bcd8-fe090c73f1ca None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:23.043886 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3809ff-1655-4205-bcd8-fe090c73f1ca None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:23.045312 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3809ff-1655-4205-bcd8-fe090c73f1ca None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:23.059587 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-2e3809ff-1655-4205-bcd8-fe090c73f1ca None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 31 14:30:23.059587 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:23.059587 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:23.059587 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:23.059587 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:23.059587 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:23.059587 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:23.059587 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:23.059587 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:23.059587 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:23.059587 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:23.059587 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:23.059587 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 14:30:23.059587 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 14:30:23.059587 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 14:30:23.059587 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 14:30:23.060532 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:23.060532 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:23.060532 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 14:30:23.060532 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 14:30:23.060532 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 14:30:23.060532 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 14:30:23.060532 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:23.060532 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:23.060532 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:23.060532 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:23.060532 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:23.060532 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:30:23.060532 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:23.060532 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:23.060532 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:23.060532 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:23.060532 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:23.060532 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:23.061481 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:23.061481 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:23.061481 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 14:30:23.061481 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 14:30:23.061481 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 14:30:23.061481 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 14:30:23.061481 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 14:30:23.061481 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 14:30:23.061481 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 31 14:30:23.061481 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:30:23.061481 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 332/666] 10.222.0.15 () {56 vars in 1102 bytes} [Tue May 31 14:30:22 2022] GET /identity/v3/users/neutron => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:23.061481 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3809ff-1655-4205-bcd8-fe090c73f1ca None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:23.115081 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e10dd47-b545-4d53-99cc-358429f9c1bb None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:23.149382 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fbbfb3-d46d-43b5-99ca-ed01704d3190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:23.149958 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fbbfb3-d46d-43b5-99ca-ed01704d3190 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:23.150241 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fbbfb3-d46d-43b5-99ca-ed01704d3190 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:23.150518 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fbbfb3-d46d-43b5-99ca-ed01704d3190 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:23.151359 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fbbfb3-d46d-43b5-99ca-ed01704d3190 None admin] RBAC: Adding query filter params (role.id=4fa2a9add9bc4786a62e7b5cae3cc051, scope.project.id=ffff4334538649fdba1beb80cad207fa, user.id=afbf718dcd9b4741a926b0a2321bd53e) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:23.151668 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fbbfb3-d46d-43b5-99ca-ed01704d3190 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:23.153086 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fbbfb3-d46d-43b5-99ca-ed01704d3190 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:23.158652 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 335/667] 10.222.0.15 () {56 vars in 1374 bytes} [Tue May 31 14:30:23 2022] GET /identity/v3/role_assignments?user.id=afbf718dcd9b4741a926b0a2321bd53e&scope.project.id=ffff4334538649fdba1beb80cad207fa&role.id=4fa2a9add9bc4786a62e7b5cae3cc051 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:23.159424 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fbbfb3-d46d-43b5-99ca-ed01704d3190 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:23.183713 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3809ff-1655-4205-bcd8-fe090c73f1ca None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:23.195479 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:23.235958 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed47a5a-5179-4901-9d1d-291d40f8e915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:23.237889 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed47a5a-5179-4901-9d1d-291d40f8e915 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:23.238722 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed47a5a-5179-4901-9d1d-291d40f8e915 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:23.239223 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed47a5a-5179-4901-9d1d-291d40f8e915 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:23.256013 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed47a5a-5179-4901-9d1d-291d40f8e915 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 14:30:23.266808 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-9ed47a5a-5179-4901-9d1d-291d40f8e915 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 31 14:30:23.266808 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:23.266808 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:23.266808 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:23.266808 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:23.266808 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:23.266808 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:23.266808 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:23.266808 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:23.266808 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:23.266808 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:23.266808 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:23.266808 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 14:30:23.266808 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 14:30:23.266808 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 14:30:23.266808 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 14:30:23.268252 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 14:30:23.268252 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 14:30:23.268252 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 14:30:23.268252 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 14:30:23.268252 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:23.268252 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:23.268252 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:23.268252 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:23.268252 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:23.268252 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:23.268252 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:23.268252 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:30:23.268252 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:23.268252 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:23.268252 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:23.268252 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:23.269246 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:23.269246 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:23.269246 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:23.269246 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:23.269246 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 14:30:23.269246 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 14:30:23.269246 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 14:30:23.269246 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 14:30:23.269246 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 14:30:23.269246 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 14:30:23.269246 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 31 14:30:23.269246 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:30:23.272109 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 333/668] 10.222.0.15 () {56 vars in 1102 bytes} [Tue May 31 14:30:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:23.274351 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed47a5a-5179-4901-9d1d-291d40f8e915 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:23.295146 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fbbfb3-d46d-43b5-99ca-ed01704d3190 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:23.300105 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:23.345337 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeb5663-3d52-4543-a19d-367e3e9c7d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:23.346278 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb5663-3d52-4543-a19d-367e3e9c7d1b None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:23.346749 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb5663-3d52-4543-a19d-367e3e9c7d1b None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:23.347312 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb5663-3d52-4543-a19d-367e3e9c7d1b None admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:23.348220 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeb5663-3d52-4543-a19d-367e3e9c7d1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:23.348681 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeb5663-3d52-4543-a19d-367e3e9c7d1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:23.350375 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeb5663-3d52-4543-a19d-367e3e9c7d1b None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:23.366112 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 336/669] 10.222.0.15 () {56 vars in 1109 bytes} [Tue May 31 14:30:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:23.367281 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeb5663-3d52-4543-a19d-367e3e9c7d1b None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:23.422961 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed47a5a-5179-4901-9d1d-291d40f8e915 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:23.467685 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:23.471343 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349528ba-47f5-42a4-8fe1-0a077e196e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:23.471343 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349528ba-47f5-42a4-8fe1-0a077e196e19 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:23.471343 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349528ba-47f5-42a4-8fe1-0a077e196e19 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:23.471343 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349528ba-47f5-42a4-8fe1-0a077e196e19 None admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:23.472194 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349528ba-47f5-42a4-8fe1-0a077e196e19 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:23.472509 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349528ba-47f5-42a4-8fe1-0a077e196e19 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:23.473950 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349528ba-47f5-42a4-8fe1-0a077e196e19 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:23.493663 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeb5663-3d52-4543-a19d-367e3e9c7d1b None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:23.497523 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 334/670] 10.222.0.15 () {56 vars in 1139 bytes} [Tue May 31 14:30:23 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:23.498673 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349528ba-47f5-42a4-8fe1-0a077e196e19 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:23.533469 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425158ea-a048-43b4-aec7-1de3a4642f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:23.534138 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425158ea-a048-43b4-aec7-1de3a4642f8c None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:23.534420 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425158ea-a048-43b4-aec7-1de3a4642f8c None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:23.534728 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425158ea-a048-43b4-aec7-1de3a4642f8c None admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:23.535715 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425158ea-a048-43b4-aec7-1de3a4642f8c None admin] RBAC: Adding query filter params (name=service) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:23.536018 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425158ea-a048-43b4-aec7-1de3a4642f8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:23.537382 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425158ea-a048-43b4-aec7-1de3a4642f8c None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:23.550236 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 337/671] 10.222.0.15 () {56 vars in 1103 bytes} [Tue May 31 14:30:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:23.560531 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425158ea-a048-43b4-aec7-1de3a4642f8c None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:23.572899 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:23.614168 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349528ba-47f5-42a4-8fe1-0a077e196e19 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:23.655678 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82d9845-610a-4509-b552-415eb46c285c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:23.656849 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d9845-610a-4509-b552-415eb46c285c None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:23.657357 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d9845-610a-4509-b552-415eb46c285c None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:23.657841 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d9845-610a-4509-b552-415eb46c285c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:23.666088 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82d9845-610a-4509-b552-415eb46c285c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:23.667838 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82d9845-610a-4509-b552-415eb46c285c None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:23.677221 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425158ea-a048-43b4-aec7-1de3a4642f8c None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:23.683848 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-d82d9845-610a-4509-b552-415eb46c285c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 14:30:23.683848 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:23.683848 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:23.683848 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:23.683848 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:23.683848 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:23.683848 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:23.683848 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:23.683848 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:23.683848 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:23.683848 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:23.683848 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:23.683848 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 14:30:23.683848 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 14:30:23.683848 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 14:30:23.684719 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 14:30:23.684719 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:23.684719 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:23.684719 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:23.684719 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:23.684719 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:23.684719 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:23.684719 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:23.684719 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:30:23.684719 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:23.684719 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:23.684719 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:23.684719 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:23.684719 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:23.684719 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:23.684719 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:23.684719 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:23.685686 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 14:30:23.685686 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 14:30:23.685686 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 14:30:23.685686 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 14:30:23.685686 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 14:30:23.685686 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 14:30:23.685686 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 14:30:23.685686 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:30:23.688087 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 335/672] 10.222.0.15 () {56 vars in 1111 bytes} [Tue May 31 14:30:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:23.689069 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82d9845-610a-4509-b552-415eb46c285c None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:23.718534 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a557aeca-75d1-4c8e-b5f3-7fbc17fbf123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:23.719228 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a557aeca-75d1-4c8e-b5f3-7fbc17fbf123 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:23.719515 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a557aeca-75d1-4c8e-b5f3-7fbc17fbf123 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:23.719830 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a557aeca-75d1-4c8e-b5f3-7fbc17fbf123 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:23.735349 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:23.801087 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a557aeca-75d1-4c8e-b5f3-7fbc17fbf123 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:23.803239 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a557aeca-75d1-4c8e-b5f3-7fbc17fbf123 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:23.805193 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82d9845-610a-4509-b552-415eb46c285c None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:23.842250 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:23.853471 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2f209a-7f8b-4076-a4c2-1547c2d32464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:23.854644 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f209a-7f8b-4076-a4c2-1547c2d32464 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:23.855477 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f209a-7f8b-4076-a4c2-1547c2d32464 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:23.856090 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f209a-7f8b-4076-a4c2-1547c2d32464 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:23.869876 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2f209a-7f8b-4076-a4c2-1547c2d32464 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:23.872466 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2f209a-7f8b-4076-a4c2-1547c2d32464 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:23.903489 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-fb2f209a-7f8b-4076-a4c2-1547c2d32464 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:23.903489 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:23.903489 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:23.903489 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:23.903489 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:23.903489 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:23.903489 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:23.903489 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:23.903489 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:23.903489 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:23.903489 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:23.903489 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:23.903489 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 14:30:23.903489 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 14:30:23.903489 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 14:30:23.904426 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 14:30:23.904426 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:23.904426 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:23.904426 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:23.904426 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:23.904426 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:23.904426 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:23.904426 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:23.904426 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:30:23.904426 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:23.904426 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:23.904426 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:23.904426 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:23.904426 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:23.904426 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:23.904426 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:23.904426 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:23.905302 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 14:30:23.905302 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 14:30:23.905302 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:23.905302 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:30:23.908103 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 336/673] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:30:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:23.909104 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2f209a-7f8b-4076-a4c2-1547c2d32464 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:23.924315 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 338/674] 10.222.0.15 () {58 vars in 1282 bytes} [Tue May 31 14:30:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 31 14:30:23.925268 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a557aeca-75d1-4c8e-b5f3-7fbc17fbf123 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:23.979325 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:24.038743 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2f209a-7f8b-4076-a4c2-1547c2d32464 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:24.040629 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a557aeca-75d1-4c8e-b5f3-7fbc17fbf123 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:24.074634 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ca7dcc-4747-43b0-808a-b5e194691471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:24.075303 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ca7dcc-4747-43b0-808a-b5e194691471 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:24.075580 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ca7dcc-4747-43b0-808a-b5e194691471 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:24.075855 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ca7dcc-4747-43b0-808a-b5e194691471 None admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:24.076650 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ca7dcc-4747-43b0-808a-b5e194691471 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:24.076961 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ca7dcc-4747-43b0-808a-b5e194691471 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:24.078664 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ca7dcc-4747-43b0-808a-b5e194691471 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:24.081953 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7d5557-4abd-4eff-b696-2870a261f3c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:24.083259 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d5557-4abd-4eff-b696-2870a261f3c4 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:24.083751 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d5557-4abd-4eff-b696-2870a261f3c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:24.084276 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d5557-4abd-4eff-b696-2870a261f3c4 None admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:24.085294 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7d5557-4abd-4eff-b696-2870a261f3c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:24.085782 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7d5557-4abd-4eff-b696-2870a261f3c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:24.087535 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7d5557-4abd-4eff-b696-2870a261f3c4 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:24.098695 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 337/675] 10.222.0.15 () {56 vars in 1148 bytes} [Tue May 31 14:30:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:24.098695 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ca7dcc-4747-43b0-808a-b5e194691471 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:24.105086 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 339/676] 10.222.0.15 () {56 vars in 1109 bytes} [Tue May 31 14:30:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:24.106232 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7889f7c8-ee1b-4cc0-9c38-47502ebedf86 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:24.106525 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7889f7c8-ee1b-4cc0-9c38-47502ebedf86 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:24.106826 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7889f7c8-ee1b-4cc0-9c38-47502ebedf86 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:24.108550 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 340/677] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:30:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:30:24.109305 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7889f7c8-ee1b-4cc0-9c38-47502ebedf86 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:24.154814 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:24.216074 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ca7dcc-4747-43b0-808a-b5e194691471 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:24.218095 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7889f7c8-ee1b-4cc0-9c38-47502ebedf86 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:24.220865 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:24.252085 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd233db1-cfa8-44f9-aaa9-196a1eae3a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:24.252867 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd233db1-cfa8-44f9-aaa9-196a1eae3a30 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:24.253150 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd233db1-cfa8-44f9-aaa9-196a1eae3a30 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:24.253446 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd233db1-cfa8-44f9-aaa9-196a1eae3a30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:24.254486 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72baa88-eab4-4656-bece-8e31fde3b8b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:24.255361 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72baa88-eab4-4656-bece-8e31fde3b8b2 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:24.255783 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72baa88-eab4-4656-bece-8e31fde3b8b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:24.256205 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72baa88-eab4-4656-bece-8e31fde3b8b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:24.257565 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72baa88-eab4-4656-bece-8e31fde3b8b2 None admin] RBAC: Adding query filter params (role.id=4fa2a9add9bc4786a62e7b5cae3cc051, scope.project.id=ffff4334538649fdba1beb80cad207fa, user.id=14ba98b007cc4ae1b20e7f261824b77c) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:24.257877 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72baa88-eab4-4656-bece-8e31fde3b8b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:24.259337 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72baa88-eab4-4656-bece-8e31fde3b8b2 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:24.264699 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd233db1-cfa8-44f9-aaa9-196a1eae3a30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:24.270641 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 341/678] 10.222.0.15 () {56 vars in 1374 bytes} [Tue May 31 14:30:24 2022] GET /identity/v3/role_assignments?user.id=14ba98b007cc4ae1b20e7f261824b77c&scope.project.id=ffff4334538649fdba1beb80cad207fa&role.id=4fa2a9add9bc4786a62e7b5cae3cc051 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:24.270821 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd233db1-cfa8-44f9-aaa9-196a1eae3a30 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:24.271249 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72baa88-eab4-4656-bece-8e31fde3b8b2 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:24.307737 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-cd233db1-cfa8-44f9-aaa9-196a1eae3a30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:24.307737 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:24.307737 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:24.307737 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:24.307737 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:24.307737 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:24.307737 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:24.307737 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:24.307737 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:24.307737 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:24.307737 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:24.307737 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:24.307737 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 14:30:24.307737 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 14:30:24.307737 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 14:30:24.308875 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 14:30:24.308875 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:24.308875 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:24.308875 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:24.308875 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:24.308875 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:24.308875 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:24.308875 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:24.308875 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:30:24.308875 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:24.308875 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:24.308875 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:24.308875 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:24.308875 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:24.308875 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:24.308875 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:24.308875 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:24.309849 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 14:30:24.309849 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 14:30:24.309849 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:24.309849 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:30:24.316640 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 338/679] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:30:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:24.318403 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c6584a-ad32-4438-9c72-f39d87910bf4 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:24.318745 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c6584a-ad32-4438-9c72-f39d87910bf4 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:24.319028 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c6584a-ad32-4438-9c72-f39d87910bf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:24.344229 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-38c6584a-ad32-4438-9c72-f39d87910bf4 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:30:24.346685 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-38c6584a-ad32-4438-9c72-f39d87910bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:30:24.413954 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72baa88-eab4-4656-bece-8e31fde3b8b2 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:24.455571 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 339/680] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:30:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 14:30:24.457014 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c6584a-ad32-4438-9c72-f39d87910bf4 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:24.458017 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3c943f-1fb2-4dc6-bbea-9091d6ff4f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:24.458889 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c943f-1fb2-4dc6-bbea-9091d6ff4f1c None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:24.459171 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c943f-1fb2-4dc6-bbea-9091d6ff4f1c None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:24.459443 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c943f-1fb2-4dc6-bbea-9091d6ff4f1c None admin] PATH_INFO: `/v3/users/swift` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:24.468537 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3c943f-1fb2-4dc6-bbea-9091d6ff4f1c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:24.470009 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3c943f-1fb2-4dc6-bbea-9091d6ff4f1c None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:24.483755 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:24.508126 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-ba3c943f-1fb2-4dc6-bbea-9091d6ff4f1c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 31 14:30:24.508126 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:24.508126 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:24.508126 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:24.508126 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:24.508126 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:24.508126 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:24.508126 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:24.508126 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:24.508126 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:24.508126 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:24.508126 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:24.508126 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 14:30:24.508126 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 14:30:24.508126 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 14:30:24.508126 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 14:30:24.509138 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:24.509138 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:24.509138 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 14:30:24.509138 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 14:30:24.509138 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 14:30:24.509138 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 14:30:24.509138 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:24.509138 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:24.509138 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:24.509138 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:24.509138 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:24.509138 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:30:24.509138 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:24.509138 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:24.509138 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:24.509138 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:24.509138 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:24.509138 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:24.510092 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:24.510092 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:24.510092 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 14:30:24.510092 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 14:30:24.510092 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 14:30:24.510092 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 14:30:24.510092 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 14:30:24.510092 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 14:30:24.510092 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 31 14:30:24.510092 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:30:24.510092 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 342/681] 10.222.0.15 () {56 vars in 1096 bytes} [Tue May 31 14:30:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:24.510753 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3c943f-1fb2-4dc6-bbea-9091d6ff4f1c None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:24.552777 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:24.595899 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c6584a-ad32-4438-9c72-f39d87910bf4 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:24.634280 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3c943f-1fb2-4dc6-bbea-9091d6ff4f1c None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:24.635411 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a67023-acfa-4af9-866c-3fe3136b6728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:24.636079 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a67023-acfa-4af9-866c-3fe3136b6728 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:24.636371 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a67023-acfa-4af9-866c-3fe3136b6728 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:24.636653 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a67023-acfa-4af9-866c-3fe3136b6728 None admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:24.637375 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a67023-acfa-4af9-866c-3fe3136b6728 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:24.637683 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a67023-acfa-4af9-866c-3fe3136b6728 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:24.639902 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a67023-acfa-4af9-866c-3fe3136b6728 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:24.657044 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 340/682] 10.222.0.15 () {56 vars in 1109 bytes} [Tue May 31 14:30:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:24.657991 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a67023-acfa-4af9-866c-3fe3136b6728 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:24.689179 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf62c6b-7ace-4a4b-b69d-a32a90903665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:24.690381 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf62c6b-7ace-4a4b-b69d-a32a90903665 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:24.690757 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf62c6b-7ace-4a4b-b69d-a32a90903665 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:24.691173 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf62c6b-7ace-4a4b-b69d-a32a90903665 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:24.705858 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf62c6b-7ace-4a4b-b69d-a32a90903665 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 14:30:24.713980 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-baf62c6b-7ace-4a4b-b69d-a32a90903665 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 31 14:30:24.713980 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:24.713980 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:24.713980 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:24.713980 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:24.713980 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:24.713980 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:24.713980 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:24.713980 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:24.713980 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:24.713980 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:24.713980 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:24.713980 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 14:30:24.713980 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 14:30:24.713980 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 14:30:24.713980 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 14:30:24.714933 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 14:30:24.714933 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 14:30:24.714933 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 14:30:24.714933 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 14:30:24.714933 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:24.714933 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:24.714933 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:24.714933 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:24.714933 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:24.714933 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:24.714933 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:24.714933 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:30:24.714933 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:24.714933 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:24.714933 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:24.714933 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:24.715776 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:24.715776 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:24.715776 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:24.715776 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:24.715776 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 14:30:24.715776 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 14:30:24.715776 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 14:30:24.715776 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 14:30:24.715776 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 14:30:24.715776 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 14:30:24.715776 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 31 14:30:24.715776 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:30:24.715776 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 343/683] 10.222.0.15 () {56 vars in 1096 bytes} [Tue May 31 14:30:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:24.716492 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf62c6b-7ace-4a4b-b69d-a32a90903665 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:24.762388 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:24.789719 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a67023-acfa-4af9-866c-3fe3136b6728 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:24.818545 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:24.833055 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf62c6b-7ace-4a4b-b69d-a32a90903665 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:24.836953 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a35ed81-7e54-42fc-a65f-15edad1cc665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:24.837812 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a35ed81-7e54-42fc-a65f-15edad1cc665 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:24.838263 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a35ed81-7e54-42fc-a65f-15edad1cc665 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:24.838803 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a35ed81-7e54-42fc-a65f-15edad1cc665 None admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:24.839784 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a35ed81-7e54-42fc-a65f-15edad1cc665 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:24.840236 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a35ed81-7e54-42fc-a65f-15edad1cc665 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:24.842244 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a35ed81-7e54-42fc-a65f-15edad1cc665 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:24.872988 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 341/684] 10.222.0.15 () {56 vars in 1135 bytes} [Tue May 31 14:30:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:24.872988 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a35ed81-7e54-42fc-a65f-15edad1cc665 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:24.884204 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b59729-19bc-481b-82ac-cf7d041d14ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:24.885009 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b59729-19bc-481b-82ac-cf7d041d14ae None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:24.885293 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b59729-19bc-481b-82ac-cf7d041d14ae None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:24.885572 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b59729-19bc-481b-82ac-cf7d041d14ae None admin] PATH_INFO: `/v3/projects/service` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:24.892933 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b59729-19bc-481b-82ac-cf7d041d14ae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:24.894468 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b59729-19bc-481b-82ac-cf7d041d14ae None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:24.909112 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-f2b59729-19bc-481b-82ac-cf7d041d14ae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 14:30:24.909112 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:24.909112 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:24.909112 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:24.909112 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:24.909112 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:24.909112 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:24.909112 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:24.909112 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:24.909112 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:24.909112 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:24.909112 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:24.909112 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 14:30:24.909112 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 14:30:24.909112 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 14:30:24.910336 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 14:30:24.910336 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:24.910336 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:24.910336 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:24.910336 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:24.910336 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:24.910336 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:24.910336 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:24.910336 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:30:24.910336 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:24.910336 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:24.910336 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:24.910336 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:24.910336 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:24.910336 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:24.910336 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:24.910336 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:24.911318 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 14:30:24.911318 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 14:30:24.911318 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 14:30:24.911318 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 14:30:24.911318 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 14:30:24.911318 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 14:30:24.911318 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 14:30:24.911318 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:30:24.915691 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 344/685] 10.222.0.15 () {56 vars in 1111 bytes} [Tue May 31 14:30:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:24.916564 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b59729-19bc-481b-82ac-cf7d041d14ae None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:25.009927 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a35ed81-7e54-42fc-a65f-15edad1cc665 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:25.038622 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b59729-19bc-481b-82ac-cf7d041d14ae None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:25.047167 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e379a5d6-e0db-44de-9df5-d0d7db58e9b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:25.047921 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e379a5d6-e0db-44de-9df5-d0d7db58e9b2 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:25.048287 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e379a5d6-e0db-44de-9df5-d0d7db58e9b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:25.048637 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e379a5d6-e0db-44de-9df5-d0d7db58e9b2 None admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:25.049649 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e379a5d6-e0db-44de-9df5-d0d7db58e9b2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:25.049779 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e379a5d6-e0db-44de-9df5-d0d7db58e9b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:25.051358 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e379a5d6-e0db-44de-9df5-d0d7db58e9b2 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:25.058089 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:25.066663 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 342/686] 10.222.0.15 () {56 vars in 1099 bytes} [Tue May 31 14:30:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:25.066663 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e379a5d6-e0db-44de-9df5-d0d7db58e9b2 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:25.098404 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61162429-3181-497a-955f-a8f02d83b21f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:25.099939 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61162429-3181-497a-955f-a8f02d83b21f None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:25.100375 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61162429-3181-497a-955f-a8f02d83b21f None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:25.101156 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61162429-3181-497a-955f-a8f02d83b21f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:25.122515 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:25.176381 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61162429-3181-497a-955f-a8f02d83b21f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:25.178017 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61162429-3181-497a-955f-a8f02d83b21f None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:25.200625 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e379a5d6-e0db-44de-9df5-d0d7db58e9b2 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:25.251820 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80a6105-d255-4d03-968c-4f347f41c3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:25.253025 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80a6105-d255-4d03-968c-4f347f41c3b2 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:25.253457 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80a6105-d255-4d03-968c-4f347f41c3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:25.253907 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80a6105-d255-4d03-968c-4f347f41c3b2 None admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:25.254881 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80a6105-d255-4d03-968c-4f347f41c3b2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:25.255344 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80a6105-d255-4d03-968c-4f347f41c3b2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:25.258385 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80a6105-d255-4d03-968c-4f347f41c3b2 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:25.275781 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 343/687] 10.222.0.15 () {56 vars in 1148 bytes} [Tue May 31 14:30:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:25.277293 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80a6105-d255-4d03-968c-4f347f41c3b2 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:25.312891 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 345/688] 10.222.0.15 () {58 vars in 1282 bytes} [Tue May 31 14:30:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 31 14:30:25.312891 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61162429-3181-497a-955f-a8f02d83b21f None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:25.355059 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:25.375858 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:25.398665 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80a6105-d255-4d03-968c-4f347f41c3b2 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:25.441176 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8a07a2-14a7-4b5d-b486-e02cddf3df02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:25.442177 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a07a2-14a7-4b5d-b486-e02cddf3df02 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:25.442796 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a07a2-14a7-4b5d-b486-e02cddf3df02 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:25.443138 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61162429-3181-497a-955f-a8f02d83b21f None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:25.443279 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a07a2-14a7-4b5d-b486-e02cddf3df02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:25.455329 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8a07a2-14a7-4b5d-b486-e02cddf3df02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:25.456992 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8a07a2-14a7-4b5d-b486-e02cddf3df02 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:25.475571 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-fd8a07a2-14a7-4b5d-b486-e02cddf3df02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:25.475571 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:25.475571 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:25.475571 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:25.475571 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:25.475571 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:25.475571 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:25.475571 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:25.475571 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:25.475571 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:25.475571 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:25.475571 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:25.475571 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 14:30:25.475571 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 14:30:25.475571 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 14:30:25.476653 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 14:30:25.476653 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:25.476653 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:25.476653 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:25.476653 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:25.476653 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:25.476653 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:25.476653 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:25.476653 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:30:25.476653 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:25.476653 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:25.476653 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:25.476653 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:25.476653 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:25.476653 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:25.476653 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:25.476653 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:25.477539 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 14:30:25.477539 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 14:30:25.477539 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:25.477539 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:30:25.482261 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 344/689] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:30:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:25.483262 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8a07a2-14a7-4b5d-b486-e02cddf3df02 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:25.488428 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b105a13-2726-4e96-8ffa-6d003e3b6122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:25.489317 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b105a13-2726-4e96-8ffa-6d003e3b6122 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:25.489799 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b105a13-2726-4e96-8ffa-6d003e3b6122 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:25.490262 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b105a13-2726-4e96-8ffa-6d003e3b6122 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:25.491816 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b105a13-2726-4e96-8ffa-6d003e3b6122 None admin] RBAC: Adding query filter params (role.id=4fa2a9add9bc4786a62e7b5cae3cc051, scope.project.id=ffff4334538649fdba1beb80cad207fa, user.id=c5262f4b9b2948fdb3b4ab504311453b) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:25.492307 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b105a13-2726-4e96-8ffa-6d003e3b6122 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:25.494471 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b105a13-2726-4e96-8ffa-6d003e3b6122 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:25.503341 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 346/690] 10.222.0.15 () {56 vars in 1374 bytes} [Tue May 31 14:30:25 2022] GET /identity/v3/role_assignments?user.id=c5262f4b9b2948fdb3b4ab504311453b&scope.project.id=ffff4334538649fdba1beb80cad207fa&role.id=4fa2a9add9bc4786a62e7b5cae3cc051 => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:25.504342 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b105a13-2726-4e96-8ffa-6d003e3b6122 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:25.629312 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b105a13-2726-4e96-8ffa-6d003e3b6122 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:25.637900 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8a07a2-14a7-4b5d-b486-e02cddf3df02 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:25.645012 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:25.655828 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:25.668331 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164acb2f-4461-44e0-94dd-54cd345594e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:25.669034 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164acb2f-4461-44e0-94dd-54cd345594e2 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:25.669597 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164acb2f-4461-44e0-94dd-54cd345594e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:25.669597 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164acb2f-4461-44e0-94dd-54cd345594e2 None admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:25.670314 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164acb2f-4461-44e0-94dd-54cd345594e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:25.670667 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164acb2f-4461-44e0-94dd-54cd345594e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:25.672095 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164acb2f-4461-44e0-94dd-54cd345594e2 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:25.682102 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e01e51e-319f-4419-9085-9f46f3493193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:25.683303 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01e51e-319f-4419-9085-9f46f3493193 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:25.683808 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01e51e-319f-4419-9085-9f46f3493193 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:25.684302 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01e51e-319f-4419-9085-9f46f3493193 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:25.685183 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 347/691] 10.222.0.15 () {56 vars in 1109 bytes} [Tue May 31 14:30:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:25.686719 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcec3bc-936f-4ad9-b9da-d2ba80eee278 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:25.687057 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcec3bc-936f-4ad9-b9da-d2ba80eee278 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:25.687274 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcec3bc-936f-4ad9-b9da-d2ba80eee278 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:25.692768 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 348/692] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:30:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:30:25.694440 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcec3bc-936f-4ad9-b9da-d2ba80eee278 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:25.698688 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e01e51e-319f-4419-9085-9f46f3493193 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:25.700416 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e01e51e-319f-4419-9085-9f46f3493193 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:25.728350 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-9e01e51e-319f-4419-9085-9f46f3493193 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:25.728350 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:25.728350 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:25.728350 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:25.728350 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:25.728350 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:25.728350 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:25.728350 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:25.728350 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:25.728350 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:25.728350 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:25.728350 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:25.728350 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 14:30:25.728350 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 14:30:25.728350 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 14:30:25.729370 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 14:30:25.729370 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:25.729370 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:25.729370 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:25.729370 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:25.729370 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:25.729370 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:25.729370 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:25.729370 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:30:25.729370 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:25.729370 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:25.729370 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:25.729370 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:25.729370 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:25.729370 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:25.729370 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:25.729370 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:25.730285 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 14:30:25.730285 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 14:30:25.730285 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:25.730285 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:30:25.734441 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 345/693] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:30:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:25.736444 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740b3cec-d849-4c66-919e-25bfd3065a92 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:25.736746 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740b3cec-d849-4c66-919e-25bfd3065a92 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:25.737032 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740b3cec-d849-4c66-919e-25bfd3065a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:25.757849 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-740b3cec-d849-4c66-919e-25bfd3065a92 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:30:25.759116 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-740b3cec-d849-4c66-919e-25bfd3065a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:30:25.847234 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 346/694] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:30:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 14:30:25.848688 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740b3cec-d849-4c66-919e-25bfd3065a92 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:25.863282 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcec3bc-936f-4ad9-b9da-d2ba80eee278 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:25.910204 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f84223b-25d8-44bd-9b8e-3c333dcd1d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:25.911061 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f84223b-25d8-44bd-9b8e-3c333dcd1d17 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:25.911360 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f84223b-25d8-44bd-9b8e-3c333dcd1d17 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:25.911775 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f84223b-25d8-44bd-9b8e-3c333dcd1d17 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:25.920357 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f84223b-25d8-44bd-9b8e-3c333dcd1d17 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:25.921923 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f84223b-25d8-44bd-9b8e-3c333dcd1d17 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:25.937581 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-2f84223b-25d8-44bd-9b8e-3c333dcd1d17 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 31 14:30:25.937581 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:25.937581 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:25.937581 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:25.937581 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:25.937581 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:25.937581 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:25.937581 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:25.937581 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:25.937581 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:25.937581 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:25.937581 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:25.937581 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 14:30:25.937581 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 14:30:25.937581 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 14:30:25.937581 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 14:30:25.938577 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:25.938577 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:25.938577 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 14:30:25.938577 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 14:30:25.938577 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 14:30:25.938577 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 14:30:25.938577 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:25.938577 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:25.938577 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:25.938577 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:25.938577 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:25.938577 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:30:25.938577 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:25.938577 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:25.938577 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:25.938577 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:25.938577 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:25.938577 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:25.939961 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:25.939961 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:25.939961 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 14:30:25.939961 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 14:30:25.939961 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 14:30:25.939961 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 14:30:25.939961 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 14:30:25.939961 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 14:30:25.939961 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 31 14:30:25.939961 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:30:25.939961 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 349/695] 10.222.0.15 () {56 vars in 1093 bytes} [Tue May 31 14:30:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:25.944579 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f84223b-25d8-44bd-9b8e-3c333dcd1d17 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:25.970953 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:25.977871 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:25.981866 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740b3cec-d849-4c66-919e-25bfd3065a92 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:26.026852 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922d68ea-0571-4946-a244-ea6c65821f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:26.027989 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d68ea-0571-4946-a244-ea6c65821f62 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:26.028942 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d68ea-0571-4946-a244-ea6c65821f62 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:26.029426 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d68ea-0571-4946-a244-ea6c65821f62 None admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:26.030801 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922d68ea-0571-4946-a244-ea6c65821f62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:26.031585 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922d68ea-0571-4946-a244-ea6c65821f62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:26.033441 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922d68ea-0571-4946-a244-ea6c65821f62 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:26.051432 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 347/696] 10.222.0.15 () {56 vars in 1109 bytes} [Tue May 31 14:30:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:26.053323 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922d68ea-0571-4946-a244-ea6c65821f62 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:26.055087 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f84223b-25d8-44bd-9b8e-3c333dcd1d17 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:26.103712 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dffb6dc-dde0-4bec-aae2-2e7532a93708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:26.104539 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dffb6dc-dde0-4bec-aae2-2e7532a93708 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:26.104876 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dffb6dc-dde0-4bec-aae2-2e7532a93708 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:26.105154 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dffb6dc-dde0-4bec-aae2-2e7532a93708 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:26.105968 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dffb6dc-dde0-4bec-aae2-2e7532a93708 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:26.107540 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dffb6dc-dde0-4bec-aae2-2e7532a93708 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:26.123904 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-1dffb6dc-dde0-4bec-aae2-2e7532a93708 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 31 14:30:26.123904 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:26.123904 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 31 14:30:26.123904 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 31 14:30:26.123904 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 31 14:30:26.123904 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 31 14:30:26.123904 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 31 14:30:26.123904 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 14:30:26.123904 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 31 14:30:26.123904 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:30:26.123904 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 31 14:30:26.123904 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:30:26.123904 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:26.123904 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:26.123904 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:26.123904 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:26.124923 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:26.124923 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:26.124923 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:26.124923 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:26.124923 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:26.124923 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:26.124923 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:26.124923 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 31 14:30:26.124923 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_service(service_id) May 31 14:30:26.124923 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 31 14:30:26.124923 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 31 14:30:26.124923 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:26.124923 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:26.124923 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:26.124923 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:26.124923 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:26.125764 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:26.125764 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:26.125764 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:30:26.125764 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:26.125764 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:26.125764 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:26.125764 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:26.125764 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:26.125764 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:26.125764 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:26.125764 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:26.125764 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 31 14:30:26.125764 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 14:30:26.125764 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 31 14:30:26.125764 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:30:26.130155 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 350/697] 10.222.0.15 () {56 vars in 1129 bytes} [Tue May 31 14:30:25 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:26.131323 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dffb6dc-dde0-4bec-aae2-2e7532a93708 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:26.185368 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922d68ea-0571-4946-a244-ea6c65821f62 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:26.230969 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf68578-9970-4aa1-b6c3-da5038d6ed08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:26.232527 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf68578-9970-4aa1-b6c3-da5038d6ed08 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:26.233132 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf68578-9970-4aa1-b6c3-da5038d6ed08 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:26.233611 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf68578-9970-4aa1-b6c3-da5038d6ed08 None admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:26.235109 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf68578-9970-4aa1-b6c3-da5038d6ed08 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:26.235633 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf68578-9970-4aa1-b6c3-da5038d6ed08 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:26.237306 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf68578-9970-4aa1-b6c3-da5038d6ed08 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:26.245315 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:26.251926 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dffb6dc-dde0-4bec-aae2-2e7532a93708 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:26.262096 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 348/698] 10.222.0.15 () {56 vars in 1133 bytes} [Tue May 31 14:30:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:26.272400 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf68578-9970-4aa1-b6c3-da5038d6ed08 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:26.281972 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:26.291847 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0ad8a3-8ade-4b36-ada6-11d6e7f91df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:26.292715 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ad8a3-8ade-4b36-ada6-11d6e7f91df3 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:26.293000 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ad8a3-8ade-4b36-ada6-11d6e7f91df3 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:26.293289 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ad8a3-8ade-4b36-ada6-11d6e7f91df3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:26.304141 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0ad8a3-8ade-4b36-ada6-11d6e7f91df3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:26.306333 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0ad8a3-8ade-4b36-ada6-11d6e7f91df3 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:26.329148 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-fb0ad8a3-8ade-4b36-ada6-11d6e7f91df3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 14:30:26.329148 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:26.329148 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:26.329148 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:26.329148 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:26.329148 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:26.329148 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:26.329148 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:26.329148 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:26.329148 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:26.329148 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:26.329148 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:26.329148 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 14:30:26.329148 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 14:30:26.329148 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 14:30:26.330090 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 14:30:26.330090 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:26.330090 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:26.330090 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:26.330090 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:26.330090 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:26.330090 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:26.330090 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:26.330090 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:30:26.330090 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:26.330090 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:26.330090 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:26.330090 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:26.330090 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:26.330090 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:26.330090 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:26.330090 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:26.331112 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 14:30:26.331112 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 14:30:26.331112 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 14:30:26.331112 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 14:30:26.331112 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 14:30:26.331112 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 14:30:26.331112 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 14:30:26.331112 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:30:26.335382 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 351/699] 10.222.0.15 () {56 vars in 1111 bytes} [Tue May 31 14:30:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:26.336203 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0ad8a3-8ade-4b36-ada6-11d6e7f91df3 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:26.403725 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf68578-9970-4aa1-b6c3-da5038d6ed08 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:26.453156 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0ad8a3-8ade-4b36-ada6-11d6e7f91df3 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:26.455633 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7e29b7-5232-4fda-bdae-1728ee85c64d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:26.457423 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e29b7-5232-4fda-bdae-1728ee85c64d None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:26.457896 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e29b7-5232-4fda-bdae-1728ee85c64d None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:26.458354 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7e29b7-5232-4fda-bdae-1728ee85c64d None admin] PATH_INFO: `/v3/services` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:26.459294 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7e29b7-5232-4fda-bdae-1728ee85c64d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:26.460311 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7e29b7-5232-4fda-bdae-1728ee85c64d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:26.461869 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7e29b7-5232-4fda-bdae-1728ee85c64d None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:26.474754 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 349/700] 10.222.0.15 () {56 vars in 1124 bytes} [Tue May 31 14:30:26 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:26.474754 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7e29b7-5232-4fda-bdae-1728ee85c64d None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:26.505876 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4454b125-22c0-401c-bcf9-f670899c5522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:26.507188 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4454b125-22c0-401c-bcf9-f670899c5522 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:26.507860 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4454b125-22c0-401c-bcf9-f670899c5522 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:26.508294 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4454b125-22c0-401c-bcf9-f670899c5522 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:26.545989 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:26.571768 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:26.598069 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4454b125-22c0-401c-bcf9-f670899c5522 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:26.599748 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4454b125-22c0-401c-bcf9-f670899c5522 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:26.604785 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7e29b7-5232-4fda-bdae-1728ee85c64d None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:26.651017 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ffabd5-f6fa-46e4-bd2f-db8068e8d98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:26.652430 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ffabd5-f6fa-46e4-bd2f-db8068e8d98c None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:26.653336 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ffabd5-f6fa-46e4-bd2f-db8068e8d98c None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:26.653803 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ffabd5-f6fa-46e4-bd2f-db8068e8d98c None admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:26.655105 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ffabd5-f6fa-46e4-bd2f-db8068e8d98c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:26.655613 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ffabd5-f6fa-46e4-bd2f-db8068e8d98c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:26.658155 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ffabd5-f6fa-46e4-bd2f-db8068e8d98c None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:26.675815 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 350/701] 10.222.0.15 () {56 vars in 1148 bytes} [Tue May 31 14:30:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:26.677023 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ffabd5-f6fa-46e4-bd2f-db8068e8d98c None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:26.731852 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 352/702] 10.222.0.15 () {58 vars in 1282 bytes} [Tue May 31 14:30:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 31 14:30:26.733624 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4454b125-22c0-401c-bcf9-f670899c5522 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:26.790895 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ffabd5-f6fa-46e4-bd2f-db8068e8d98c None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:26.812875 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:26.827763 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed57317b-1f3d-4429-b58d-3f267131af6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:26.828437 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed57317b-1f3d-4429-b58d-3f267131af6a None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:26.828725 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed57317b-1f3d-4429-b58d-3f267131af6a None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:26.829005 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed57317b-1f3d-4429-b58d-3f267131af6a None admin] PATH_INFO: `/v3/services` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:26.829714 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed57317b-1f3d-4429-b58d-3f267131af6a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:26.830023 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed57317b-1f3d-4429-b58d-3f267131af6a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:26.831514 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed57317b-1f3d-4429-b58d-3f267131af6a None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:26.835573 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:26.842589 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 351/703] 10.222.0.15 () {56 vars in 1124 bytes} [Tue May 31 14:30:26 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:26.842589 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed57317b-1f3d-4429-b58d-3f267131af6a None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:26.873948 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4454b125-22c0-401c-bcf9-f670899c5522 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:26.926459 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d8e949-ceed-48d1-865a-b4668eccf9e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:26.927172 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d8e949-ceed-48d1-865a-b4668eccf9e7 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:26.927458 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d8e949-ceed-48d1-865a-b4668eccf9e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:26.927734 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d8e949-ceed-48d1-865a-b4668eccf9e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:26.928730 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d8e949-ceed-48d1-865a-b4668eccf9e7 None admin] RBAC: Adding query filter params (role.id=4fa2a9add9bc4786a62e7b5cae3cc051, scope.project.id=ffff4334538649fdba1beb80cad207fa, user.id=e158f461c66e4d779f23fb7760672897) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:26.928970 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d8e949-ceed-48d1-865a-b4668eccf9e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:26.930469 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d8e949-ceed-48d1-865a-b4668eccf9e7 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:26.942595 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 353/704] 10.222.0.15 () {56 vars in 1374 bytes} [Tue May 31 14:30:26 2022] GET /identity/v3/role_assignments?user.id=e158f461c66e4d779f23fb7760672897&scope.project.id=ffff4334538649fdba1beb80cad207fa&role.id=4fa2a9add9bc4786a62e7b5cae3cc051 => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:26.942595 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a17ab24-c23d-414f-9cf2-1b80a2bb9f5d None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:26.942595 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a17ab24-c23d-414f-9cf2-1b80a2bb9f5d None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:26.942595 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a17ab24-c23d-414f-9cf2-1b80a2bb9f5d None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:26.942595 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 354/705] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:30:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:30:26.947815 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4f6133-0810-4442-a124-cabf3eb6faff None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:26.948111 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4f6133-0810-4442-a124-cabf3eb6faff None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:26.948706 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4f6133-0810-4442-a124-cabf3eb6faff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:26.987317 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-0c4f6133-0810-4442-a124-cabf3eb6faff None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:30:26.988484 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-0c4f6133-0810-4442-a124-cabf3eb6faff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:30:27.038925 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed57317b-1f3d-4429-b58d-3f267131af6a None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:27.100658 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4923689-3c12-4820-94f1-858b178b6942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:27.101462 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4923689-3c12-4820-94f1-858b178b6942 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:27.101745 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4923689-3c12-4820-94f1-858b178b6942 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:27.102020 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4923689-3c12-4820-94f1-858b178b6942 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:27.127510 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 355/706] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:30:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 31 14:30:27.136842 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4923689-3c12-4820-94f1-858b178b6942 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:27.138450 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4923689-3c12-4820-94f1-858b178b6942 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:27.156756 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4f6133-0810-4442-a124-cabf3eb6faff None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:27.184672 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-c4923689-3c12-4820-94f1-858b178b6942 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:27.184672 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:27.184672 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:27.184672 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:27.184672 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:27.184672 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:27.184672 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:27.184672 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:27.184672 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:27.184672 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:27.184672 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:27.184672 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:27.184672 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 14:30:27.184672 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 14:30:27.184672 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 14:30:27.185627 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 14:30:27.185627 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:27.185627 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:27.185627 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:27.185627 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:27.185627 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:27.185627 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:27.185627 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:27.185627 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:30:27.185627 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:27.185627 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:27.185627 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:27.185627 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:27.185627 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:27.185627 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:27.185627 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:27.185627 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:27.186514 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 14:30:27.186514 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 14:30:27.186514 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:27.186514 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:30:27.196294 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 352/707] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:30:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:27.196294 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4923689-3c12-4820-94f1-858b178b6942 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:27.237936 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:27.273501 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:27.300362 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4f6133-0810-4442-a124-cabf3eb6faff None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:27.348671 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7d1aa1-b402-40cf-bd14-27ad438dd95a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:27.348671 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d1aa1-b402-40cf-bd14-27ad438dd95a None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:27.348671 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d1aa1-b402-40cf-bd14-27ad438dd95a None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:27.350744 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d1aa1-b402-40cf-bd14-27ad438dd95a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:27.372268 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7d1aa1-b402-40cf-bd14-27ad438dd95a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:27.382662 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7d1aa1-b402-40cf-bd14-27ad438dd95a None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:27.410576 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4923689-3c12-4820-94f1-858b178b6942 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:27.424328 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-6b7d1aa1-b402-40cf-bd14-27ad438dd95a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:27.424328 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:27.424328 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:27.424328 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:27.424328 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:27.424328 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:27.424328 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:27.424328 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:27.424328 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:27.424328 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:27.424328 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:27.424328 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:27.424328 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 14:30:27.424328 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 14:30:27.424328 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 14:30:27.425270 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 14:30:27.425270 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:27.425270 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:27.425270 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:27.425270 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:27.425270 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:27.425270 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:27.425270 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:27.425270 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:30:27.425270 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:27.425270 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:27.425270 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:27.425270 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:27.425270 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:27.425270 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:27.425270 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:27.425270 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:27.426609 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 14:30:27.426609 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 14:30:27.426609 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:27.426609 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:30:27.433858 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 356/708] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:30:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 14:30:27.433858 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7d1aa1-b402-40cf-bd14-27ad438dd95a None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:27.498658 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3c0c89-3f41-4a43-ac06-f0032b3f77ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:27.498658 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c0c89-3f41-4a43-ac06-f0032b3f77ca None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:27.499139 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c0c89-3f41-4a43-ac06-f0032b3f77ca None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:27.499139 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c0c89-3f41-4a43-ac06-f0032b3f77ca None admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:27.502570 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3c0c89-3f41-4a43-ac06-f0032b3f77ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:27.502570 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3c0c89-3f41-4a43-ac06-f0032b3f77ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:27.502570 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3c0c89-3f41-4a43-ac06-f0032b3f77ca None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:27.536544 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 353/709] 10.222.0.15 () {56 vars in 1109 bytes} [Tue May 31 14:30:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:27.539425 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3c0c89-3f41-4a43-ac06-f0032b3f77ca None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:27.654575 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7d1aa1-b402-40cf-bd14-27ad438dd95a None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:27.654575 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:27.764468 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691fce13-c8d0-4681-901b-f746aa8d0abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:27.765070 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691fce13-c8d0-4681-901b-f746aa8d0abf None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:27.765326 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691fce13-c8d0-4681-901b-f746aa8d0abf None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:27.765584 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691fce13-c8d0-4681-901b-f746aa8d0abf None admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:27.766302 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691fce13-c8d0-4681-901b-f746aa8d0abf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:27.778933 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691fce13-c8d0-4681-901b-f746aa8d0abf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:27.780412 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691fce13-c8d0-4681-901b-f746aa8d0abf None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:27.808068 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 357/710] 10.222.0.15 () {56 vars in 1109 bytes} [Tue May 31 14:30:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:27.822572 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691fce13-c8d0-4681-901b-f746aa8d0abf None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:27.862533 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3c0c89-3f41-4a43-ac06-f0032b3f77ca None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:27.902577 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:28.075295 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f30b89-76b4-49a2-8d99-9877a1086c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:28.076246 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f30b89-76b4-49a2-8d99-9877a1086c88 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:28.076537 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f30b89-76b4-49a2-8d99-9877a1086c88 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:28.076822 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f30b89-76b4-49a2-8d99-9877a1086c88 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:28.082925 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691fce13-c8d0-4681-901b-f746aa8d0abf None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:28.124179 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f30b89-76b4-49a2-8d99-9877a1086c88 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:28.125928 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f30b89-76b4-49a2-8d99-9877a1086c88 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:28.156164 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11bc388-7e94-4609-ab7b-47820d0f6691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:28.156793 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11bc388-7e94-4609-ab7b-47820d0f6691 None admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:28.157060 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11bc388-7e94-4609-ab7b-47820d0f6691 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:28.158457 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11bc388-7e94-4609-ab7b-47820d0f6691 None admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:28.158457 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11bc388-7e94-4609-ab7b-47820d0f6691 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:28.159483 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11bc388-7e94-4609-ab7b-47820d0f6691 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:28.175212 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-57f30b89-76b4-49a2-8d99-9877a1086c88 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 14:30:28.175212 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:28.175212 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:28.175212 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:28.175212 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:28.175212 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:28.175212 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:28.175212 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:28.175212 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:28.175212 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:28.175212 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:28.175212 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:28.175212 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 14:30:28.175212 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 14:30:28.175212 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 14:30:28.176159 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 14:30:28.176159 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:28.176159 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:28.176159 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:28.176159 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:28.176159 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:28.176159 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:28.176159 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:28.176159 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:30:28.176159 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:28.176159 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:28.176159 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:28.176159 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:28.176159 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:28.176159 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:28.176159 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:28.176159 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:28.177175 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 14:30:28.177175 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 14:30:28.177175 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 14:30:28.177175 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 14:30:28.177175 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 14:30:28.177175 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 14:30:28.177175 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 14:30:28.177175 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:30:28.177175 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 354/711] 10.222.0.15 () {56 vars in 1111 bytes} [Tue May 31 14:30:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 639 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:28.178173 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff568b0-b5f1-41a6-8b86-c647cd161bbb None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:28.178274 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff568b0-b5f1-41a6-8b86-c647cd161bbb None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:28.183253 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff568b0-b5f1-41a6-8b86-c647cd161bbb None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:28.184570 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 355/712] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:30:28 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:30:28.185221 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff568b0-b5f1-41a6-8b86-c647cd161bbb None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:28.267626 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 358/713] 10.222.0.15 () {60 vars in 1132 bytes} [Tue May 31 14:30:27 2022] POST /identity/v3/users => generated 254 bytes in 450 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:30:28.270353 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79968791-450b-4429-9103-7726f8256412 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:28.270849 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79968791-450b-4429-9103-7726f8256412 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:28.271228 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79968791-450b-4429-9103-7726f8256412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:28.294000 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-79968791-450b-4429-9103-7726f8256412 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:30:28.296010 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-79968791-450b-4429-9103-7726f8256412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:30:28.313474 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:28.375417 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff568b0-b5f1-41a6-8b86-c647cd161bbb None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:28.400966 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 359/714] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:30:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 14:30:28.424290 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79968791-450b-4429-9103-7726f8256412 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:28.543357 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b195fd0d-4038-409c-9dd3-0ca4ba8e506a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:28.544635 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b195fd0d-4038-409c-9dd3-0ca4ba8e506a None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:28.545087 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b195fd0d-4038-409c-9dd3-0ca4ba8e506a None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:28.545515 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b195fd0d-4038-409c-9dd3-0ca4ba8e506a None admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:28.546463 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b195fd0d-4038-409c-9dd3-0ca4ba8e506a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:28.546943 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b195fd0d-4038-409c-9dd3-0ca4ba8e506a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:28.550194 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b195fd0d-4038-409c-9dd3-0ca4ba8e506a None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:28.575694 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 356/715] 10.222.0.15 () {56 vars in 1148 bytes} [Tue May 31 14:30:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:28.581781 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b195fd0d-4038-409c-9dd3-0ca4ba8e506a None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:28.618904 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:28.793100 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b195fd0d-4038-409c-9dd3-0ca4ba8e506a None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:28.850169 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79968791-450b-4429-9103-7726f8256412 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:28.927415 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdf845b-3e6e-476b-a87d-45aa706cafb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:28.929065 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdf845b-3e6e-476b-a87d-45aa706cafb1 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:28.929568 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdf845b-3e6e-476b-a87d-45aa706cafb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:28.930069 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdf845b-3e6e-476b-a87d-45aa706cafb1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:28.931216 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdf845b-3e6e-476b-a87d-45aa706cafb1 None admin] RBAC: Adding query filter params (role.id=76c53e2c353644f885028a0226c06146, scope.project.id=ffff4334538649fdba1beb80cad207fa, user.id=b57768d448e345ad8879bf29f21b48ea) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:28.931737 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdf845b-3e6e-476b-a87d-45aa706cafb1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:28.934895 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdf845b-3e6e-476b-a87d-45aa706cafb1 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:28.949183 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 357/716] 10.222.0.15 () {56 vars in 1374 bytes} [Tue May 31 14:30:28 2022] GET /identity/v3/role_assignments?user.id=b57768d448e345ad8879bf29f21b48ea&scope.project.id=ffff4334538649fdba1beb80cad207fa&role.id=76c53e2c353644f885028a0226c06146 => generated 259 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 14:30:28.987390 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660e3345-e18f-4bcf-9671-fe11265d8a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:28.988232 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e3345-e18f-4bcf-9671-fe11265d8a04 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:28.988515 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e3345-e18f-4bcf-9671-fe11265d8a04 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:28.988791 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e3345-e18f-4bcf-9671-fe11265d8a04 None admin] PATH_INFO: `/v3/services/network` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:28.989488 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660e3345-e18f-4bcf-9671-fe11265d8a04 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:28.999299 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660e3345-e18f-4bcf-9671-fe11265d8a04 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:29.035986 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-660e3345-e18f-4bcf-9671-fe11265d8a04 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 31 14:30:29.035986 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:29.035986 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 31 14:30:29.035986 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 31 14:30:29.035986 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 31 14:30:29.035986 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 31 14:30:29.035986 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 31 14:30:29.035986 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 14:30:29.035986 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 31 14:30:29.035986 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:30:29.035986 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 31 14:30:29.035986 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:30:29.035986 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:29.035986 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:29.035986 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:29.035986 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:29.035986 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:29.037068 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:29.037068 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:29.037068 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:29.037068 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:29.037068 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:29.037068 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:29.037068 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 31 14:30:29.037068 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_service(service_id) May 31 14:30:29.037068 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 31 14:30:29.037068 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 31 14:30:29.037068 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:29.037068 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:29.037068 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:29.037068 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:29.037068 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:29.037068 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:29.038488 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:29.038488 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:30:29.038488 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:29.038488 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:29.038488 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:29.038488 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:29.038488 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:29.038488 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:29.038488 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:29.038488 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:29.038488 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 31 14:30:29.038488 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 14:30:29.038488 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 31 14:30:29.038488 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:30:29.038488 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 360/717] 10.222.0.15 () {56 vars in 1111 bytes} [Tue May 31 14:30:28 2022] GET /identity/v3/services/network => generated 88 bytes in 614 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 14:30:29.047782 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdf845b-3e6e-476b-a87d-45aa706cafb1 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:29.257197 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdf845b-3e6e-476b-a87d-45aa706cafb1 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:29.278920 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:29.312186 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e690ce7a-c5ba-4a65-9469-ee161faf04fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:29.312866 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e690ce7a-c5ba-4a65-9469-ee161faf04fb None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:29.313149 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e690ce7a-c5ba-4a65-9469-ee161faf04fb None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:29.313421 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e690ce7a-c5ba-4a65-9469-ee161faf04fb None admin] PATH_INFO: `/v3/services` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:29.314123 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e690ce7a-c5ba-4a65-9469-ee161faf04fb None admin] RBAC: Adding query filter params (name=network) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:29.314427 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e690ce7a-c5ba-4a65-9469-ee161faf04fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:29.315840 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e690ce7a-c5ba-4a65-9469-ee161faf04fb None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:29.326536 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 358/718] 10.222.0.15 () {56 vars in 1112 bytes} [Tue May 31 14:30:29 2022] GET /identity/v3/services?name=network => generated 124 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:29.331977 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660e3345-e18f-4bcf-9671-fe11265d8a04 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:29.359223 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:29.498381 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660e3345-e18f-4bcf-9671-fe11265d8a04 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:29.517765 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae67fe6-32fb-4ff9-89e9-3938c15aec04 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:29.518090 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae67fe6-32fb-4ff9-89e9-3938c15aec04 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:29.518323 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae67fe6-32fb-4ff9-89e9-3938c15aec04 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:29.519848 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 359/719] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:30:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 31 14:30:29.525294 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f32843-48b5-44ee-9ae3-b32c31d2c803 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:29.525826 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f32843-48b5-44ee-9ae3-b32c31d2c803 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:29.526315 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f32843-48b5-44ee-9ae3-b32c31d2c803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:29.549069 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-02f32843-48b5-44ee-9ae3-b32c31d2c803 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:30:29.553608 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-02f32843-48b5-44ee-9ae3-b32c31d2c803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:30:29.569416 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74811d33-0132-4909-93ba-4d0e844928fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:29.570456 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74811d33-0132-4909-93ba-4d0e844928fb None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:29.570964 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74811d33-0132-4909-93ba-4d0e844928fb None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:29.571463 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74811d33-0132-4909-93ba-4d0e844928fb None admin] PATH_INFO: `/v3/services` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:29.572372 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74811d33-0132-4909-93ba-4d0e844928fb None admin] RBAC: Adding query filter params (type=network) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:29.572878 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74811d33-0132-4909-93ba-4d0e844928fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:29.574462 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74811d33-0132-4909-93ba-4d0e844928fb None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:29.594700 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 361/720] 10.222.0.15 () {56 vars in 1112 bytes} [Tue May 31 14:30:29 2022] GET /identity/v3/services?type=network => generated 124 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:29.740381 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 360/721] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:30:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 31 14:30:29.788632 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74811d33-0132-4909-93ba-4d0e844928fb None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:29.932022 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:29.968047 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74811d33-0132-4909-93ba-4d0e844928fb None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:30.013939 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d02821d-c2c3-41ac-8bfd-5df22fba1c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:30.015073 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d02821d-c2c3-41ac-8bfd-5df22fba1c67 None admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:30.015602 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d02821d-c2c3-41ac-8bfd-5df22fba1c67 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:30.016088 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d02821d-c2c3-41ac-8bfd-5df22fba1c67 None admin] PATH_INFO: `/v3/services` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:30.017063 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d02821d-c2c3-41ac-8bfd-5df22fba1c67 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:30.018766 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d02821d-c2c3-41ac-8bfd-5df22fba1c67 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:30.131655 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 362/722] 10.222.0.15 () {60 vars in 1141 bytes} [Tue May 31 14:30:29 2022] POST /identity/v3/services => generated 251 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:30:30.311825 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e66bf4-7b3b-48c7-a075-928bdf00c742 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:30.312474 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e66bf4-7b3b-48c7-a075-928bdf00c742 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:30.312957 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e66bf4-7b3b-48c7-a075-928bdf00c742 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:30.314522 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 361/723] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:30:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:30:30.320374 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78484c5-2c52-4258-b216-035daa4d5b91 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:30.320898 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78484c5-2c52-4258-b216-035daa4d5b91 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:30.321378 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78484c5-2c52-4258-b216-035daa4d5b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:30.352550 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-f78484c5-2c52-4258-b216-035daa4d5b91 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:30:30.354513 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-f78484c5-2c52-4258-b216-035daa4d5b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:30:30.526027 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 363/724] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:30:30 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 14:30:30.559545 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e66bf4-7b3b-48c7-a075-928bdf00c742 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:30.675446 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:30.684252 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e66bf4-7b3b-48c7-a075-928bdf00c742 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:30.724786 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0ed7b3-87b6-4ca0-a4a2-b45fcfb5596f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:30.725593 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ed7b3-87b6-4ca0-a4a2-b45fcfb5596f None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:30.725881 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ed7b3-87b6-4ca0-a4a2-b45fcfb5596f None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:30.726164 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ed7b3-87b6-4ca0-a4a2-b45fcfb5596f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:30.739279 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0ed7b3-87b6-4ca0-a4a2-b45fcfb5596f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 14:30:30.748309 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-6c0ed7b3-87b6-4ca0-a4a2-b45fcfb5596f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 31 14:30:30.748309 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:30.748309 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:30.748309 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:30.748309 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:30.748309 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:30.748309 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:30.748309 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:30.748309 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:30.748309 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:30.748309 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:30.748309 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:30.748309 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 14:30:30.748309 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 14:30:30.748309 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 14:30:30.748309 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 14:30:30.749262 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 14:30:30.749262 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 14:30:30.749262 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 14:30:30.749262 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 14:30:30.749262 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:30.749262 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:30.749262 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:30.749262 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:30.749262 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:30.749262 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:30.749262 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:30.749262 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:30:30.749262 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:30.749262 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:30.749262 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:30.749262 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:30.750511 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:30.750511 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:30.750511 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:30.750511 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:30.750511 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 14:30:30.750511 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 14:30:30.750511 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 14:30:30.750511 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 14:30:30.750511 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 14:30:30.750511 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 14:30:30.750511 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 31 14:30:30.750511 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:30:30.750511 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 362/725] 10.222.0.15 () {56 vars in 1096 bytes} [Tue May 31 14:30:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:30.758029 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78484c5-2c52-4258-b216-035daa4d5b91 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:30.833838 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:30.878575 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78484c5-2c52-4258-b216-035daa4d5b91 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:30.918034 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecaf38d-633b-4a85-aebb-63896b0bdef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:30.918751 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecaf38d-633b-4a85-aebb-63896b0bdef2 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:30.919042 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecaf38d-633b-4a85-aebb-63896b0bdef2 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:30.919319 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecaf38d-633b-4a85-aebb-63896b0bdef2 None admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:30.920072 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecaf38d-633b-4a85-aebb-63896b0bdef2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:30.920379 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecaf38d-633b-4a85-aebb-63896b0bdef2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:30.921770 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecaf38d-633b-4a85-aebb-63896b0bdef2 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:30.935883 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 364/726] 10.222.0.15 () {56 vars in 1099 bytes} [Tue May 31 14:30:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:30.942413 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0ed7b3-87b6-4ca0-a4a2-b45fcfb5596f None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:31.097422 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0ed7b3-87b6-4ca0-a4a2-b45fcfb5596f None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:31.151577 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b82f24-a08c-40fb-b94b-cd90e02b2f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:31.152379 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b82f24-a08c-40fb-b94b-cd90e02b2f19 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:31.152670 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b82f24-a08c-40fb-b94b-cd90e02b2f19 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:31.152949 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b82f24-a08c-40fb-b94b-cd90e02b2f19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:31.183624 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b82f24-a08c-40fb-b94b-cd90e02b2f19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:31.185131 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b82f24-a08c-40fb-b94b-cd90e02b2f19 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:31.227001 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-a5b82f24-a08c-40fb-b94b-cd90e02b2f19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:31.227001 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:31.227001 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:31.227001 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:31.227001 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:31.227001 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:31.227001 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:31.227001 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:31.227001 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:31.227001 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:31.227001 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:31.227001 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:31.227001 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 14:30:31.227001 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 14:30:31.227001 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 14:30:31.228234 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 14:30:31.228234 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:31.228234 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:31.228234 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:31.228234 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:31.228234 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:31.228234 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:31.228234 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:31.228234 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:30:31.228234 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:31.228234 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:31.228234 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:31.228234 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:31.228234 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:31.228234 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:31.228234 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:31.228234 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:31.230199 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 14:30:31.230199 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 14:30:31.230199 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:31.230199 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:30:31.230199 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 363/727] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:30:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:31.239654 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecaf38d-633b-4a85-aebb-63896b0bdef2 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:31.373239 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0de735-2619-4580-a4cb-c599aac70e41 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:31.373559 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0de735-2619-4580-a4cb-c599aac70e41 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:31.373861 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0de735-2619-4580-a4cb-c599aac70e41 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:31.375440 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 364/728] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:30:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:30:31.392445 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae8ca9-5979-49c3-b437-95579ef5b45f None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:31.393063 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae8ca9-5979-49c3-b437-95579ef5b45f None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:31.393545 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae8ca9-5979-49c3-b437-95579ef5b45f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:31.412915 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:31.418602 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecaf38d-633b-4a85-aebb-63896b0bdef2 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:31.450128 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:31.451521 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-a9ae8ca9-5979-49c3-b437-95579ef5b45f None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:30:31.452877 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-a9ae8ca9-5979-49c3-b437-95579ef5b45f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:30:31.468787 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c1dda9-5a06-45a7-821c-02349fa091eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:31.469463 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c1dda9-5a06-45a7-821c-02349fa091eb None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:31.469756 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c1dda9-5a06-45a7-821c-02349fa091eb None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:31.470032 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c1dda9-5a06-45a7-821c-02349fa091eb None admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:31.470794 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c1dda9-5a06-45a7-821c-02349fa091eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:31.471102 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c1dda9-5a06-45a7-821c-02349fa091eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:31.472467 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c1dda9-5a06-45a7-821c-02349fa091eb None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:31.496144 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 365/729] 10.222.0.15 () {56 vars in 1109 bytes} [Tue May 31 14:30:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:31.501594 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c1dda9-5a06-45a7-821c-02349fa091eb None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:31.615640 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c1dda9-5a06-45a7-821c-02349fa091eb None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:31.640558 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 365/730] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:30:31 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 14:30:31.664958 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ae8ca9-5979-49c3-b437-95579ef5b45f None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:31.731733 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6d1614-77f9-49b2-9d5f-b2f455022f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:31.732545 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6d1614-77f9-49b2-9d5f-b2f455022f46 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:31.732832 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6d1614-77f9-49b2-9d5f-b2f455022f46 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:31.733107 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6d1614-77f9-49b2-9d5f-b2f455022f46 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:31.751539 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6d1614-77f9-49b2-9d5f-b2f455022f46 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:31.754573 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6d1614-77f9-49b2-9d5f-b2f455022f46 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:31.778590 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-ef6d1614-77f9-49b2-9d5f-b2f455022f46 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 31 14:30:31.778590 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:31.778590 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:31.778590 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:31.778590 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:31.778590 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:31.778590 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:31.778590 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:31.778590 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:31.778590 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:31.778590 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:31.778590 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:31.778590 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 14:30:31.778590 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 14:30:31.778590 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 14:30:31.778590 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 14:30:31.779599 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:31.779599 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:31.779599 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 14:30:31.779599 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 14:30:31.779599 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 14:30:31.779599 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 14:30:31.779599 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:31.779599 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:31.779599 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:31.779599 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:31.779599 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:31.779599 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:30:31.779599 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:31.779599 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:31.779599 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:31.779599 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:31.779599 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:31.779599 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:31.780578 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:31.780578 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:31.780578 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 14:30:31.780578 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 14:30:31.780578 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 14:30:31.780578 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 14:30:31.780578 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 14:30:31.780578 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 14:30:31.780578 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 31 14:30:31.780578 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:30:31.785099 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 366/731] 10.222.0.15 () {56 vars in 1096 bytes} [Tue May 31 14:30:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:31.787917 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d23dd89-7357-4ecb-bb1c-c865dd79dd7d None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:31.787917 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d23dd89-7357-4ecb-bb1c-c865dd79dd7d None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:31.787917 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d23dd89-7357-4ecb-bb1c-c865dd79dd7d None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:31.793188 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 367/732] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:30:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:30:31.793188 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d23dd89-7357-4ecb-bb1c-c865dd79dd7d None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:31.820795 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ae8ca9-5979-49c3-b437-95579ef5b45f None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:31.851960 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:31.858092 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb547fd9-fc41-47c9-8368-fc2a3ee0bdef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:31.859374 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb547fd9-fc41-47c9-8368-fc2a3ee0bdef None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:31.859871 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb547fd9-fc41-47c9-8368-fc2a3ee0bdef None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:31.860353 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb547fd9-fc41-47c9-8368-fc2a3ee0bdef None admin] PATH_INFO: `/v3/roles/service` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:31.871451 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:31.875585 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb547fd9-fc41-47c9-8368-fc2a3ee0bdef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 14:30:31.884461 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-eb547fd9-fc41-47c9-8368-fc2a3ee0bdef None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 31 14:30:31.884461 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:31.884461 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:31.884461 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:31.884461 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:31.884461 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:31.884461 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:31.884461 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:31.884461 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:31.884461 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:31.884461 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:31.884461 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:31.884461 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 14:30:31.884461 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 14:30:31.884461 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 14:30:31.884461 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 14:30:31.885418 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 14:30:31.885418 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 14:30:31.885418 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 14:30:31.885418 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 14:30:31.885418 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:31.885418 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:31.885418 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:31.885418 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:31.885418 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:31.885418 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:31.885418 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:31.885418 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:30:31.885418 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:31.885418 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:31.885418 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:31.885418 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:31.886258 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:31.886258 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:31.886258 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:31.886258 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:31.886258 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 14:30:31.886258 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 14:30:31.886258 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 14:30:31.886258 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 14:30:31.886258 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 14:30:31.886258 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 14:30:31.886258 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 31 14:30:31.886258 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:30:31.889144 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 366/733] 10.222.0.15 () {56 vars in 1102 bytes} [Tue May 31 14:30:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:31.890665 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd47732b-78e8-463d-b50b-a02805dc605e None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:31.891179 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd47732b-78e8-463d-b50b-a02805dc605e None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:31.891662 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd47732b-78e8-463d-b50b-a02805dc605e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:31.910857 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-dd47732b-78e8-463d-b50b-a02805dc605e None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:30:31.913118 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-dd47732b-78e8-463d-b50b-a02805dc605e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:30:31.931392 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d23dd89-7357-4ecb-bb1c-c865dd79dd7d None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:31.968855 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686f7e9f-17ee-4300-b4fa-1015a88fbe11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:31.969546 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686f7e9f-17ee-4300-b4fa-1015a88fbe11 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:31.969823 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686f7e9f-17ee-4300-b4fa-1015a88fbe11 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:31.970105 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686f7e9f-17ee-4300-b4fa-1015a88fbe11 None admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:31.971923 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686f7e9f-17ee-4300-b4fa-1015a88fbe11 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:31.972465 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686f7e9f-17ee-4300-b4fa-1015a88fbe11 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:31.973775 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686f7e9f-17ee-4300-b4fa-1015a88fbe11 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:32.001118 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 368/735] 10.222.0.15 () {56 vars in 1135 bytes} [Tue May 31 14:30:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:32.001479 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 367/735] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:30:31 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 14:30:32.003304 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686f7e9f-17ee-4300-b4fa-1015a88fbe11 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:32.013019 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd47732b-78e8-463d-b50b-a02805dc605e None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:32.108866 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686f7e9f-17ee-4300-b4fa-1015a88fbe11 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:32.110386 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:32.131398 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd47732b-78e8-463d-b50b-a02805dc605e None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:32.144959 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c96c4fb-e0a3-4302-b199-e6680acd5d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:32.145567 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c96c4fb-e0a3-4302-b199-e6680acd5d98 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:32.145853 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c96c4fb-e0a3-4302-b199-e6680acd5d98 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:32.146131 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c96c4fb-e0a3-4302-b199-e6680acd5d98 None admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:32.146996 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c96c4fb-e0a3-4302-b199-e6680acd5d98 None admin] RBAC: Adding query filter params (name=service) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:32.147307 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c96c4fb-e0a3-4302-b199-e6680acd5d98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:32.148686 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c96c4fb-e0a3-4302-b199-e6680acd5d98 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:32.157048 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 369/736] 10.222.0.15 () {56 vars in 1103 bytes} [Tue May 31 14:30:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:32.157749 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:32.157955 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c96c4fb-e0a3-4302-b199-e6680acd5d98 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:32.176166 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a42edd-7761-4717-a15f-8b01479f1f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:32.177207 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a42edd-7761-4717-a15f-8b01479f1f53 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:32.178363 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a42edd-7761-4717-a15f-8b01479f1f53 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:32.178897 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a42edd-7761-4717-a15f-8b01479f1f53 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:32.260880 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c96c4fb-e0a3-4302-b199-e6680acd5d98 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:32.261487 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a42edd-7761-4717-a15f-8b01479f1f53 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:32.263443 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a42edd-7761-4717-a15f-8b01479f1f53 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:32.297277 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065b2023-ac9f-4ce8-bb45-3ea592e48735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:32.297277 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065b2023-ac9f-4ce8-bb45-3ea592e48735 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:32.299502 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065b2023-ac9f-4ce8-bb45-3ea592e48735 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:32.299600 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065b2023-ac9f-4ce8-bb45-3ea592e48735 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:32.310067 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065b2023-ac9f-4ce8-bb45-3ea592e48735 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 14:30:32.317828 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-065b2023-ac9f-4ce8-bb45-3ea592e48735 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 31 14:30:32.317828 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:32.317828 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:32.317828 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:32.317828 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:32.317828 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:32.317828 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:32.317828 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:32.317828 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:32.317828 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:32.317828 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:32.317828 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:32.317828 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 14:30:32.317828 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 14:30:32.317828 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 14:30:32.317828 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 14:30:32.319608 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 14:30:32.319608 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 14:30:32.319608 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 14:30:32.319608 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 14:30:32.319608 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:32.319608 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:32.319608 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:32.319608 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:32.319608 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:32.319608 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:32.319608 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:32.319608 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:30:32.319608 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:32.319608 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:32.319608 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:32.319608 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:32.320459 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:32.320459 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:32.320459 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:32.320459 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:32.320459 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 14:30:32.320459 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 14:30:32.320459 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 14:30:32.320459 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 14:30:32.320459 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 14:30:32.320459 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 14:30:32.320459 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 31 14:30:32.320459 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:30:32.324652 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 370/737] 10.222.0.15 () {56 vars in 1096 bytes} [Tue May 31 14:30:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:32.325109 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065b2023-ac9f-4ce8-bb45-3ea592e48735 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:32.355830 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:32.383925 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 368/738] 10.222.0.15 () {58 vars in 1282 bytes} [Tue May 31 14:30:32 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 31 14:30:32.384809 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a42edd-7761-4717-a15f-8b01479f1f53 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:32.424367 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:32.470315 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065b2023-ac9f-4ce8-bb45-3ea592e48735 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:32.506985 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a42edd-7761-4717-a15f-8b01479f1f53 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:32.507179 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ba4544-92e5-46e5-a5cb-a30d411f34e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:32.507789 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba4544-92e5-46e5-a5cb-a30d411f34e5 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:32.508077 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba4544-92e5-46e5-a5cb-a30d411f34e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:32.508400 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba4544-92e5-46e5-a5cb-a30d411f34e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:32.519404 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ba4544-92e5-46e5-a5cb-a30d411f34e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:32.520875 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ba4544-92e5-46e5-a5cb-a30d411f34e5 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:32.540186 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-59ba4544-92e5-46e5-a5cb-a30d411f34e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:32.540186 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:32.540186 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:32.540186 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:32.540186 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:32.540186 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:32.540186 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:32.540186 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:32.540186 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:32.540186 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:32.540186 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:32.540186 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:32.540186 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 14:30:32.540186 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 14:30:32.540186 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 14:30:32.541109 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 14:30:32.541109 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:32.541109 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:32.541109 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:32.541109 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:32.541109 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:32.541109 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:32.541109 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:32.541109 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:30:32.541109 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:32.541109 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:32.541109 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:32.541109 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:32.541109 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:32.541109 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:32.541109 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:32.541109 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:32.542033 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 14:30:32.542033 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 14:30:32.542033 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:32.542033 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:30:32.542033 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 371/739] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:30:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:32.544214 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876e0bec-26a0-4edb-bd48-a02a388719a0 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:32.544214 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876e0bec-26a0-4edb-bd48-a02a388719a0 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:32.544214 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876e0bec-26a0-4edb-bd48-a02a388719a0 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:32.550184 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 372/740] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:30:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:30:32.550184 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876e0bec-26a0-4edb-bd48-a02a388719a0 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:32.554821 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f061552a-70db-41c2-bcab-8a4f2384716b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:32.555320 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f061552a-70db-41c2-bcab-8a4f2384716b None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:32.555603 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f061552a-70db-41c2-bcab-8a4f2384716b None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:32.555880 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f061552a-70db-41c2-bcab-8a4f2384716b None admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:32.556635 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f061552a-70db-41c2-bcab-8a4f2384716b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:32.556941 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f061552a-70db-41c2-bcab-8a4f2384716b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:32.558310 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f061552a-70db-41c2-bcab-8a4f2384716b None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:32.567920 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 369/741] 10.222.0.15 () {56 vars in 1099 bytes} [Tue May 31 14:30:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:32.573252 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f061552a-70db-41c2-bcab-8a4f2384716b None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:32.632566 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:32.660981 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876e0bec-26a0-4edb-bd48-a02a388719a0 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:32.670098 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:32.688362 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f061552a-70db-41c2-bcab-8a4f2384716b None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:32.701700 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374ed557-8ff0-45ce-bbbe-d929483a2b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:32.702620 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374ed557-8ff0-45ce-bbbe-d929483a2b8d None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:32.702809 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374ed557-8ff0-45ce-bbbe-d929483a2b8d None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:32.703087 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374ed557-8ff0-45ce-bbbe-d929483a2b8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:32.714568 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374ed557-8ff0-45ce-bbbe-d929483a2b8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:32.716041 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374ed557-8ff0-45ce-bbbe-d929483a2b8d None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:32.728172 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37267997-57b0-477b-9950-eb0e963205fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:32.729120 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37267997-57b0-477b-9950-eb0e963205fe None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:32.729585 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37267997-57b0-477b-9950-eb0e963205fe None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:32.730071 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37267997-57b0-477b-9950-eb0e963205fe None admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:32.731008 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37267997-57b0-477b-9950-eb0e963205fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:32.731519 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37267997-57b0-477b-9950-eb0e963205fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:32.733103 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37267997-57b0-477b-9950-eb0e963205fe None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:32.735508 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-374ed557-8ff0-45ce-bbbe-d929483a2b8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:32.735508 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:32.735508 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:32.735508 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:32.735508 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:32.735508 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:32.735508 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:32.735508 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:32.735508 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:32.735508 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:32.735508 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:32.735508 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:32.735508 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 14:30:32.735508 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 14:30:32.735508 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 14:30:32.736440 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 14:30:32.736440 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:32.736440 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:32.736440 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:32.736440 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:32.736440 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:32.736440 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:32.736440 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:32.736440 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:30:32.736440 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:32.736440 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:32.736440 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:32.736440 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:32.736440 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:32.736440 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:32.736440 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:32.736440 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:32.737364 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 14:30:32.737364 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 14:30:32.737364 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:32.737364 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:30:32.737364 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 373/742] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:30:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:32.738065 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81508a1e-68cd-4043-9a25-a3cb62d1324c None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:32.738353 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81508a1e-68cd-4043-9a25-a3cb62d1324c None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:32.738656 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81508a1e-68cd-4043-9a25-a3cb62d1324c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:32.749474 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 370/743] 10.222.0.15 () {56 vars in 1109 bytes} [Tue May 31 14:30:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:32.751043 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37267997-57b0-477b-9950-eb0e963205fe None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:32.762027 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-81508a1e-68cd-4043-9a25-a3cb62d1324c None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:30:32.763420 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-81508a1e-68cd-4043-9a25-a3cb62d1324c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:30:32.858022 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 374/744] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:30:32 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 31 14:30:32.859250 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81508a1e-68cd-4043-9a25-a3cb62d1324c None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:32.888158 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37267997-57b0-477b-9950-eb0e963205fe None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:32.924095 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f03785f-bca6-4fd7-9b93-0a748c55c384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:32.924896 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f03785f-bca6-4fd7-9b93-0a748c55c384 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:32.925180 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f03785f-bca6-4fd7-9b93-0a748c55c384 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:32.925454 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f03785f-bca6-4fd7-9b93-0a748c55c384 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:32.926044 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:32.937224 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f03785f-bca6-4fd7-9b93-0a748c55c384 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:32.938848 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f03785f-bca6-4fd7-9b93-0a748c55c384 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:32.941734 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:32.957588 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-1f03785f-bca6-4fd7-9b93-0a748c55c384 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:32.957588 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:32.957588 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:32.957588 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:32.957588 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:32.957588 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:32.957588 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:32.957588 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:32.957588 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:32.957588 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:32.957588 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:32.957588 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:32.957588 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 14:30:32.957588 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 14:30:32.957588 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 14:30:32.958783 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 14:30:32.958783 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:32.958783 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:32.958783 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:32.958783 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:32.958783 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:32.958783 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:32.958783 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:32.958783 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:30:32.958783 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:32.958783 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:32.958783 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:32.958783 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:32.958783 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:32.958783 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:32.958783 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:32.958783 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:32.960245 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 14:30:32.960245 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 14:30:32.960245 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:32.960245 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:30:32.960245 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 371/745] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:30:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:32.960245 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f03785f-bca6-4fd7-9b93-0a748c55c384 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:32.974869 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81508a1e-68cd-4043-9a25-a3cb62d1324c None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:33.013694 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95045513-c96a-4ce7-977a-3c46f8d426b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:33.014367 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95045513-c96a-4ce7-977a-3c46f8d426b5 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:33.014686 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95045513-c96a-4ce7-977a-3c46f8d426b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:33.014968 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95045513-c96a-4ce7-977a-3c46f8d426b5 None admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:33.015690 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95045513-c96a-4ce7-977a-3c46f8d426b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:33.015998 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95045513-c96a-4ce7-977a-3c46f8d426b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:33.017387 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95045513-c96a-4ce7-977a-3c46f8d426b5 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:33.028850 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 375/746] 10.222.0.15 () {56 vars in 1109 bytes} [Tue May 31 14:30:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:33.029469 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95045513-c96a-4ce7-977a-3c46f8d426b5 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:33.076124 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f03785f-bca6-4fd7-9b93-0a748c55c384 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:33.112815 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d56d022-bc41-43c9-b303-0bdf52e16313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:33.113620 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d56d022-bc41-43c9-b303-0bdf52e16313 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:33.113902 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d56d022-bc41-43c9-b303-0bdf52e16313 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:33.114177 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d56d022-bc41-43c9-b303-0bdf52e16313 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:33.122158 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d56d022-bc41-43c9-b303-0bdf52e16313 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:33.123627 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d56d022-bc41-43c9-b303-0bdf52e16313 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:33.133449 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95045513-c96a-4ce7-977a-3c46f8d426b5 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:33.138308 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-9d56d022-bc41-43c9-b303-0bdf52e16313 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 31 14:30:33.138308 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:33.138308 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:33.138308 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:33.138308 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:33.138308 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:33.138308 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:33.138308 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:33.138308 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:33.138308 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:33.138308 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:33.138308 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:33.138308 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 14:30:33.138308 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 14:30:33.138308 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 14:30:33.138308 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 14:30:33.139306 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:33.139306 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:33.139306 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 14:30:33.139306 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 14:30:33.139306 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 14:30:33.139306 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 14:30:33.139306 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:33.139306 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:33.139306 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:33.139306 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:33.139306 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:33.139306 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:30:33.139306 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:33.139306 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:33.139306 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:33.139306 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:33.139306 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:33.139306 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:33.140246 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:33.140246 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:33.140246 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 14:30:33.140246 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 14:30:33.140246 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 14:30:33.140246 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 14:30:33.140246 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 14:30:33.140246 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 14:30:33.140246 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 31 14:30:33.140246 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:30:33.140246 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 372/747] 10.222.0.15 () {56 vars in 1117 bytes} [Tue May 31 14:30:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:33.140246 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d56d022-bc41-43c9-b303-0bdf52e16313 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:33.152062 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:33.169269 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05618e6f-0f82-40fa-9c5e-cdab2e460afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:33.169939 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05618e6f-0f82-40fa-9c5e-cdab2e460afa None admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:33.170233 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05618e6f-0f82-40fa-9c5e-cdab2e460afa None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:33.170522 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05618e6f-0f82-40fa-9c5e-cdab2e460afa None admin] PATH_INFO: `/v3/services` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:33.171272 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05618e6f-0f82-40fa-9c5e-cdab2e460afa None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:33.172673 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05618e6f-0f82-40fa-9c5e-cdab2e460afa None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:33.196234 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:33.238359 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d56d022-bc41-43c9-b303-0bdf52e16313 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:33.243433 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 376/748] 10.222.0.15 () {60 vars in 1141 bytes} [Tue May 31 14:30:33 2022] POST /identity/v3/services => generated 240 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:30:33.244248 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05618e6f-0f82-40fa-9c5e-cdab2e460afa None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:33.290475 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d745beb4-ec9a-4749-a880-509d8034fe44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:33.294444 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745beb4-ec9a-4749-a880-509d8034fe44 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:33.294444 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745beb4-ec9a-4749-a880-509d8034fe44 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:33.294444 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745beb4-ec9a-4749-a880-509d8034fe44 None admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:33.294444 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d745beb4-ec9a-4749-a880-509d8034fe44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:33.294444 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d745beb4-ec9a-4749-a880-509d8034fe44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:33.296405 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d745beb4-ec9a-4749-a880-509d8034fe44 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:33.311177 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 373/749] 10.222.0.15 () {56 vars in 1109 bytes} [Tue May 31 14:30:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:33.312800 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da279c4a-1133-4b29-8751-b9700a69eff6 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:33.313093 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da279c4a-1133-4b29-8751-b9700a69eff6 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:33.313372 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da279c4a-1133-4b29-8751-b9700a69eff6 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:33.319589 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 374/750] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:30:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:30:33.319589 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da279c4a-1133-4b29-8751-b9700a69eff6 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:33.376953 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05618e6f-0f82-40fa-9c5e-cdab2e460afa None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:33.416676 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08c9022-3905-4bd0-8026-fb0021550f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:33.417532 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c9022-3905-4bd0-8026-fb0021550f0c None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:33.417956 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c9022-3905-4bd0-8026-fb0021550f0c None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:33.418581 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c9022-3905-4bd0-8026-fb0021550f0c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:33.428691 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08c9022-3905-4bd0-8026-fb0021550f0c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:33.430171 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08c9022-3905-4bd0-8026-fb0021550f0c None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:33.441554 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da279c4a-1133-4b29-8751-b9700a69eff6 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:33.446373 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-a08c9022-3905-4bd0-8026-fb0021550f0c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 14:30:33.446373 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:33.446373 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:33.446373 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:33.446373 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:33.446373 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:33.446373 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:33.446373 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:33.446373 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:33.446373 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:33.446373 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:33.446373 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:33.446373 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 14:30:33.446373 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 14:30:33.446373 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 14:30:33.447743 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 14:30:33.447743 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:33.447743 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:33.447743 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:33.447743 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:33.447743 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:33.447743 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:33.447743 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:33.447743 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:30:33.447743 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:33.447743 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:33.447743 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:33.447743 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:33.447743 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:33.447743 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:33.447743 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:33.447743 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:33.455481 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 14:30:33.455481 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 14:30:33.455481 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 14:30:33.455481 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 14:30:33.455481 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 14:30:33.455481 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 14:30:33.455481 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 14:30:33.455481 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:30:33.455481 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 377/751] 10.222.0.15 () {56 vars in 1111 bytes} [Tue May 31 14:30:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:33.455481 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08c9022-3905-4bd0-8026-fb0021550f0c None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:33.463955 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:33.491676 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b140e88b-9dc0-47f2-b05f-f2d4fce1e5f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:33.492373 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b140e88b-9dc0-47f2-b05f-f2d4fce1e5f1 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:33.492659 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b140e88b-9dc0-47f2-b05f-f2d4fce1e5f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:33.492935 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b140e88b-9dc0-47f2-b05f-f2d4fce1e5f1 None admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:33.493763 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b140e88b-9dc0-47f2-b05f-f2d4fce1e5f1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:33.494069 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b140e88b-9dc0-47f2-b05f-f2d4fce1e5f1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:33.495544 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b140e88b-9dc0-47f2-b05f-f2d4fce1e5f1 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:33.500759 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:33.519316 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 375/752] 10.222.0.15 () {56 vars in 1149 bytes} [Tue May 31 14:30:33 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:33.519316 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc856106-a34e-4fed-9f96-46e40b0e6deb None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:33.519316 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc856106-a34e-4fed-9f96-46e40b0e6deb None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:33.519316 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc856106-a34e-4fed-9f96-46e40b0e6deb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:33.534678 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-fc856106-a34e-4fed-9f96-46e40b0e6deb None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:30:33.535988 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-fc856106-a34e-4fed-9f96-46e40b0e6deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:30:33.572731 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08c9022-3905-4bd0-8026-fb0021550f0c None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:33.618585 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 376/753] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:30:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 14:30:33.618585 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc856106-a34e-4fed-9f96-46e40b0e6deb None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:33.620702 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b52815-f5f6-40e2-add4-f852740b69a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:33.621582 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b52815-f5f6-40e2-add4-f852740b69a1 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:33.621934 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b52815-f5f6-40e2-add4-f852740b69a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:33.622300 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b52815-f5f6-40e2-add4-f852740b69a1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:33.630087 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b52815-f5f6-40e2-add4-f852740b69a1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:33.632495 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b52815-f5f6-40e2-add4-f852740b69a1 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:33.652043 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-91b52815-f5f6-40e2-add4-f852740b69a1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 31 14:30:33.652043 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:33.652043 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:33.652043 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:33.652043 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:33.652043 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:33.652043 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:33.652043 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:33.652043 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:33.652043 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:33.652043 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:33.652043 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:33.652043 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 14:30:33.652043 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 14:30:33.652043 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 14:30:33.652043 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 14:30:33.653258 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:33.653258 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:33.653258 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 14:30:33.653258 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 14:30:33.653258 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 14:30:33.653258 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 14:30:33.653258 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:33.653258 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:33.653258 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:33.653258 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:33.653258 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:33.653258 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:30:33.653258 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:33.653258 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:33.653258 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:33.653258 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:33.653258 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:33.653258 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:33.654446 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:33.654446 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:33.654446 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 14:30:33.654446 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 14:30:33.654446 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 14:30:33.654446 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 14:30:33.654446 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 14:30:33.654446 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 14:30:33.654446 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 31 14:30:33.654446 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:30:33.657847 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 378/754] 10.222.0.15 () {56 vars in 1093 bytes} [Tue May 31 14:30:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:33.658682 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b52815-f5f6-40e2-add4-f852740b69a1 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:33.724852 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:33.729213 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc856106-a34e-4fed-9f96-46e40b0e6deb None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:33.763032 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:33.766775 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b52815-f5f6-40e2-add4-f852740b69a1 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:33.768145 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec96f29-f3b2-4f2a-b1d1-4d3ae83a9c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:33.768869 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec96f29-f3b2-4f2a-b1d1-4d3ae83a9c37 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:33.769209 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec96f29-f3b2-4f2a-b1d1-4d3ae83a9c37 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:33.769434 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec96f29-f3b2-4f2a-b1d1-4d3ae83a9c37 None admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:33.770220 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec96f29-f3b2-4f2a-b1d1-4d3ae83a9c37 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:33.770530 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec96f29-f3b2-4f2a-b1d1-4d3ae83a9c37 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:33.772035 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec96f29-f3b2-4f2a-b1d1-4d3ae83a9c37 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:33.784570 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 377/755] 10.222.0.15 () {56 vars in 1148 bytes} [Tue May 31 14:30:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:33.790159 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec96f29-f3b2-4f2a-b1d1-4d3ae83a9c37 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:33.804229 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84ac6a6-6c53-4f04-a77e-0dbd2eb44599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:33.804959 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ac6a6-6c53-4f04-a77e-0dbd2eb44599 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:33.805311 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ac6a6-6c53-4f04-a77e-0dbd2eb44599 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:33.805658 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ac6a6-6c53-4f04-a77e-0dbd2eb44599 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:33.883516 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84ac6a6-6c53-4f04-a77e-0dbd2eb44599 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:33.884994 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84ac6a6-6c53-4f04-a77e-0dbd2eb44599 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:33.899325 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec96f29-f3b2-4f2a-b1d1-4d3ae83a9c37 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:33.936448 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df907da-d972-4933-894e-c6ef375d9dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:33.937258 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df907da-d972-4933-894e-c6ef375d9dfa None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:33.937538 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df907da-d972-4933-894e-c6ef375d9dfa None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:33.938244 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df907da-d972-4933-894e-c6ef375d9dfa None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:33.938931 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df907da-d972-4933-894e-c6ef375d9dfa None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:33.940329 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df907da-d972-4933-894e-c6ef375d9dfa None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:33.955482 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-1df907da-d972-4933-894e-c6ef375d9dfa None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 31 14:30:33.955482 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:33.955482 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 31 14:30:33.955482 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 31 14:30:33.955482 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 31 14:30:33.955482 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 31 14:30:33.955482 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 31 14:30:33.955482 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 14:30:33.955482 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 31 14:30:33.955482 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:30:33.955482 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 31 14:30:33.955482 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:30:33.955482 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:33.955482 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:33.955482 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:33.955482 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:33.956518 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:33.956518 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:33.956518 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:33.956518 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:33.956518 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:33.956518 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:33.956518 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:33.956518 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 31 14:30:33.956518 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_service(service_id) May 31 14:30:33.956518 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 31 14:30:33.956518 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 31 14:30:33.956518 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:33.956518 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:33.956518 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:33.956518 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:33.956518 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:33.957360 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:33.957360 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:33.957360 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:30:33.957360 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:33.957360 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:33.957360 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:33.957360 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:33.957360 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:33.957360 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:33.957360 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:33.957360 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:33.957360 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 31 14:30:33.957360 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 14:30:33.957360 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 31 14:30:33.957360 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:30:33.957360 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 378/756] 10.222.0.15 () {56 vars in 1129 bytes} [Tue May 31 14:30:33 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:33.958211 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df907da-d972-4933-894e-c6ef375d9dfa None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:33.986320 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:33.992392 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:34.001690 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 379/757] 10.222.0.15 () {58 vars in 1282 bytes} [Tue May 31 14:30:33 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 31 14:30:34.001690 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84ac6a6-6c53-4f04-a77e-0dbd2eb44599 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:34.078438 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df907da-d972-4933-894e-c6ef375d9dfa None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:34.105568 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84ac6a6-6c53-4f04-a77e-0dbd2eb44599 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:34.114050 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafa95f0-55d0-4d20-abf6-909fef9a19a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:34.114752 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa95f0-55d0-4d20-abf6-909fef9a19a9 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:34.115564 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa95f0-55d0-4d20-abf6-909fef9a19a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:34.115843 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa95f0-55d0-4d20-abf6-909fef9a19a9 None admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:34.116910 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafa95f0-55d0-4d20-abf6-909fef9a19a9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:34.117030 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafa95f0-55d0-4d20-abf6-909fef9a19a9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:34.118390 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafa95f0-55d0-4d20-abf6-909fef9a19a9 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:34.136158 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 379/758] 10.222.0.15 () {56 vars in 1133 bytes} [Tue May 31 14:30:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:34.139696 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafa95f0-55d0-4d20-abf6-909fef9a19a9 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:34.141464 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2be328-13ef-4aa5-b203-ea84e1c474a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:34.142114 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2be328-13ef-4aa5-b203-ea84e1c474a5 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:34.142396 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2be328-13ef-4aa5-b203-ea84e1c474a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:34.142700 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2be328-13ef-4aa5-b203-ea84e1c474a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:34.143529 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2be328-13ef-4aa5-b203-ea84e1c474a5 None admin] RBAC: Adding query filter params (role.id=76c53e2c353644f885028a0226c06146, scope.project.id=ffff4334538649fdba1beb80cad207fa, user.id=e158f461c66e4d779f23fb7760672897) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:34.143839 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2be328-13ef-4aa5-b203-ea84e1c474a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:34.145282 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2be328-13ef-4aa5-b203-ea84e1c474a5 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:34.150995 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 380/759] 10.222.0.15 () {56 vars in 1374 bytes} [Tue May 31 14:30:33 2022] GET /identity/v3/role_assignments?user.id=e158f461c66e4d779f23fb7760672897&scope.project.id=ffff4334538649fdba1beb80cad207fa&role.id=76c53e2c353644f885028a0226c06146 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:34.151837 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2be328-13ef-4aa5-b203-ea84e1c474a5 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:34.248734 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:34.252773 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:34.272861 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafa95f0-55d0-4d20-abf6-909fef9a19a9 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:34.301110 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2be328-13ef-4aa5-b203-ea84e1c474a5 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:34.317357 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b89c709-bd95-433b-bbaa-0951cd263a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:34.318582 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b89c709-bd95-433b-bbaa-0951cd263a1d None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:34.318971 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b89c709-bd95-433b-bbaa-0951cd263a1d None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:34.319355 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b89c709-bd95-433b-bbaa-0951cd263a1d None admin] PATH_INFO: `/v3/services` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:34.320182 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b89c709-bd95-433b-bbaa-0951cd263a1d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:34.320603 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b89c709-bd95-433b-bbaa-0951cd263a1d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:34.322960 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b89c709-bd95-433b-bbaa-0951cd263a1d None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:34.334811 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 380/760] 10.222.0.15 () {56 vars in 1124 bytes} [Tue May 31 14:30:34 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:34.335939 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b89c709-bd95-433b-bbaa-0951cd263a1d None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:34.351252 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c92ff7-9984-49f2-98a4-6e90a7993f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:34.352492 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c92ff7-9984-49f2-98a4-6e90a7993f0b None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:34.352926 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c92ff7-9984-49f2-98a4-6e90a7993f0b None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:34.353401 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c92ff7-9984-49f2-98a4-6e90a7993f0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:34.367456 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c92ff7-9984-49f2-98a4-6e90a7993f0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:34.369279 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c92ff7-9984-49f2-98a4-6e90a7993f0b None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:34.398403 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-f0c92ff7-9984-49f2-98a4-6e90a7993f0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:34.398403 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:34.398403 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:34.398403 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:34.398403 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:34.398403 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:34.398403 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:34.398403 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:34.398403 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:34.398403 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:34.398403 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:34.398403 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:34.398403 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 14:30:34.398403 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 14:30:34.398403 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 14:30:34.399585 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 14:30:34.399585 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:34.399585 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:34.399585 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:34.399585 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:34.399585 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:34.399585 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:34.399585 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:34.399585 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:30:34.399585 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:34.399585 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:34.399585 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:34.399585 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:34.399585 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:34.399585 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:34.399585 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:34.399585 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:34.400713 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 14:30:34.400713 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 14:30:34.400713 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:34.400713 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:30:34.403054 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 381/761] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:30:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:34.404213 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c92ff7-9984-49f2-98a4-6e90a7993f0b None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:34.465465 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b89c709-bd95-433b-bbaa-0951cd263a1d None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:34.513042 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1332427e-4973-4da3-b794-04e7fa5a803a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:34.514378 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1332427e-4973-4da3-b794-04e7fa5a803a None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:34.514813 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1332427e-4973-4da3-b794-04e7fa5a803a None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:34.515193 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1332427e-4973-4da3-b794-04e7fa5a803a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:34.530921 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1332427e-4973-4da3-b794-04e7fa5a803a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:34.533082 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1332427e-4973-4da3-b794-04e7fa5a803a None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:34.540888 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c92ff7-9984-49f2-98a4-6e90a7993f0b None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:34.542657 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:34.557108 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:34.564212 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-1332427e-4973-4da3-b794-04e7fa5a803a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:34.564212 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:34.564212 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:34.564212 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:34.564212 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:34.564212 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:34.564212 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:34.564212 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:34.564212 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:34.564212 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:34.564212 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:34.564212 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:34.564212 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 14:30:34.564212 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 14:30:34.564212 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 14:30:34.565233 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 14:30:34.565233 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:34.565233 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:34.565233 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:34.565233 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:34.565233 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:34.565233 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:34.565233 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:34.565233 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:30:34.565233 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:34.565233 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:34.565233 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:34.565233 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:34.565233 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:34.565233 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:34.565233 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:34.565233 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:34.566373 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 14:30:34.566373 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 14:30:34.566373 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:34.566373 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:30:34.566373 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 381/762] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:30:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:34.566373 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1332427e-4973-4da3-b794-04e7fa5a803a None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:34.581625 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994de9e5-0c70-4be3-bbc9-3f447a0e2753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:34.582542 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994de9e5-0c70-4be3-bbc9-3f447a0e2753 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:34.582988 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994de9e5-0c70-4be3-bbc9-3f447a0e2753 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:34.583418 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994de9e5-0c70-4be3-bbc9-3f447a0e2753 None admin] PATH_INFO: `/v3/services` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:34.584781 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994de9e5-0c70-4be3-bbc9-3f447a0e2753 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:34.585254 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994de9e5-0c70-4be3-bbc9-3f447a0e2753 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:34.586835 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994de9e5-0c70-4be3-bbc9-3f447a0e2753 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:34.598300 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 382/763] 10.222.0.15 () {56 vars in 1124 bytes} [Tue May 31 14:30:34 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:34.599913 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994de9e5-0c70-4be3-bbc9-3f447a0e2753 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:34.682007 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1332427e-4973-4da3-b794-04e7fa5a803a None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:34.709083 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994de9e5-0c70-4be3-bbc9-3f447a0e2753 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:34.717571 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9453f971-90b0-436b-a80d-41c528fe135b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:34.718375 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9453f971-90b0-436b-a80d-41c528fe135b None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:34.718788 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9453f971-90b0-436b-a80d-41c528fe135b None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:34.719165 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9453f971-90b0-436b-a80d-41c528fe135b None admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:34.720082 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9453f971-90b0-436b-a80d-41c528fe135b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:34.720379 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9453f971-90b0-436b-a80d-41c528fe135b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:34.722797 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9453f971-90b0-436b-a80d-41c528fe135b None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:34.741397 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 382/764] 10.222.0.15 () {56 vars in 1109 bytes} [Tue May 31 14:30:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:34.742495 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9453f971-90b0-436b-a80d-41c528fe135b None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:34.751047 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d75b65c-1323-4eb4-8382-fc2ce2ccdc58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:34.751958 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d75b65c-1323-4eb4-8382-fc2ce2ccdc58 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:34.752393 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d75b65c-1323-4eb4-8382-fc2ce2ccdc58 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:34.752921 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d75b65c-1323-4eb4-8382-fc2ce2ccdc58 None admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:34.753786 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d75b65c-1323-4eb4-8382-fc2ce2ccdc58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:34.754252 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d75b65c-1323-4eb4-8382-fc2ce2ccdc58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:34.755892 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d75b65c-1323-4eb4-8382-fc2ce2ccdc58 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:34.769011 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 383/765] 10.222.0.15 () {56 vars in 1109 bytes} [Tue May 31 14:30:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:34.770009 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d75b65c-1323-4eb4-8382-fc2ce2ccdc58 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:34.805267 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:34.813344 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:34.848856 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9453f971-90b0-436b-a80d-41c528fe135b None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:34.878977 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d75b65c-1323-4eb4-8382-fc2ce2ccdc58 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:34.886974 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7370b28b-d8c8-44e0-9bd1-948d8621814d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:34.887836 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7370b28b-d8c8-44e0-9bd1-948d8621814d None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:34.888293 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7370b28b-d8c8-44e0-9bd1-948d8621814d None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:34.888633 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7370b28b-d8c8-44e0-9bd1-948d8621814d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:34.889633 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7370b28b-d8c8-44e0-9bd1-948d8621814d None admin] RBAC: Adding query filter params (interface=public, service_id=1f2235cd216e4eaba22f1eef6145bcaf, region_id=RegionOne) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:34.889927 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7370b28b-d8c8-44e0-9bd1-948d8621814d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:34.891478 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7370b28b-d8c8-44e0-9bd1-948d8621814d None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:34.905079 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 383/766] 10.222.0.15 () {56 vars in 1251 bytes} [Tue May 31 14:30:34 2022] GET /identity/v3/endpoints?service_id=1f2235cd216e4eaba22f1eef6145bcaf&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:34.905079 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7370b28b-d8c8-44e0-9bd1-948d8621814d None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:34.923069 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1884cec-9342-4ab7-b405-47eeed8df035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:34.924218 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1884cec-9342-4ab7-b405-47eeed8df035 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:34.924642 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1884cec-9342-4ab7-b405-47eeed8df035 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:34.925065 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1884cec-9342-4ab7-b405-47eeed8df035 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:34.932422 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1884cec-9342-4ab7-b405-47eeed8df035 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:34.934068 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1884cec-9342-4ab7-b405-47eeed8df035 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:34.948892 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-c1884cec-9342-4ab7-b405-47eeed8df035 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 14:30:34.948892 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:34.948892 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:34.948892 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:34.948892 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:34.948892 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:34.948892 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:34.948892 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:34.948892 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:34.948892 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:34.948892 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:34.948892 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:34.948892 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 14:30:34.948892 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 14:30:34.948892 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 14:30:34.950088 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 14:30:34.950088 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:34.950088 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:34.950088 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:34.950088 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:34.950088 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:34.950088 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:34.950088 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:34.950088 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:30:34.950088 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:34.950088 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:34.950088 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:34.950088 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:34.950088 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:34.950088 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:34.950088 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:34.950088 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:34.951234 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 14:30:34.951234 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 14:30:34.951234 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 14:30:34.951234 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 14:30:34.951234 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 14:30:34.951234 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 14:30:34.951234 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 14:30:34.951234 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:30:34.958057 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 384/767] 10.222.0.15 () {56 vars in 1111 bytes} [Tue May 31 14:30:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:34.961890 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1884cec-9342-4ab7-b405-47eeed8df035 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:35.023303 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7370b28b-d8c8-44e0-9bd1-948d8621814d None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:35.048073 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:35.061548 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15332cf-1d55-4dc5-bd83-3c9cece6036b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:35.062928 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15332cf-1d55-4dc5-bd83-3c9cece6036b None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:35.062928 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15332cf-1d55-4dc5-bd83-3c9cece6036b None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:35.063577 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:35.064074 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15332cf-1d55-4dc5-bd83-3c9cece6036b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:35.068834 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1884cec-9342-4ab7-b405-47eeed8df035 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:35.073707 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15332cf-1d55-4dc5-bd83-3c9cece6036b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:35.077305 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15332cf-1d55-4dc5-bd83-3c9cece6036b None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:35.094778 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-d15332cf-1d55-4dc5-bd83-3c9cece6036b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 14:30:35.094778 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:35.094778 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:35.094778 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:35.094778 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:35.094778 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:35.094778 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:35.094778 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:35.094778 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:35.094778 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:35.094778 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:35.094778 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:35.094778 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 14:30:35.094778 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 14:30:35.094778 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 14:30:35.101633 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 14:30:35.101633 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:35.101633 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:35.101633 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:35.101633 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:35.101633 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:35.101633 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:35.101633 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:35.101633 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:30:35.101633 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:35.101633 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:35.101633 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:35.101633 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:35.101633 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:35.101633 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:35.101633 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:35.101633 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:35.102529 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 14:30:35.102529 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 14:30:35.102529 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 14:30:35.102529 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 14:30:35.102529 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 14:30:35.102529 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 14:30:35.102529 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 14:30:35.102529 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:30:35.102529 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 384/768] 10.222.0.15 () {56 vars in 1111 bytes} [Tue May 31 14:30:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:35.102529 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15332cf-1d55-4dc5-bd83-3c9cece6036b None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:35.112231 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023c66ca-78a9-4f12-a2dd-9e73b92d2412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:35.113148 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023c66ca-78a9-4f12-a2dd-9e73b92d2412 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:35.113650 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023c66ca-78a9-4f12-a2dd-9e73b92d2412 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:35.114134 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023c66ca-78a9-4f12-a2dd-9e73b92d2412 None admin] PATH_INFO: `/v3/services` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:35.115110 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023c66ca-78a9-4f12-a2dd-9e73b92d2412 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:35.116716 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023c66ca-78a9-4f12-a2dd-9e73b92d2412 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:35.126881 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 385/769] 10.222.0.15 () {56 vars in 1087 bytes} [Tue May 31 14:30:34 2022] GET /identity/v3/services => generated 772 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:35.128123 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023c66ca-78a9-4f12-a2dd-9e73b92d2412 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:35.242896 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15332cf-1d55-4dc5-bd83-3c9cece6036b None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:35.294576 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4534bde6-534f-4592-82c6-5bb783ac4ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:35.294576 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4534bde6-534f-4592-82c6-5bb783ac4ef6 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:35.294576 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4534bde6-534f-4592-82c6-5bb783ac4ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:35.294576 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4534bde6-534f-4592-82c6-5bb783ac4ef6 None admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:35.294999 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4534bde6-534f-4592-82c6-5bb783ac4ef6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:35.294999 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4534bde6-534f-4592-82c6-5bb783ac4ef6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:35.296753 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4534bde6-534f-4592-82c6-5bb783ac4ef6 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:35.335452 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 385/770] 10.222.0.15 () {56 vars in 1148 bytes} [Tue May 31 14:30:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:35.338649 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4534bde6-534f-4592-82c6-5bb783ac4ef6 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:35.407529 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023c66ca-78a9-4f12-a2dd-9e73b92d2412 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:35.409766 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:35.463282 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d5912b-41c2-4e57-b346-a26df988e3fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:35.464342 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d5912b-41c2-4e57-b346-a26df988e3fc None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:35.464864 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d5912b-41c2-4e57-b346-a26df988e3fc None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:35.465343 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d5912b-41c2-4e57-b346-a26df988e3fc None admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:35.466366 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d5912b-41c2-4e57-b346-a26df988e3fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:35.466896 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d5912b-41c2-4e57-b346-a26df988e3fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:35.468547 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d5912b-41c2-4e57-b346-a26df988e3fc None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:35.475602 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4534bde6-534f-4592-82c6-5bb783ac4ef6 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:35.490193 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 386/771] 10.222.0.15 () {56 vars in 1148 bytes} [Tue May 31 14:30:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:35.508397 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d5912b-41c2-4e57-b346-a26df988e3fc None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:35.519749 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8716fc67-bc57-4582-a702-8993847019c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:35.520278 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8716fc67-bc57-4582-a702-8993847019c8 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:35.521578 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8716fc67-bc57-4582-a702-8993847019c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:35.521578 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8716fc67-bc57-4582-a702-8993847019c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:35.521875 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8716fc67-bc57-4582-a702-8993847019c8 None admin] RBAC: Adding query filter params (role.id=4fa2a9add9bc4786a62e7b5cae3cc051, scope.project.id=ffff4334538649fdba1beb80cad207fa, user.id=735d2518c8404bd991acee533b314039) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:35.522173 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8716fc67-bc57-4582-a702-8993847019c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:35.524604 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8716fc67-bc57-4582-a702-8993847019c8 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:35.532885 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 386/772] 10.222.0.15 () {56 vars in 1374 bytes} [Tue May 31 14:30:35 2022] GET /identity/v3/role_assignments?user.id=735d2518c8404bd991acee533b314039&scope.project.id=ffff4334538649fdba1beb80cad207fa&role.id=4fa2a9add9bc4786a62e7b5cae3cc051 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:35.576593 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:35.634143 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f3e810-be9a-4e91-9a21-3c46a7b69e30 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:35.634522 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f3e810-be9a-4e91-9a21-3c46a7b69e30 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:35.638846 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f3e810-be9a-4e91-9a21-3c46a7b69e30 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:35.641839 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 387/773] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:30:35 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:30:35.648294 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fde6921-d85e-481b-b522-175226cdc7c7 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:35.654587 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fde6921-d85e-481b-b522-175226cdc7c7 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:35.654587 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fde6921-d85e-481b-b522-175226cdc7c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:35.692278 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d5912b-41c2-4e57-b346-a26df988e3fc None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:35.695714 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-1fde6921-d85e-481b-b522-175226cdc7c7 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:30:35.696986 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-1fde6921-d85e-481b-b522-175226cdc7c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:30:35.742578 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68d9e81-3f0e-4cad-a4b0-2065b77337f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:35.747348 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d9e81-3f0e-4cad-a4b0-2065b77337f6 None admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:35.747712 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d9e81-3f0e-4cad-a4b0-2065b77337f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:35.748058 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d9e81-3f0e-4cad-a4b0-2065b77337f6 None admin] PATH_INFO: `/v3/projects/ffff4334538649fdba1beb80cad207fa/users/b57768d448e345ad8879bf29f21b48ea/roles/76c53e2c353644f885028a0226c06146` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:35.753309 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68d9e81-3f0e-4cad-a4b0-2065b77337f6 None admin] RBAC: Authorizing `identity:create_grant(project_id=ffff4334538649fdba1beb80cad207fa, user_id=b57768d448e345ad8879bf29f21b48ea, role_id=76c53e2c353644f885028a0226c06146)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:35.755064 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68d9e81-3f0e-4cad-a4b0-2065b77337f6 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:35.800131 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 388/774] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:30:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 14:30:35.824726 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fde6921-d85e-481b-b522-175226cdc7c7 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:35.850844 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 387/775] 10.222.0.15 () {58 vars in 1439 bytes} [Tue May 31 14:30:35 2022] PUT /identity/v3/projects/ffff4334538649fdba1beb80cad207fa/users/b57768d448e345ad8879bf29f21b48ea/roles/76c53e2c353644f885028a0226c06146 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 14:30:35.902991 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:36.025763 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fde6921-d85e-481b-b522-175226cdc7c7 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:36.091189 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe71c2fc-aaae-4107-9054-f90180d5ab2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:36.092133 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe71c2fc-aaae-4107-9054-f90180d5ab2a None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:36.092422 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe71c2fc-aaae-4107-9054-f90180d5ab2a None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:36.092706 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe71c2fc-aaae-4107-9054-f90180d5ab2a None admin] PATH_INFO: `/v3/services/network` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:36.093385 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe71c2fc-aaae-4107-9054-f90180d5ab2a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:36.103090 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe71c2fc-aaae-4107-9054-f90180d5ab2a None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:36.120665 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-fe71c2fc-aaae-4107-9054-f90180d5ab2a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 31 14:30:36.120665 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:36.120665 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 31 14:30:36.120665 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 31 14:30:36.120665 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 31 14:30:36.120665 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 31 14:30:36.120665 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 31 14:30:36.120665 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 14:30:36.120665 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 31 14:30:36.120665 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:30:36.120665 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 31 14:30:36.120665 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:30:36.120665 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:36.120665 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:36.120665 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:36.120665 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:36.120665 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:36.121892 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:36.121892 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:36.121892 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:36.121892 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:36.121892 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:36.121892 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:36.121892 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 31 14:30:36.121892 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_service(service_id) May 31 14:30:36.121892 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 31 14:30:36.121892 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 31 14:30:36.121892 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:36.121892 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:36.121892 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:36.121892 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:36.121892 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:36.121892 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:36.122811 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:36.122811 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:30:36.122811 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:36.122811 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:36.122811 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:36.122811 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:36.122811 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:36.122811 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:36.122811 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:36.122811 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:36.122811 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 31 14:30:36.122811 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 14:30:36.122811 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 31 14:30:36.122811 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:30:36.127125 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 389/776] 10.222.0.15 () {56 vars in 1111 bytes} [Tue May 31 14:30:35 2022] GET /identity/v3/services/network => generated 88 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 14:30:36.135723 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68d9e81-3f0e-4cad-a4b0-2065b77337f6 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:36.255036 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:36.267773 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68d9e81-3f0e-4cad-a4b0-2065b77337f6 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:36.383340 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba687de-9f8f-4c7b-a4ff-c9580cb9f504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:36.383947 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba687de-9f8f-4c7b-a4ff-c9580cb9f504 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:36.384235 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba687de-9f8f-4c7b-a4ff-c9580cb9f504 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:36.384516 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba687de-9f8f-4c7b-a4ff-c9580cb9f504 None admin] PATH_INFO: `/v3/services` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:36.385231 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba687de-9f8f-4c7b-a4ff-c9580cb9f504 None admin] RBAC: Adding query filter params (name=network) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:36.385539 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba687de-9f8f-4c7b-a4ff-c9580cb9f504 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:36.386941 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba687de-9f8f-4c7b-a4ff-c9580cb9f504 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:36.395125 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 388/777] 10.222.0.15 () {56 vars in 1112 bytes} [Tue May 31 14:30:36 2022] GET /identity/v3/services?name=network => generated 124 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:36.401441 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe71c2fc-aaae-4107-9054-f90180d5ab2a None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:36.593047 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:36.596964 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe71c2fc-aaae-4107-9054-f90180d5ab2a None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:36.649603 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1b2925-cebd-4f85-be72-b2d94f8d3600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:36.650256 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1b2925-cebd-4f85-be72-b2d94f8d3600 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:36.650561 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1b2925-cebd-4f85-be72-b2d94f8d3600 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:36.652422 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1b2925-cebd-4f85-be72-b2d94f8d3600 None admin] PATH_INFO: `/v3/services` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:36.653151 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1b2925-cebd-4f85-be72-b2d94f8d3600 None admin] RBAC: Adding query filter params (type=network) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:36.653464 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1b2925-cebd-4f85-be72-b2d94f8d3600 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:36.656372 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1b2925-cebd-4f85-be72-b2d94f8d3600 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:36.665789 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 390/778] 10.222.0.15 () {56 vars in 1112 bytes} [Tue May 31 14:30:36 2022] GET /identity/v3/services?type=network => generated 350 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:36.671542 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba687de-9f8f-4c7b-a4ff-c9580cb9f504 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:36.741586 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff82cfb6-2e13-4a2c-ad04-58b78601e53f None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:36.741957 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff82cfb6-2e13-4a2c-ad04-58b78601e53f None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:36.742169 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff82cfb6-2e13-4a2c-ad04-58b78601e53f None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:36.744673 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 391/779] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:30:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:30:36.749991 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34296de3-1d09-4e9b-b331-e669bb5f6379 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:36.750264 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34296de3-1d09-4e9b-b331-e669bb5f6379 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:36.750545 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34296de3-1d09-4e9b-b331-e669bb5f6379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:36.791521 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-34296de3-1d09-4e9b-b331-e669bb5f6379 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:30:36.792720 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-34296de3-1d09-4e9b-b331-e669bb5f6379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:30:36.831645 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba687de-9f8f-4c7b-a4ff-c9580cb9f504 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:36.894803 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5899c94-c379-4674-803d-978000c152de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:36.898216 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5899c94-c379-4674-803d-978000c152de None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:36.899437 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5899c94-c379-4674-803d-978000c152de None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:36.900545 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5899c94-c379-4674-803d-978000c152de None admin] PATH_INFO: `/v3/endpoints` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:36.902798 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5899c94-c379-4674-803d-978000c152de None admin] RBAC: Adding query filter params (interface=public, service_id=fd4912a8fb6e4eac950dad1c462e9761, region_id=RegionOne) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:36.903993 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5899c94-c379-4674-803d-978000c152de None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:36.906162 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5899c94-c379-4674-803d-978000c152de None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:36.924423 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 392/780] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:30:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 31 14:30:36.928762 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 389/781] 10.222.0.15 () {56 vars in 1251 bytes} [Tue May 31 14:30:36 2022] GET /identity/v3/endpoints?service_id=fd4912a8fb6e4eac950dad1c462e9761&interface=public®ion_id=RegionOne => generated 194 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:36.933539 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34296de3-1d09-4e9b-b331-e669bb5f6379 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:36.974538 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5899c94-c379-4674-803d-978000c152de None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:37.010947 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:37.105979 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:37.122999 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34296de3-1d09-4e9b-b331-e669bb5f6379 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:37.157646 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5899c94-c379-4674-803d-978000c152de None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:37.193873 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ed5927-7147-4cd7-93dc-57686e0aae37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:37.194731 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ed5927-7147-4cd7-93dc-57686e0aae37 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:37.195019 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ed5927-7147-4cd7-93dc-57686e0aae37 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:37.195291 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ed5927-7147-4cd7-93dc-57686e0aae37 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:37.205805 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ed5927-7147-4cd7-93dc-57686e0aae37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 14:30:37.221417 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-51ed5927-7147-4cd7-93dc-57686e0aae37 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 31 14:30:37.221417 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:37.221417 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:37.221417 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:37.221417 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:37.221417 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:37.221417 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:37.221417 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:37.221417 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:37.221417 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:37.221417 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:37.221417 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:37.221417 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 14:30:37.221417 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 14:30:37.221417 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 14:30:37.221417 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 14:30:37.222385 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 14:30:37.222385 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 14:30:37.222385 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 14:30:37.222385 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 14:30:37.222385 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:37.222385 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:37.222385 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:37.222385 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:37.222385 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:37.222385 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:37.222385 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:37.222385 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:30:37.222385 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:37.222385 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:37.222385 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:37.222385 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:37.223258 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:37.223258 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:37.223258 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:37.223258 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:37.223258 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 14:30:37.223258 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 14:30:37.223258 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 14:30:37.223258 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 14:30:37.223258 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 14:30:37.223258 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 14:30:37.223258 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 31 14:30:37.223258 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:30:37.227523 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 390/782] 10.222.0.15 () {56 vars in 1096 bytes} [Tue May 31 14:30:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 14:30:37.233020 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ed5927-7147-4cd7-93dc-57686e0aae37 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:37.242572 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c317a8-20f2-4c6c-8053-8cdf1682bc9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:37.242572 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c317a8-20f2-4c6c-8053-8cdf1682bc9d None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:37.242572 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c317a8-20f2-4c6c-8053-8cdf1682bc9d None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:37.242572 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c317a8-20f2-4c6c-8053-8cdf1682bc9d None admin] PATH_INFO: `/v3/services` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:37.242947 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c317a8-20f2-4c6c-8053-8cdf1682bc9d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:37.243272 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c317a8-20f2-4c6c-8053-8cdf1682bc9d None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:37.262031 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 393/783] 10.222.0.15 () {56 vars in 1087 bytes} [Tue May 31 14:30:36 2022] GET /identity/v3/services => generated 772 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 14:30:37.330581 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:37.366583 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ed5927-7147-4cd7-93dc-57686e0aae37 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:37.416199 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2498f85f-6a98-4256-a92f-4cd423b4f75e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:37.416818 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2498f85f-6a98-4256-a92f-4cd423b4f75e None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:37.417109 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2498f85f-6a98-4256-a92f-4cd423b4f75e None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:37.417390 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2498f85f-6a98-4256-a92f-4cd423b4f75e None admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:37.418285 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2498f85f-6a98-4256-a92f-4cd423b4f75e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:37.418624 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2498f85f-6a98-4256-a92f-4cd423b4f75e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:37.420042 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2498f85f-6a98-4256-a92f-4cd423b4f75e None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:37.434940 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 391/784] 10.222.0.15 () {56 vars in 1099 bytes} [Tue May 31 14:30:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:37.441402 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c317a8-20f2-4c6c-8053-8cdf1682bc9d None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:37.593925 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c317a8-20f2-4c6c-8053-8cdf1682bc9d None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:37.632681 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574d3ebf-6fc3-4fb8-8c32-affe6f967800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:37.633488 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574d3ebf-6fc3-4fb8-8c32-affe6f967800 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:37.633774 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574d3ebf-6fc3-4fb8-8c32-affe6f967800 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:37.634049 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574d3ebf-6fc3-4fb8-8c32-affe6f967800 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:37.642445 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eefe9e-92fc-4f67-af2b-c7a53d03e22d None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:37.642800 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eefe9e-92fc-4f67-af2b-c7a53d03e22d None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:37.643084 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eefe9e-92fc-4f67-af2b-c7a53d03e22d None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:37.644578 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 392/785] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:30:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:30:37.649939 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574d3ebf-6fc3-4fb8-8c32-affe6f967800 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:37.650460 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f26236-2274-4e6d-a944-9f3eadb6c9af None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:37.650780 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f26236-2274-4e6d-a944-9f3eadb6c9af None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:37.651062 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f26236-2274-4e6d-a944-9f3eadb6c9af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:37.651588 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574d3ebf-6fc3-4fb8-8c32-affe6f967800 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:37.671747 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-574d3ebf-6fc3-4fb8-8c32-affe6f967800 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:37.671747 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:37.671747 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:37.671747 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:37.671747 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:37.671747 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:37.671747 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:37.671747 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:37.671747 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:37.671747 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:37.671747 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:37.671747 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:37.671747 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 14:30:37.671747 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 14:30:37.671747 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 14:30:37.672706 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 14:30:37.672706 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:37.672706 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:37.672706 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:37.672706 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:37.672706 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:37.672706 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:37.672706 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:37.672706 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:30:37.672706 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:37.672706 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:37.672706 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:37.672706 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:37.672706 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:37.672706 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:37.672706 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:37.672706 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:37.673620 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 14:30:37.673620 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 14:30:37.673620 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:37.673620 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:30:37.673620 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 394/786] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:30:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:37.685667 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574d3ebf-6fc3-4fb8-8c32-affe6f967800 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:37.692199 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-26f26236-2274-4e6d-a944-9f3eadb6c9af None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:30:37.693458 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-26f26236-2274-4e6d-a944-9f3eadb6c9af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:30:37.702174 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:37.838734 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 393/787] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:30:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 14:30:37.846184 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574d3ebf-6fc3-4fb8-8c32-affe6f967800 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:37.879577 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f26236-2274-4e6d-a944-9f3eadb6c9af None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:37.901324 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8aac59-7cd4-45c7-9f65-f3d1cc2f54a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:37.901324 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8aac59-7cd4-45c7-9f65-f3d1cc2f54a3 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:37.901627 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8aac59-7cd4-45c7-9f65-f3d1cc2f54a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:37.901887 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8aac59-7cd4-45c7-9f65-f3d1cc2f54a3 None admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:37.906573 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8aac59-7cd4-45c7-9f65-f3d1cc2f54a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:37.906573 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8aac59-7cd4-45c7-9f65-f3d1cc2f54a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:37.906573 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8aac59-7cd4-45c7-9f65-f3d1cc2f54a3 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:37.941398 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 395/788] 10.222.0.15 () {56 vars in 1109 bytes} [Tue May 31 14:30:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:37.957445 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8aac59-7cd4-45c7-9f65-f3d1cc2f54a3 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:38.019258 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:38.053825 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:38.073462 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f26236-2274-4e6d-a944-9f3eadb6c9af None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:38.117577 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0de0f55-bb91-4ea2-909f-da7c3e3fcee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:38.120591 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0de0f55-bb91-4ea2-909f-da7c3e3fcee3 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:38.121204 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0de0f55-bb91-4ea2-909f-da7c3e3fcee3 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:38.121697 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0de0f55-bb91-4ea2-909f-da7c3e3fcee3 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:38.122634 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0de0f55-bb91-4ea2-909f-da7c3e3fcee3 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:38.124285 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0de0f55-bb91-4ea2-909f-da7c3e3fcee3 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:38.139048 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-b0de0f55-bb91-4ea2-909f-da7c3e3fcee3 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 31 14:30:38.139048 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:38.139048 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 31 14:30:38.139048 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 31 14:30:38.139048 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 31 14:30:38.139048 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 31 14:30:38.139048 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 31 14:30:38.139048 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 14:30:38.139048 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 31 14:30:38.139048 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:30:38.139048 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 31 14:30:38.139048 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:30:38.139048 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:38.139048 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:38.139048 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:38.139048 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:38.140016 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:38.140016 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:38.140016 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:38.140016 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:38.140016 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:38.140016 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:38.140016 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:38.140016 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 31 14:30:38.140016 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_service(service_id) May 31 14:30:38.140016 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 31 14:30:38.140016 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 31 14:30:38.140016 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:38.140016 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:38.140016 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:38.140016 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:38.140016 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:38.140858 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:38.140858 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:38.140858 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:30:38.140858 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:38.140858 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:38.140858 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:38.140858 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:38.140858 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:38.140858 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:38.140858 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:38.140858 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:38.140858 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 31 14:30:38.140858 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 14:30:38.140858 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 31 14:30:38.140858 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:30:38.141661 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8aac59-7cd4-45c7-9f65-f3d1cc2f54a3 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:38.144050 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 394/789] 10.222.0.15 () {56 vars in 1129 bytes} [Tue May 31 14:30:37 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:38.153642 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0de0f55-bb91-4ea2-909f-da7c3e3fcee3 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:38.218863 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011536cd-52b9-4f51-a993-205d5b1bbd34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:38.220860 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011536cd-52b9-4f51-a993-205d5b1bbd34 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:38.221923 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011536cd-52b9-4f51-a993-205d5b1bbd34 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:38.222583 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011536cd-52b9-4f51-a993-205d5b1bbd34 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:38.240934 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011536cd-52b9-4f51-a993-205d5b1bbd34 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:38.242860 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011536cd-52b9-4f51-a993-205d5b1bbd34 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:38.268970 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-011536cd-52b9-4f51-a993-205d5b1bbd34 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 31 14:30:38.268970 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:38.268970 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:38.268970 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:38.268970 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:38.268970 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:38.268970 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:38.268970 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:38.268970 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:38.268970 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:38.268970 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:38.268970 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:38.268970 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 14:30:38.268970 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 14:30:38.268970 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 14:30:38.268970 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 14:30:38.269972 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:38.269972 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:38.269972 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 14:30:38.269972 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 14:30:38.269972 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 14:30:38.269972 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 14:30:38.269972 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:38.269972 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:38.269972 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:38.269972 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:38.269972 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:38.269972 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:30:38.269972 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:38.269972 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:38.269972 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:38.269972 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:38.269972 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:38.269972 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:38.271014 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:38.271014 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:38.271014 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 14:30:38.271014 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 14:30:38.271014 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 14:30:38.271014 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 14:30:38.271014 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 14:30:38.271014 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 14:30:38.271014 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 31 14:30:38.271014 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:30:38.274490 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 396/790] 10.222.0.15 () {56 vars in 1096 bytes} [Tue May 31 14:30:37 2022] GET /identity/v3/users/swift => generated 83 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 14:30:38.280909 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011536cd-52b9-4f51-a993-205d5b1bbd34 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:38.374704 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0de0f55-bb91-4ea2-909f-da7c3e3fcee3 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:38.406675 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:38.411386 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c872a293-ffe9-476f-a6fc-24b5f89e5998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:38.411758 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011536cd-52b9-4f51-a993-205d5b1bbd34 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:38.412051 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c872a293-ffe9-476f-a6fc-24b5f89e5998 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:38.412335 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c872a293-ffe9-476f-a6fc-24b5f89e5998 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:38.412613 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c872a293-ffe9-476f-a6fc-24b5f89e5998 None admin] PATH_INFO: `/v3/services` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:38.413346 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c872a293-ffe9-476f-a6fc-24b5f89e5998 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:38.413650 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c872a293-ffe9-476f-a6fc-24b5f89e5998 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:38.415212 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c872a293-ffe9-476f-a6fc-24b5f89e5998 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:38.425335 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 395/791] 10.222.0.15 () {56 vars in 1124 bytes} [Tue May 31 14:30:38 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:38.425335 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532edeac-da9c-4a02-a26e-7b12adde354f None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:38.425335 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532edeac-da9c-4a02-a26e-7b12adde354f None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:38.425335 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532edeac-da9c-4a02-a26e-7b12adde354f None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:38.425335 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 396/792] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:30:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:30:38.427649 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532edeac-da9c-4a02-a26e-7b12adde354f None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:38.457063 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:38.463741 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28ee3cc-908c-4682-ba19-b3b8b4789f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:38.464651 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ee3cc-908c-4682-ba19-b3b8b4789f17 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:38.465154 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ee3cc-908c-4682-ba19-b3b8b4789f17 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:38.465668 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ee3cc-908c-4682-ba19-b3b8b4789f17 None admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:38.466878 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28ee3cc-908c-4682-ba19-b3b8b4789f17 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:38.467533 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28ee3cc-908c-4682-ba19-b3b8b4789f17 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:38.473091 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28ee3cc-908c-4682-ba19-b3b8b4789f17 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:38.498618 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 397/793] 10.222.0.15 () {56 vars in 1135 bytes} [Tue May 31 14:30:38 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:38.500392 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e607a39-5c25-47c0-85a9-aca7ef271c98 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:38.500920 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e607a39-5c25-47c0-85a9-aca7ef271c98 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:38.501409 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e607a39-5c25-47c0-85a9-aca7ef271c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:38.518610 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-3e607a39-5c25-47c0-85a9-aca7ef271c98 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:30:38.520105 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-3e607a39-5c25-47c0-85a9-aca7ef271c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:30:38.547107 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532edeac-da9c-4a02-a26e-7b12adde354f None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:38.588318 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abccfd89-05f8-4379-8cfa-e6fde1d61797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:38.588995 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abccfd89-05f8-4379-8cfa-e6fde1d61797 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:38.589553 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abccfd89-05f8-4379-8cfa-e6fde1d61797 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:38.589665 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abccfd89-05f8-4379-8cfa-e6fde1d61797 None admin] PATH_INFO: `/v3/services` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:38.590328 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abccfd89-05f8-4379-8cfa-e6fde1d61797 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:38.590692 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abccfd89-05f8-4379-8cfa-e6fde1d61797 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:38.592028 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abccfd89-05f8-4379-8cfa-e6fde1d61797 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:38.595060 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 398/794] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:30:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 14:30:38.596136 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e607a39-5c25-47c0-85a9-aca7ef271c98 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:38.598600 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 397/795] 10.222.0.15 () {56 vars in 1124 bytes} [Tue May 31 14:30:38 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:38.602645 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abccfd89-05f8-4379-8cfa-e6fde1d61797 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:38.673622 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:38.717448 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e607a39-5c25-47c0-85a9-aca7ef271c98 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:38.721647 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abccfd89-05f8-4379-8cfa-e6fde1d61797 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:38.751057 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:38.758656 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6cfb10-b070-4cbc-a1c4-b46cc3ba7257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:38.759566 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6cfb10-b070-4cbc-a1c4-b46cc3ba7257 None admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:38.760058 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6cfb10-b070-4cbc-a1c4-b46cc3ba7257 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:38.760476 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6cfb10-b070-4cbc-a1c4-b46cc3ba7257 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:38.761354 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6cfb10-b070-4cbc-a1c4-b46cc3ba7257 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:38.762178 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0d2879-9b46-48e9-accf-b3cc6dec03ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:38.763062 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0d2879-9b46-48e9-accf-b3cc6dec03ca None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:38.763217 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6cfb10-b070-4cbc-a1c4-b46cc3ba7257 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:38.763451 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0d2879-9b46-48e9-accf-b3cc6dec03ca None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:38.763783 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0d2879-9b46-48e9-accf-b3cc6dec03ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:38.777639 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0d2879-9b46-48e9-accf-b3cc6dec03ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:38.779182 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0d2879-9b46-48e9-accf-b3cc6dec03ca None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:38.798497 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-5d0d2879-9b46-48e9-accf-b3cc6dec03ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:38.798497 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:38.798497 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:38.798497 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:38.798497 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:38.798497 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:38.798497 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:38.798497 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:38.798497 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:38.798497 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:38.798497 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:38.798497 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:38.798497 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 14:30:38.798497 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 14:30:38.798497 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 14:30:38.799521 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 14:30:38.799521 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:38.799521 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:38.799521 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:38.799521 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:38.799521 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:38.799521 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:38.799521 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:38.799521 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:30:38.799521 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:38.799521 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:38.799521 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:38.799521 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:38.799521 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:38.799521 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:38.799521 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:38.799521 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:38.800406 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 14:30:38.800406 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 14:30:38.800406 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:38.800406 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:30:38.800406 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 399/796] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:30:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:38.801104 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0d2879-9b46-48e9-accf-b3cc6dec03ca None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:38.878576 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 398/797] 10.222.0.15 () {60 vars in 1144 bytes} [Tue May 31 14:30:38 2022] POST /identity/v3/endpoints => generated 346 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:30:38.878576 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a582e03-4cb0-45fa-af0d-9f868f83d10b None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:38.878576 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a582e03-4cb0-45fa-af0d-9f868f83d10b None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:38.878576 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a582e03-4cb0-45fa-af0d-9f868f83d10b None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:38.878576 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 399/798] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:30:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:30:38.882598 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a582e03-4cb0-45fa-af0d-9f868f83d10b None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:38.919879 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0d2879-9b46-48e9-accf-b3cc6dec03ca None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:38.970891 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24a1111-0a0a-490b-9a96-f216fa029bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:38.971662 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24a1111-0a0a-490b-9a96-f216fa029bba None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:38.971902 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24a1111-0a0a-490b-9a96-f216fa029bba None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:38.972248 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24a1111-0a0a-490b-9a96-f216fa029bba None admin] PATH_INFO: `/v3/roles/service` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:38.992748 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24a1111-0a0a-490b-9a96-f216fa029bba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 14:30:39.006877 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-c24a1111-0a0a-490b-9a96-f216fa029bba None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 31 14:30:39.006877 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:39.006877 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:39.006877 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:39.006877 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:39.006877 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:39.006877 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:39.006877 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:39.006877 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:39.006877 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:39.006877 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:39.006877 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:39.006877 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 14:30:39.006877 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 14:30:39.006877 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 14:30:39.006877 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 14:30:39.007881 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 14:30:39.007881 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 14:30:39.007881 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 14:30:39.007881 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 14:30:39.007881 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:39.007881 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:39.007881 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:39.007881 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:39.007881 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:39.007881 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:39.007881 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:39.007881 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:30:39.007881 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:39.007881 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:39.007881 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:39.007881 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:39.008715 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:39.008715 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:39.008715 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:39.008715 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:39.008715 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 14:30:39.008715 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 14:30:39.008715 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 14:30:39.008715 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 14:30:39.008715 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 14:30:39.008715 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 14:30:39.008715 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 31 14:30:39.008715 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:30:39.011471 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 400/799] 10.222.0.15 () {56 vars in 1102 bytes} [Tue May 31 14:30:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:39.014012 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2955ca-395d-4f39-b272-a9a015c1051c None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:39.014461 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2955ca-395d-4f39-b272-a9a015c1051c None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:39.014907 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2955ca-395d-4f39-b272-a9a015c1051c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:39.023667 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a582e03-4cb0-45fa-af0d-9f868f83d10b None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:39.037012 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:39.042444 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-6e2955ca-395d-4f39-b272-a9a015c1051c None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:30:39.044111 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-6e2955ca-395d-4f39-b272-a9a015c1051c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:30:39.065243 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89286e31-1724-498e-ad94-6cc09620f402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:39.066108 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89286e31-1724-498e-ad94-6cc09620f402 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:39.066508 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89286e31-1724-498e-ad94-6cc09620f402 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:39.066906 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89286e31-1724-498e-ad94-6cc09620f402 None admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:39.067853 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89286e31-1724-498e-ad94-6cc09620f402 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:39.068255 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89286e31-1724-498e-ad94-6cc09620f402 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:39.069858 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89286e31-1724-498e-ad94-6cc09620f402 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:39.076173 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:39.086641 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 400/800] 10.222.0.15 () {56 vars in 1109 bytes} [Tue May 31 14:30:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:39.087746 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89286e31-1724-498e-ad94-6cc09620f402 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:39.142700 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 401/801] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:30:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 14:30:39.144166 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2955ca-395d-4f39-b272-a9a015c1051c None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:39.218788 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89286e31-1724-498e-ad94-6cc09620f402 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:39.263913 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf693178-a6e8-48fa-a0bc-eddd64937855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:39.265112 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf693178-a6e8-48fa-a0bc-eddd64937855 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:39.265963 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf693178-a6e8-48fa-a0bc-eddd64937855 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:39.266716 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf693178-a6e8-48fa-a0bc-eddd64937855 None admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:39.267669 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf693178-a6e8-48fa-a0bc-eddd64937855 None admin] RBAC: Adding query filter params (name=service) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:39.268389 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf693178-a6e8-48fa-a0bc-eddd64937855 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:39.271131 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf693178-a6e8-48fa-a0bc-eddd64937855 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:39.272374 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2955ca-395d-4f39-b272-a9a015c1051c None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:39.281835 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 401/802] 10.222.0.15 () {56 vars in 1103 bytes} [Tue May 31 14:30:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:39.282971 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf693178-a6e8-48fa-a0bc-eddd64937855 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:39.324159 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df31944-4745-4a60-ba76-a2d89721fe12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:39.325356 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df31944-4745-4a60-ba76-a2d89721fe12 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:39.325716 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df31944-4745-4a60-ba76-a2d89721fe12 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:39.326072 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df31944-4745-4a60-ba76-a2d89721fe12 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:39.334824 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:39.337148 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df31944-4745-4a60-ba76-a2d89721fe12 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:39.338894 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df31944-4745-4a60-ba76-a2d89721fe12 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:39.356347 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-3df31944-4745-4a60-ba76-a2d89721fe12 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 14:30:39.356347 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:39.356347 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:39.356347 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:39.356347 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:39.356347 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:39.356347 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:39.356347 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:39.356347 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:39.356347 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:39.356347 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:39.356347 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:39.356347 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 14:30:39.356347 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 14:30:39.356347 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 14:30:39.357294 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 14:30:39.357294 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:39.357294 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:39.357294 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:39.357294 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:39.357294 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:39.357294 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:39.357294 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:39.357294 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:30:39.357294 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:39.357294 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:39.357294 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:39.357294 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:39.357294 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:39.357294 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:39.357294 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:39.357294 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:39.358174 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 14:30:39.358174 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 14:30:39.358174 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 14:30:39.358174 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 14:30:39.358174 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 14:30:39.358174 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 14:30:39.358174 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 14:30:39.358174 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:30:39.360769 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 402/803] 10.222.0.15 () {56 vars in 1111 bytes} [Tue May 31 14:30:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:39.361841 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df31944-4745-4a60-ba76-a2d89721fe12 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:39.384435 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:39.421710 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf693178-a6e8-48fa-a0bc-eddd64937855 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:39.458523 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20215c67-16f3-4600-aed6-27364cc1381c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:39.459359 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20215c67-16f3-4600-aed6-27364cc1381c None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:39.459648 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20215c67-16f3-4600-aed6-27364cc1381c None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:39.459924 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20215c67-16f3-4600-aed6-27364cc1381c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:39.471201 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20215c67-16f3-4600-aed6-27364cc1381c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 14:30:39.475718 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df31944-4745-4a60-ba76-a2d89721fe12 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:39.479437 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-20215c67-16f3-4600-aed6-27364cc1381c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 31 14:30:39.479437 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:39.479437 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:39.479437 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:39.479437 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:39.479437 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:39.479437 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:39.479437 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:39.479437 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:39.479437 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:39.479437 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:39.479437 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:39.479437 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 14:30:39.479437 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 14:30:39.479437 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 14:30:39.479437 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 14:30:39.480385 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 14:30:39.480385 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 14:30:39.480385 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 14:30:39.480385 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 14:30:39.480385 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:39.480385 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:39.480385 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:39.480385 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:39.480385 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:39.480385 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:39.480385 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:39.480385 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:30:39.480385 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:39.480385 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:39.480385 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:39.480385 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:39.481209 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:39.481209 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:39.481209 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:39.481209 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:39.481209 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 14:30:39.481209 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 14:30:39.481209 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 14:30:39.481209 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 14:30:39.481209 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 14:30:39.481209 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 14:30:39.481209 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 31 14:30:39.481209 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:30:39.481209 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 402/804] 10.222.0.15 () {56 vars in 1096 bytes} [Tue May 31 14:30:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:39.481895 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20215c67-16f3-4600-aed6-27364cc1381c None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:39.519324 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be01606-7503-4369-b462-0f6a98ba73ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:39.521071 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be01606-7503-4369-b462-0f6a98ba73ee None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:39.523735 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be01606-7503-4369-b462-0f6a98ba73ee None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:39.525935 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be01606-7503-4369-b462-0f6a98ba73ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:39.542576 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be01606-7503-4369-b462-0f6a98ba73ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:39.544429 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be01606-7503-4369-b462-0f6a98ba73ee None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:39.563378 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-5be01606-7503-4369-b462-0f6a98ba73ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:39.563378 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:39.563378 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:39.563378 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:39.563378 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:39.563378 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:39.563378 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:39.563378 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:39.563378 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:39.563378 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:39.563378 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:39.563378 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:39.563378 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 14:30:39.563378 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 14:30:39.563378 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 14:30:39.564318 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 14:30:39.564318 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:39.564318 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:39.564318 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:39.564318 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:39.564318 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:39.564318 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:39.564318 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:39.564318 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:30:39.564318 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:39.564318 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:39.564318 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:39.564318 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:39.564318 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:39.564318 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:39.564318 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:39.564318 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:39.565198 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 14:30:39.565198 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 14:30:39.565198 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:39.565198 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:30:39.568147 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 403/805] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:30:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:39.569234 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be01606-7503-4369-b462-0f6a98ba73ee None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:39.614468 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:39.626964 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20215c67-16f3-4600-aed6-27364cc1381c None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:39.651082 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:39.678625 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee98199f-18ab-4631-b131-eea62dea99fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:39.679463 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98199f-18ab-4631-b131-eea62dea99fa None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:39.679813 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98199f-18ab-4631-b131-eea62dea99fa None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:39.680158 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98199f-18ab-4631-b131-eea62dea99fa None admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:39.681026 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee98199f-18ab-4631-b131-eea62dea99fa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:39.681401 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee98199f-18ab-4631-b131-eea62dea99fa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:39.683830 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee98199f-18ab-4631-b131-eea62dea99fa None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:39.698208 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be01606-7503-4369-b462-0f6a98ba73ee None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:39.699946 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 403/806] 10.222.0.15 () {56 vars in 1148 bytes} [Tue May 31 14:30:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:39.701764 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee98199f-18ab-4631-b131-eea62dea99fa None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:39.747880 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddb2b5a-2909-4790-84d2-ea1bd4c09ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:39.748892 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddb2b5a-2909-4790-84d2-ea1bd4c09ce4 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:39.749357 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddb2b5a-2909-4790-84d2-ea1bd4c09ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:39.749808 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddb2b5a-2909-4790-84d2-ea1bd4c09ce4 None admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:39.750767 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddb2b5a-2909-4790-84d2-ea1bd4c09ce4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:39.751252 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddb2b5a-2909-4790-84d2-ea1bd4c09ce4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:39.753359 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddb2b5a-2909-4790-84d2-ea1bd4c09ce4 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:39.765744 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 404/807] 10.222.0.15 () {56 vars in 1099 bytes} [Tue May 31 14:30:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:39.766941 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddb2b5a-2909-4790-84d2-ea1bd4c09ce4 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:39.828544 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee98199f-18ab-4631-b131-eea62dea99fa None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:39.871556 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7987e1be-7e28-42ec-95df-dc3d71d4a8f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:39.872227 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7987e1be-7e28-42ec-95df-dc3d71d4a8f2 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:39.872512 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7987e1be-7e28-42ec-95df-dc3d71d4a8f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:39.872789 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7987e1be-7e28-42ec-95df-dc3d71d4a8f2 None admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:39.873504 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7987e1be-7e28-42ec-95df-dc3d71d4a8f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:39.873807 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7987e1be-7e28-42ec-95df-dc3d71d4a8f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:39.875227 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7987e1be-7e28-42ec-95df-dc3d71d4a8f2 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:39.887868 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 404/808] 10.222.0.15 () {56 vars in 1109 bytes} [Tue May 31 14:30:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:39.888659 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7987e1be-7e28-42ec-95df-dc3d71d4a8f2 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:39.896832 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddb2b5a-2909-4790-84d2-ea1bd4c09ce4 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:39.906091 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:39.926254 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:39.933081 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304668d6-e765-4d28-a10f-e7a72fc87cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:39.933976 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304668d6-e765-4d28-a10f-e7a72fc87cc9 None admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:39.934306 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304668d6-e765-4d28-a10f-e7a72fc87cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:39.934619 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304668d6-e765-4d28-a10f-e7a72fc87cc9 None admin] PATH_INFO: `/v3/projects/ffff4334538649fdba1beb80cad207fa/users/e158f461c66e4d779f23fb7760672897/roles/76c53e2c353644f885028a0226c06146` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:39.936602 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304668d6-e765-4d28-a10f-e7a72fc87cc9 None admin] RBAC: Authorizing `identity:create_grant(project_id=ffff4334538649fdba1beb80cad207fa, user_id=e158f461c66e4d779f23fb7760672897, role_id=76c53e2c353644f885028a0226c06146)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:39.938041 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304668d6-e765-4d28-a10f-e7a72fc87cc9 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:39.994941 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7987e1be-7e28-42ec-95df-dc3d71d4a8f2 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:40.027908 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61f100b-a30f-40ca-b032-3a6c2e1e3b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:40.028702 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f100b-a30f-40ca-b032-3a6c2e1e3b4b None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:40.028983 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f100b-a30f-40ca-b032-3a6c2e1e3b4b None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:40.029256 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f100b-a30f-40ca-b032-3a6c2e1e3b4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:40.039908 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61f100b-a30f-40ca-b032-3a6c2e1e3b4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:40.041336 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61f100b-a30f-40ca-b032-3a6c2e1e3b4b None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:40.056018 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 405/809] 10.222.0.15 () {58 vars in 1439 bytes} [Tue May 31 14:30:39 2022] PUT /identity/v3/projects/ffff4334538649fdba1beb80cad207fa/users/e158f461c66e4d779f23fb7760672897/roles/76c53e2c353644f885028a0226c06146 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:30:40.061020 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcbaa3d-faa6-43fb-924e-d2e1d2026768 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:40.061020 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcbaa3d-faa6-43fb-924e-d2e1d2026768 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:40.061020 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcbaa3d-faa6-43fb-924e-d2e1d2026768 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:40.061279 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-d61f100b-a30f-40ca-b032-3a6c2e1e3b4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:40.061279 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:40.061279 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:40.061279 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:40.061279 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:40.061279 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:40.061279 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:40.061279 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:40.061279 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:40.061279 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:40.061279 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:40.061279 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:40.061279 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 14:30:40.061279 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 14:30:40.061279 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 14:30:40.062081 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 14:30:40.062081 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:40.062081 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:40.062081 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:40.062081 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:40.062081 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:40.062081 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:40.062081 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:40.062081 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:30:40.062081 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:40.062081 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:40.062081 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:40.062081 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:40.062081 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:40.062081 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:40.062081 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:40.062081 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:40.068325 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 14:30:40.068325 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 14:30:40.068325 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:40.068325 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:30:40.068325 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 405/810] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:30:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:40.068615 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 406/811] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:30:40 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:30:40.068688 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61f100b-a30f-40ca-b032-3a6c2e1e3b4b None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:40.070619 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a204a0-ef3e-4203-9d06-6adb8ccae662 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:40.073137 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a204a0-ef3e-4203-9d06-6adb8ccae662 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:40.073137 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a204a0-ef3e-4203-9d06-6adb8ccae662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:40.112775 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-36a204a0-ef3e-4203-9d06-6adb8ccae662 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:30:40.114695 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-36a204a0-ef3e-4203-9d06-6adb8ccae662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:30:40.148329 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:40.196208 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61f100b-a30f-40ca-b032-3a6c2e1e3b4b None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:40.211194 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 407/812] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:30:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 14:30:40.212204 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a204a0-ef3e-4203-9d06-6adb8ccae662 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:40.236265 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c3aa1d-d768-482b-a915-fca35de5584d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:40.237108 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c3aa1d-d768-482b-a915-fca35de5584d None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:40.237396 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c3aa1d-d768-482b-a915-fca35de5584d None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:40.237728 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c3aa1d-d768-482b-a915-fca35de5584d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:40.248125 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c3aa1d-d768-482b-a915-fca35de5584d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:40.250779 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c3aa1d-d768-482b-a915-fca35de5584d None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:40.280992 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-34c3aa1d-d768-482b-a915-fca35de5584d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 31 14:30:40.280992 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:40.280992 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:40.280992 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:40.280992 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:40.280992 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:40.280992 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:40.280992 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:40.280992 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:40.280992 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:40.280992 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:40.280992 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:40.280992 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 14:30:40.280992 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 14:30:40.280992 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 14:30:40.280992 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 14:30:40.282004 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:40.282004 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:40.282004 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 14:30:40.282004 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 14:30:40.282004 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 14:30:40.282004 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 14:30:40.282004 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:40.282004 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:40.282004 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:40.282004 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:40.282004 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:40.282004 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:30:40.282004 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:40.282004 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:40.282004 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:40.282004 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:40.282004 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:40.282004 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:40.283025 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:40.283025 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:40.283025 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 14:30:40.283025 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 14:30:40.283025 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 14:30:40.283025 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 14:30:40.283025 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 14:30:40.283025 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 14:30:40.283025 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 31 14:30:40.283025 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:30:40.283025 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 406/813] 10.222.0.15 () {56 vars in 1117 bytes} [Tue May 31 14:30:40 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:40.283881 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c3aa1d-d768-482b-a915-fca35de5584d None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:40.344065 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a204a0-ef3e-4203-9d06-6adb8ccae662 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:40.366666 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:40.389426 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282c4e2d-8423-4308-b8a1-bdfb00c127d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:40.390096 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282c4e2d-8423-4308-b8a1-bdfb00c127d2 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:40.390379 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282c4e2d-8423-4308-b8a1-bdfb00c127d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:40.390681 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282c4e2d-8423-4308-b8a1-bdfb00c127d2 None admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:40.391702 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282c4e2d-8423-4308-b8a1-bdfb00c127d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:40.392011 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282c4e2d-8423-4308-b8a1-bdfb00c127d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:40.398573 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282c4e2d-8423-4308-b8a1-bdfb00c127d2 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:40.412825 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 408/814] 10.222.0.15 () {56 vars in 1109 bytes} [Tue May 31 14:30:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:40.417741 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282c4e2d-8423-4308-b8a1-bdfb00c127d2 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:40.435277 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c3aa1d-d768-482b-a915-fca35de5584d None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:40.460645 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:40.474000 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8422919-320b-494b-89d2-a33342c4c39d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:40.474842 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8422919-320b-494b-89d2-a33342c4c39d None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:40.475132 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8422919-320b-494b-89d2-a33342c4c39d None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:40.475418 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8422919-320b-494b-89d2-a33342c4c39d None admin] PATH_INFO: `/v3/services/network` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:40.476428 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8422919-320b-494b-89d2-a33342c4c39d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:40.478862 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8422919-320b-494b-89d2-a33342c4c39d None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:40.492661 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-c8422919-320b-494b-89d2-a33342c4c39d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 31 14:30:40.492661 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:40.492661 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 31 14:30:40.492661 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 31 14:30:40.492661 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 31 14:30:40.492661 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 31 14:30:40.492661 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 31 14:30:40.492661 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 14:30:40.492661 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 31 14:30:40.492661 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:30:40.492661 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 31 14:30:40.492661 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:30:40.492661 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:40.492661 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:40.492661 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:40.492661 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:40.492661 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:40.493896 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:40.493896 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:40.493896 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:40.493896 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:40.493896 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:40.493896 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:40.493896 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 31 14:30:40.493896 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_service(service_id) May 31 14:30:40.493896 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 31 14:30:40.493896 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 31 14:30:40.493896 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:40.493896 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:40.493896 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:40.493896 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:40.493896 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:40.493896 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:40.494908 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:40.494908 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:30:40.494908 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:40.494908 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:40.494908 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:40.494908 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:40.494908 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:40.494908 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:40.494908 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:40.494908 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:40.494908 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 31 14:30:40.494908 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 14:30:40.494908 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 31 14:30:40.494908 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:30:40.498026 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 407/815] 10.222.0.15 () {56 vars in 1111 bytes} [Tue May 31 14:30:40 2022] GET /identity/v3/services/network => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:40.498631 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8422919-320b-494b-89d2-a33342c4c39d None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:40.553120 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282c4e2d-8423-4308-b8a1-bdfb00c127d2 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:40.600044 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49de2a67-a104-4e22-a7a6-4e638da2046b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:40.601765 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49de2a67-a104-4e22-a7a6-4e638da2046b None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:40.602355 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49de2a67-a104-4e22-a7a6-4e638da2046b None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:40.603066 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49de2a67-a104-4e22-a7a6-4e638da2046b None admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:40.604371 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49de2a67-a104-4e22-a7a6-4e638da2046b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:40.604904 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49de2a67-a104-4e22-a7a6-4e638da2046b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:40.606885 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49de2a67-a104-4e22-a7a6-4e638da2046b None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:40.626688 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8422919-320b-494b-89d2-a33342c4c39d None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:40.634580 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 409/816] 10.222.0.15 () {56 vars in 1149 bytes} [Tue May 31 14:30:40 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:40.634580 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49de2a67-a104-4e22-a7a6-4e638da2046b None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:40.676727 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a1783f-a617-4a86-bcca-5a5fa830de59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:40.677845 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a1783f-a617-4a86-bcca-5a5fa830de59 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:40.678174 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a1783f-a617-4a86-bcca-5a5fa830de59 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:40.678453 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a1783f-a617-4a86-bcca-5a5fa830de59 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:40.687112 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:40.690167 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a1783f-a617-4a86-bcca-5a5fa830de59 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:40.692248 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a1783f-a617-4a86-bcca-5a5fa830de59 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:40.710943 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-96a1783f-a617-4a86-bcca-5a5fa830de59 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 31 14:30:40.710943 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:40.710943 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:40.710943 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:40.710943 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:40.710943 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:40.710943 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:40.710943 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:40.710943 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:40.710943 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:40.710943 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:40.710943 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:40.710943 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 14:30:40.710943 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 14:30:40.710943 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 14:30:40.710943 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 14:30:40.711940 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:40.711940 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:40.711940 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 14:30:40.711940 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 14:30:40.711940 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 14:30:40.711940 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 14:30:40.711940 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:40.711940 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:40.711940 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:40.711940 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:40.711940 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:40.711940 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:30:40.711940 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:40.711940 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:40.711940 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:40.711940 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:40.711940 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:40.711940 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:40.712896 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:40.712896 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:40.712896 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 14:30:40.712896 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 14:30:40.712896 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 14:30:40.712896 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 14:30:40.712896 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 14:30:40.712896 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 14:30:40.712896 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 31 14:30:40.712896 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:30:40.712896 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 408/817] 10.222.0.15 () {56 vars in 1093 bytes} [Tue May 31 14:30:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:40.713486 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a1783f-a617-4a86-bcca-5a5fa830de59 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:40.773676 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:40.778843 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49de2a67-a104-4e22-a7a6-4e638da2046b None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:40.825295 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db8ce42-ef6b-4ee1-bd87-eff6fd560081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:40.825972 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db8ce42-ef6b-4ee1-bd87-eff6fd560081 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:40.826256 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db8ce42-ef6b-4ee1-bd87-eff6fd560081 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:40.826535 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db8ce42-ef6b-4ee1-bd87-eff6fd560081 None admin] PATH_INFO: `/v3/services` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:40.827271 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db8ce42-ef6b-4ee1-bd87-eff6fd560081 None admin] RBAC: Adding query filter params (name=network) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:40.827586 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db8ce42-ef6b-4ee1-bd87-eff6fd560081 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:40.828949 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db8ce42-ef6b-4ee1-bd87-eff6fd560081 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:40.836651 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 410/818] 10.222.0.15 () {56 vars in 1112 bytes} [Tue May 31 14:30:40 2022] GET /identity/v3/services?name=network => generated 124 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:40.838121 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db8ce42-ef6b-4ee1-bd87-eff6fd560081 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:40.854025 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a1783f-a617-4a86-bcca-5a5fa830de59 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:40.896188 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48565d0c-07ae-417d-a31a-8d3f84823283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:40.897441 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48565d0c-07ae-417d-a31a-8d3f84823283 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:40.898004 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48565d0c-07ae-417d-a31a-8d3f84823283 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:40.898451 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48565d0c-07ae-417d-a31a-8d3f84823283 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:40.910686 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48565d0c-07ae-417d-a31a-8d3f84823283 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:40.912193 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48565d0c-07ae-417d-a31a-8d3f84823283 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:40.930365 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-48565d0c-07ae-417d-a31a-8d3f84823283 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:40.930365 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:40.930365 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:40.930365 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:40.930365 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:40.930365 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:40.930365 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:40.930365 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:40.930365 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:40.930365 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:40.930365 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:40.930365 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:40.930365 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 14:30:40.930365 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 14:30:40.930365 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 14:30:40.931317 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 14:30:40.931317 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:40.931317 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:40.931317 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:40.931317 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:40.931317 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:40.931317 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:40.931317 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:40.931317 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:30:40.931317 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:40.931317 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:40.931317 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:40.931317 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:40.931317 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:40.931317 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:40.931317 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:40.931317 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:40.932286 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 14:30:40.932286 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 14:30:40.932286 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:40.932286 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:30:40.935964 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 409/819] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:30:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:40.936841 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48565d0c-07ae-417d-a31a-8d3f84823283 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:40.969879 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db8ce42-ef6b-4ee1-bd87-eff6fd560081 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:40.971552 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:41.019772 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de92fc9-a08a-4403-9789-b18d13ed1a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:41.021126 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de92fc9-a08a-4403-9789-b18d13ed1a55 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:41.021919 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de92fc9-a08a-4403-9789-b18d13ed1a55 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:41.022273 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de92fc9-a08a-4403-9789-b18d13ed1a55 None admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:41.023496 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de92fc9-a08a-4403-9789-b18d13ed1a55 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:41.023875 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de92fc9-a08a-4403-9789-b18d13ed1a55 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:41.025416 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de92fc9-a08a-4403-9789-b18d13ed1a55 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:41.049382 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 411/820] 10.222.0.15 () {56 vars in 1133 bytes} [Tue May 31 14:30:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:41.050389 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de92fc9-a08a-4403-9789-b18d13ed1a55 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:41.064206 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:41.068121 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48565d0c-07ae-417d-a31a-8d3f84823283 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:41.107800 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878aee65-cd26-4a10-a75a-463249319a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:41.108798 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878aee65-cd26-4a10-a75a-463249319a5d None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:41.109262 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878aee65-cd26-4a10-a75a-463249319a5d None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:41.109718 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878aee65-cd26-4a10-a75a-463249319a5d None admin] PATH_INFO: `/v3/services` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:41.110688 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878aee65-cd26-4a10-a75a-463249319a5d None admin] RBAC: Adding query filter params (type=network) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:41.111198 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878aee65-cd26-4a10-a75a-463249319a5d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:41.112890 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878aee65-cd26-4a10-a75a-463249319a5d None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:41.118473 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 410/821] 10.222.0.15 () {56 vars in 1112 bytes} [Tue May 31 14:30:40 2022] GET /identity/v3/services?type=network => generated 350 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:41.119594 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878aee65-cd26-4a10-a75a-463249319a5d None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:41.195342 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de92fc9-a08a-4403-9789-b18d13ed1a55 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:41.232901 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f522e6e3-87ca-4ec3-ac97-a2c3b27ab418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:41.233561 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f522e6e3-87ca-4ec3-ac97-a2c3b27ab418 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:41.233847 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f522e6e3-87ca-4ec3-ac97-a2c3b27ab418 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:41.234124 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f522e6e3-87ca-4ec3-ac97-a2c3b27ab418 None admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:41.234879 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f522e6e3-87ca-4ec3-ac97-a2c3b27ab418 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:41.235186 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f522e6e3-87ca-4ec3-ac97-a2c3b27ab418 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:41.236555 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f522e6e3-87ca-4ec3-ac97-a2c3b27ab418 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:41.247677 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878aee65-cd26-4a10-a75a-463249319a5d None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:41.249119 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 412/822] 10.222.0.15 () {56 vars in 1109 bytes} [Tue May 31 14:30:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:41.250046 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f522e6e3-87ca-4ec3-ac97-a2c3b27ab418 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:41.275169 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:41.302960 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc2d061-7b1d-472b-b766-9be26e629e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:41.303764 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc2d061-7b1d-472b-b766-9be26e629e80 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:41.304320 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc2d061-7b1d-472b-b766-9be26e629e80 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:41.304693 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc2d061-7b1d-472b-b766-9be26e629e80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:41.339901 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:41.377402 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f522e6e3-87ca-4ec3-ac97-a2c3b27ab418 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:41.378452 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc2d061-7b1d-472b-b766-9be26e629e80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:41.379989 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc2d061-7b1d-472b-b766-9be26e629e80 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:41.418328 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b38856-a1ca-42e2-84bd-9459b7cdc7fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:41.419024 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b38856-a1ca-42e2-84bd-9459b7cdc7fb None admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:41.419311 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b38856-a1ca-42e2-84bd-9459b7cdc7fb None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:41.419588 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b38856-a1ca-42e2-84bd-9459b7cdc7fb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:41.420737 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b38856-a1ca-42e2-84bd-9459b7cdc7fb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:41.422462 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b38856-a1ca-42e2-84bd-9459b7cdc7fb None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:41.479500 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 411/823] 10.222.0.15 () {58 vars in 1282 bytes} [Tue May 31 14:30:41 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 31 14:30:41.480963 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc2d061-7b1d-472b-b766-9be26e629e80 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:41.507931 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 413/824] 10.222.0.15 () {60 vars in 1144 bytes} [Tue May 31 14:30:41 2022] POST /identity/v3/endpoints => generated 327 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:30:41.510516 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed561c3-8cdd-443c-84e4-774aced760ae None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:41.510808 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed561c3-8cdd-443c-84e4-774aced760ae None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:41.511096 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed561c3-8cdd-443c-84e4-774aced760ae None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:41.512632 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 414/825] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:30:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:30:41.513468 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed561c3-8cdd-443c-84e4-774aced760ae None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:41.560985 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:41.603201 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc2d061-7b1d-472b-b766-9be26e629e80 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:41.620241 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:41.651489 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c05ba9-5e87-456e-bba2-0a1c0a7e0818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:41.652460 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c05ba9-5e87-456e-bba2-0a1c0a7e0818 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:41.652943 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c05ba9-5e87-456e-bba2-0a1c0a7e0818 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:41.653442 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c05ba9-5e87-456e-bba2-0a1c0a7e0818 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:41.655010 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed561c3-8cdd-443c-84e4-774aced760ae None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:41.661906 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c05ba9-5e87-456e-bba2-0a1c0a7e0818 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:41.663571 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c05ba9-5e87-456e-bba2-0a1c0a7e0818 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:41.679819 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-13c05ba9-5e87-456e-bba2-0a1c0a7e0818 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 14:30:41.679819 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:41.679819 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:41.679819 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:41.679819 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:41.679819 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:41.679819 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:41.679819 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:41.679819 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:41.679819 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:41.679819 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:41.679819 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:41.679819 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 14:30:41.679819 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 14:30:41.679819 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 14:30:41.681287 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 14:30:41.681287 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:41.681287 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:41.681287 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:41.681287 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:41.681287 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:41.681287 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:41.681287 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:41.681287 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:30:41.681287 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:41.681287 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:41.681287 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:41.681287 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:41.681287 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:41.681287 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:41.681287 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:41.681287 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:41.682212 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 14:30:41.682212 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 14:30:41.682212 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 14:30:41.682212 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 14:30:41.682212 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 14:30:41.682212 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 14:30:41.682212 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 14:30:41.682212 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:30:41.682212 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 412/826] 10.222.0.15 () {56 vars in 1111 bytes} [Tue May 31 14:30:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:41.687461 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf89c85-7d81-4b84-be0b-1c7b444041b7 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:41.687461 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf89c85-7d81-4b84-be0b-1c7b444041b7 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:41.687461 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf89c85-7d81-4b84-be0b-1c7b444041b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:41.697682 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d6f22c-78e0-4267-a921-4e2bebab98f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:41.698503 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d6f22c-78e0-4267-a921-4e2bebab98f3 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:41.699022 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d6f22c-78e0-4267-a921-4e2bebab98f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:41.699308 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d6f22c-78e0-4267-a921-4e2bebab98f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:41.703915 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-4cf89c85-7d81-4b84-be0b-1c7b444041b7 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:30:41.705280 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-4cf89c85-7d81-4b84-be0b-1c7b444041b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:30:41.712964 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d6f22c-78e0-4267-a921-4e2bebab98f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:41.714429 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d6f22c-78e0-4267-a921-4e2bebab98f3 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:41.742651 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-55d6f22c-78e0-4267-a921-4e2bebab98f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:41.742651 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:41.742651 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:41.742651 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:41.742651 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:41.742651 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:41.742651 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:41.742651 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:41.742651 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:41.742651 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:41.742651 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:41.742651 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:41.742651 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 14:30:41.742651 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 14:30:41.742651 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 14:30:41.744736 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 14:30:41.744736 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:41.744736 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:41.744736 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:41.744736 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:41.744736 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:41.744736 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:41.744736 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:41.744736 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:30:41.744736 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:41.744736 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:41.744736 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:41.744736 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:41.744736 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:41.744736 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:41.744736 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:41.744736 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:41.746917 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 14:30:41.746917 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 14:30:41.746917 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:41.746917 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:30:41.746917 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 415/827] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:30:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:41.746917 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d6f22c-78e0-4267-a921-4e2bebab98f3 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:41.794576 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 413/828] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:30:41 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 14:30:41.794576 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf89c85-7d81-4b84-be0b-1c7b444041b7 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:41.850854 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:41.885344 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d6f22c-78e0-4267-a921-4e2bebab98f3 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:41.906882 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf89c85-7d81-4b84-be0b-1c7b444041b7 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:41.913202 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:41.921296 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6de9236-14fe-4618-b5ff-1afd672d8ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:41.921961 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6de9236-14fe-4618-b5ff-1afd672d8ab1 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:41.922361 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6de9236-14fe-4618-b5ff-1afd672d8ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:41.922666 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6de9236-14fe-4618-b5ff-1afd672d8ab1 None admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:41.923580 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6de9236-14fe-4618-b5ff-1afd672d8ab1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:41.923892 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6de9236-14fe-4618-b5ff-1afd672d8ab1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:41.925347 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6de9236-14fe-4618-b5ff-1afd672d8ab1 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:41.943383 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 416/829] 10.222.0.15 () {56 vars in 1148 bytes} [Tue May 31 14:30:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:41.943383 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6de9236-14fe-4618-b5ff-1afd672d8ab1 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:41.949733 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422fa5f4-92c2-404c-ad0b-4f283192cce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:41.950417 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422fa5f4-92c2-404c-ad0b-4f283192cce6 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:41.951164 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422fa5f4-92c2-404c-ad0b-4f283192cce6 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:41.951449 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422fa5f4-92c2-404c-ad0b-4f283192cce6 None admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:41.952589 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422fa5f4-92c2-404c-ad0b-4f283192cce6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:41.952905 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422fa5f4-92c2-404c-ad0b-4f283192cce6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:41.954597 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422fa5f4-92c2-404c-ad0b-4f283192cce6 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:41.970722 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 414/830] 10.222.0.15 () {56 vars in 1109 bytes} [Tue May 31 14:30:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:41.971862 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422fa5f4-92c2-404c-ad0b-4f283192cce6 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:42.053190 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6de9236-14fe-4618-b5ff-1afd672d8ab1 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:42.081779 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422fa5f4-92c2-404c-ad0b-4f283192cce6 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:42.092636 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb563928-2d63-4dba-b865-996c6fc3ca91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:42.093446 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb563928-2d63-4dba-b865-996c6fc3ca91 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:42.093737 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb563928-2d63-4dba-b865-996c6fc3ca91 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:42.094007 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:42.094115 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb563928-2d63-4dba-b865-996c6fc3ca91 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:42.094817 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb563928-2d63-4dba-b865-996c6fc3ca91 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:42.096252 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb563928-2d63-4dba-b865-996c6fc3ca91 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:42.109564 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-eb563928-2d63-4dba-b865-996c6fc3ca91 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 31 14:30:42.109564 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:42.109564 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 31 14:30:42.109564 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 31 14:30:42.109564 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 31 14:30:42.109564 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 31 14:30:42.109564 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 31 14:30:42.109564 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 14:30:42.109564 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 31 14:30:42.109564 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:30:42.109564 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 31 14:30:42.109564 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:30:42.109564 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:42.109564 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:42.109564 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:42.109564 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:42.109564 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:42.110775 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:42.110775 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:42.110775 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:42.110775 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:42.110775 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:42.110775 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:42.110775 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 31 14:30:42.110775 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_service(service_id) May 31 14:30:42.110775 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 31 14:30:42.110775 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 31 14:30:42.110775 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:42.110775 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:42.110775 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:42.110775 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:42.110775 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:42.110775 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:42.111637 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:42.111637 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:30:42.111637 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:42.111637 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:42.111637 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:42.111637 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:42.111637 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:42.111637 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:42.111637 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:42.111637 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:42.111637 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 31 14:30:42.111637 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 14:30:42.111637 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 31 14:30:42.111637 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:30:42.111637 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 417/831] 10.222.0.15 () {56 vars in 1114 bytes} [Tue May 31 14:30:41 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:42.112425 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb563928-2d63-4dba-b865-996c6fc3ca91 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:42.123134 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a9f6b7-7cd0-44d6-b852-f82ee951fdbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:42.124056 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a9f6b7-7cd0-44d6-b852-f82ee951fdbe None admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:42.124341 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a9f6b7-7cd0-44d6-b852-f82ee951fdbe None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:42.124618 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a9f6b7-7cd0-44d6-b852-f82ee951fdbe None admin] PATH_INFO: `/v3/projects/ffff4334538649fdba1beb80cad207fa/users/735d2518c8404bd991acee533b314039/roles/4fa2a9add9bc4786a62e7b5cae3cc051` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:42.141190 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a9f6b7-7cd0-44d6-b852-f82ee951fdbe None admin] RBAC: Authorizing `identity:create_grant(project_id=ffff4334538649fdba1beb80cad207fa, user_id=735d2518c8404bd991acee533b314039, role_id=4fa2a9add9bc4786a62e7b5cae3cc051)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:42.142673 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a9f6b7-7cd0-44d6-b852-f82ee951fdbe None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:42.173922 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:42.213325 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 415/832] 10.222.0.15 () {58 vars in 1439 bytes} [Tue May 31 14:30:41 2022] PUT /identity/v3/projects/ffff4334538649fdba1beb80cad207fa/users/735d2518c8404bd991acee533b314039/roles/4fa2a9add9bc4786a62e7b5cae3cc051 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:30:42.214519 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a9f6b7-7cd0-44d6-b852-f82ee951fdbe None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:42.238294 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb563928-2d63-4dba-b865-996c6fc3ca91 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:42.279988 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bf6de5-e3d0-4583-8de7-faa83e1323da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:42.281674 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bf6de5-e3d0-4583-8de7-faa83e1323da None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:42.282144 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bf6de5-e3d0-4583-8de7-faa83e1323da None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:42.282900 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bf6de5-e3d0-4583-8de7-faa83e1323da None admin] PATH_INFO: `/v3/projects/service` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:42.300748 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bf6de5-e3d0-4583-8de7-faa83e1323da None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:42.304664 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bf6de5-e3d0-4583-8de7-faa83e1323da None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:42.326228 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-04bf6de5-e3d0-4583-8de7-faa83e1323da None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 14:30:42.326228 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:42.326228 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:42.326228 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:42.326228 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:42.326228 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:42.326228 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:42.326228 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:42.326228 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:42.326228 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:42.326228 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:42.326228 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:42.326228 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 14:30:42.326228 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 14:30:42.326228 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 14:30:42.327458 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 14:30:42.327458 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:42.327458 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:42.327458 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:42.327458 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:42.327458 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:42.327458 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:42.327458 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:42.327458 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:30:42.327458 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:42.327458 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:42.327458 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:42.327458 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:42.327458 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:42.327458 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:42.327458 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:42.327458 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:42.328581 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 14:30:42.328581 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 14:30:42.328581 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 14:30:42.328581 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 14:30:42.328581 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 14:30:42.328581 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 14:30:42.328581 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 14:30:42.328581 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:30:42.334964 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 418/833] 10.222.0.15 () {56 vars in 1111 bytes} [Tue May 31 14:30:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:42.336249 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bf6de5-e3d0-4583-8de7-faa83e1323da None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:42.356215 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a9f6b7-7cd0-44d6-b852-f82ee951fdbe None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:42.412386 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4553bbe-2269-45f8-b97d-078e4b0f0552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:42.413067 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4553bbe-2269-45f8-b97d-078e4b0f0552 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:42.413353 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4553bbe-2269-45f8-b97d-078e4b0f0552 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:42.413629 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4553bbe-2269-45f8-b97d-078e4b0f0552 None admin] PATH_INFO: `/v3/services` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:42.414347 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4553bbe-2269-45f8-b97d-078e4b0f0552 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:42.414705 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4553bbe-2269-45f8-b97d-078e4b0f0552 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:42.416121 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4553bbe-2269-45f8-b97d-078e4b0f0552 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:42.422592 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 416/834] 10.222.0.15 () {56 vars in 1114 bytes} [Tue May 31 14:30:42 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:42.427948 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4553bbe-2269-45f8-b97d-078e4b0f0552 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:42.460030 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:42.467270 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bf6de5-e3d0-4583-8de7-faa83e1323da None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:42.484038 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:42.504095 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e3345d-5f79-4eb9-b787-9db97e335db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:42.504784 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e3345d-5f79-4eb9-b787-9db97e335db4 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:42.505067 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e3345d-5f79-4eb9-b787-9db97e335db4 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:42.505342 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e3345d-5f79-4eb9-b787-9db97e335db4 None admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:42.506123 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e3345d-5f79-4eb9-b787-9db97e335db4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:42.506453 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e3345d-5f79-4eb9-b787-9db97e335db4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:42.507941 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e3345d-5f79-4eb9-b787-9db97e335db4 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:42.520351 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 419/835] 10.222.0.15 () {56 vars in 1148 bytes} [Tue May 31 14:30:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:42.521865 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9cca9d-b22b-48b1-b3e5-7008750703b9 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:42.522343 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9cca9d-b22b-48b1-b3e5-7008750703b9 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:42.522892 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9cca9d-b22b-48b1-b3e5-7008750703b9 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:42.524469 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 420/836] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:30:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:30:42.528487 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9cca9d-b22b-48b1-b3e5-7008750703b9 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:42.549284 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4553bbe-2269-45f8-b97d-078e4b0f0552 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:42.584896 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df3f12e-b0f2-4365-af05-85eeda2039cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:42.585783 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df3f12e-b0f2-4365-af05-85eeda2039cf None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:42.586218 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df3f12e-b0f2-4365-af05-85eeda2039cf None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:42.586673 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df3f12e-b0f2-4365-af05-85eeda2039cf None admin] PATH_INFO: `/v3/services` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:42.587518 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df3f12e-b0f2-4365-af05-85eeda2039cf None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:42.588013 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df3f12e-b0f2-4365-af05-85eeda2039cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:42.589382 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df3f12e-b0f2-4365-af05-85eeda2039cf None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:42.602575 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 417/837] 10.222.0.15 () {56 vars in 1114 bytes} [Tue May 31 14:30:42 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 14:30:42.602575 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ec063-1388-413a-aaa9-acab972927e5 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:42.602575 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ec063-1388-413a-aaa9-acab972927e5 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:42.602575 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ec063-1388-413a-aaa9-acab972927e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:42.625647 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-311ec063-1388-413a-aaa9-acab972927e5 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:30:42.627062 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-311ec063-1388-413a-aaa9-acab972927e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:30:42.688596 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9cca9d-b22b-48b1-b3e5-7008750703b9 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:42.713861 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 418/838] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:30:42 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 14:30:42.736732 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311ec063-1388-413a-aaa9-acab972927e5 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:42.737168 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4df595-82d9-4089-b972-656492489cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:42.738052 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4df595-82d9-4089-b972-656492489cef None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:42.738477 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4df595-82d9-4089-b972-656492489cef None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:42.739600 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4df595-82d9-4089-b972-656492489cef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:42.741042 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4df595-82d9-4089-b972-656492489cef None admin] RBAC: Adding query filter params (role.id=76c53e2c353644f885028a0226c06146, scope.project.id=ffff4334538649fdba1beb80cad207fa, user.id=b57768d448e345ad8879bf29f21b48ea) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:42.742519 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4df595-82d9-4089-b972-656492489cef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:42.744325 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4df595-82d9-4089-b972-656492489cef None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:42.753788 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 421/839] 10.222.0.15 () {56 vars in 1374 bytes} [Tue May 31 14:30:42 2022] GET /identity/v3/role_assignments?user.id=b57768d448e345ad8879bf29f21b48ea&scope.project.id=ffff4334538649fdba1beb80cad207fa&role.id=76c53e2c353644f885028a0226c06146 => generated 608 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:42.763583 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:42.874336 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311ec063-1388-413a-aaa9-acab972927e5 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:42.914004 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631ff87b-57f4-444b-a7e6-190331deb1cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:42.914860 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ff87b-57f4-444b-a7e6-190331deb1cc None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:42.915148 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ff87b-57f4-444b-a7e6-190331deb1cc None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:42.915429 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ff87b-57f4-444b-a7e6-190331deb1cc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:42.927640 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631ff87b-57f4-444b-a7e6-190331deb1cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 14:30:42.935792 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-631ff87b-57f4-444b-a7e6-190331deb1cc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 31 14:30:42.935792 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:42.935792 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:42.935792 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:42.935792 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:42.935792 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:42.935792 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:42.935792 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:42.935792 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:42.935792 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:42.935792 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:42.935792 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:42.935792 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 14:30:42.935792 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 14:30:42.935792 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 14:30:42.935792 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 14:30:42.936917 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 14:30:42.936917 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 14:30:42.936917 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 14:30:42.936917 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 14:30:42.936917 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:42.936917 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:42.936917 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:42.936917 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:42.936917 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:42.936917 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:42.936917 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:42.936917 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:30:42.936917 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:42.936917 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:42.936917 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:42.936917 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:42.938041 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:42.938041 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:42.938041 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:42.938041 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:42.938041 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 14:30:42.938041 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 14:30:42.938041 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 14:30:42.938041 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 14:30:42.938041 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 14:30:42.938041 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 14:30:42.938041 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 31 14:30:42.938041 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:30:42.938041 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 419/840] 10.222.0.15 () {56 vars in 1096 bytes} [Tue May 31 14:30:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 14:30:42.945549 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4df595-82d9-4089-b972-656492489cef None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:42.992269 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:43.063064 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4df595-82d9-4089-b972-656492489cef None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:43.102264 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce1ed42-dc12-4b76-bd7b-35594834c3f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:43.103200 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce1ed42-dc12-4b76-bd7b-35594834c3f2 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:43.103628 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce1ed42-dc12-4b76-bd7b-35594834c3f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:43.104068 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce1ed42-dc12-4b76-bd7b-35594834c3f2 None admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:43.105005 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce1ed42-dc12-4b76-bd7b-35594834c3f2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:43.105462 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce1ed42-dc12-4b76-bd7b-35594834c3f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:43.107050 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce1ed42-dc12-4b76-bd7b-35594834c3f2 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:43.116928 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 422/841] 10.222.0.15 () {56 vars in 1099 bytes} [Tue May 31 14:30:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:43.122205 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631ff87b-57f4-444b-a7e6-190331deb1cc None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:43.213020 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:43.239319 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631ff87b-57f4-444b-a7e6-190331deb1cc None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:43.289942 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c198523-d33c-49af-b273-9d48e9e79f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:43.289942 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c198523-d33c-49af-b273-9d48e9e79f6f None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:43.289942 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c198523-d33c-49af-b273-9d48e9e79f6f None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:43.289942 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c198523-d33c-49af-b273-9d48e9e79f6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:43.306583 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c198523-d33c-49af-b273-9d48e9e79f6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:43.306583 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c198523-d33c-49af-b273-9d48e9e79f6f None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:43.323022 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-8c198523-d33c-49af-b273-9d48e9e79f6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:43.323022 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:43.323022 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:43.323022 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:43.323022 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:43.323022 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:43.323022 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:43.323022 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:43.323022 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:43.323022 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:43.323022 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:43.323022 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:43.323022 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 14:30:43.323022 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 14:30:43.323022 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 14:30:43.323916 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 14:30:43.323916 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:43.323916 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:43.323916 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:43.323916 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:43.323916 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:43.323916 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:43.323916 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:43.323916 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:30:43.323916 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:43.323916 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:43.323916 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:43.323916 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:43.323916 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:43.323916 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:43.323916 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:43.323916 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:43.324797 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 14:30:43.324797 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 14:30:43.324797 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:43.324797 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:30:43.325637 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 420/842] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:30:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:43.333668 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce1ed42-dc12-4b76-bd7b-35594834c3f2 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:43.454342 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:43.459257 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce1ed42-dc12-4b76-bd7b-35594834c3f2 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:43.495846 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fd72bf-9538-484e-aa7d-b27141724864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:43.497420 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fd72bf-9538-484e-aa7d-b27141724864 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:43.497928 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fd72bf-9538-484e-aa7d-b27141724864 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:43.498396 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fd72bf-9538-484e-aa7d-b27141724864 None admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:43.499357 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fd72bf-9538-484e-aa7d-b27141724864 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:43.499857 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fd72bf-9538-484e-aa7d-b27141724864 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:43.501460 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fd72bf-9538-484e-aa7d-b27141724864 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:43.518680 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 423/843] 10.222.0.15 () {56 vars in 1109 bytes} [Tue May 31 14:30:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:43.520880 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c198523-d33c-49af-b273-9d48e9e79f6f None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:43.641309 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c198523-d33c-49af-b273-9d48e9e79f6f None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:43.675885 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:43.685101 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb550cc-9d50-417d-9a89-ade5addcd979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:43.685101 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb550cc-9d50-417d-9a89-ade5addcd979 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:43.685101 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb550cc-9d50-417d-9a89-ade5addcd979 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:43.685101 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb550cc-9d50-417d-9a89-ade5addcd979 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:43.693846 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb550cc-9d50-417d-9a89-ade5addcd979 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:43.695500 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb550cc-9d50-417d-9a89-ade5addcd979 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:43.714602 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-6cb550cc-9d50-417d-9a89-ade5addcd979 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 31 14:30:43.714602 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:43.714602 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:43.714602 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:43.714602 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:43.714602 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:43.714602 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:43.714602 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:43.714602 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:43.714602 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:43.714602 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:43.714602 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:43.714602 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 14:30:43.714602 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 14:30:43.714602 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 14:30:43.714602 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 14:30:43.715778 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:43.715778 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:43.715778 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 14:30:43.715778 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 14:30:43.715778 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 14:30:43.715778 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 14:30:43.715778 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:43.715778 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:43.715778 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:43.715778 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:43.715778 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:43.715778 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:30:43.715778 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:43.715778 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:43.715778 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:43.715778 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:43.715778 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:43.715778 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:43.716736 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:43.716736 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:43.716736 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 14:30:43.716736 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 14:30:43.716736 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 14:30:43.716736 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 14:30:43.716736 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 14:30:43.716736 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 14:30:43.716736 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 31 14:30:43.716736 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:30:43.716736 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 421/844] 10.222.0.15 () {56 vars in 1096 bytes} [Tue May 31 14:30:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:43.719380 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fd72bf-9538-484e-aa7d-b27141724864 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:43.829288 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fd72bf-9538-484e-aa7d-b27141724864 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:43.867798 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a811485-d35f-46e3-9cb4-cbfa230cb67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:43.868499 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a811485-d35f-46e3-9cb4-cbfa230cb67b None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:43.868783 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a811485-d35f-46e3-9cb4-cbfa230cb67b None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:43.869059 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a811485-d35f-46e3-9cb4-cbfa230cb67b None admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:43.869899 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a811485-d35f-46e3-9cb4-cbfa230cb67b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:43.870207 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a811485-d35f-46e3-9cb4-cbfa230cb67b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:43.871662 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a811485-d35f-46e3-9cb4-cbfa230cb67b None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:43.891142 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 424/845] 10.222.0.15 () {56 vars in 1135 bytes} [Tue May 31 14:30:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:43.903691 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb550cc-9d50-417d-9a89-ade5addcd979 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:44.046537 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb550cc-9d50-417d-9a89-ade5addcd979 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:44.095862 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ecabff-e5ab-4bd9-8706-51030331e4da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:44.095862 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ecabff-e5ab-4bd9-8706-51030331e4da None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:44.096448 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ecabff-e5ab-4bd9-8706-51030331e4da None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:44.096448 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ecabff-e5ab-4bd9-8706-51030331e4da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:44.172664 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:44.185449 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ecabff-e5ab-4bd9-8706-51030331e4da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:44.187149 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ecabff-e5ab-4bd9-8706-51030331e4da None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:44.298527 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 422/846] 10.222.0.15 () {58 vars in 1282 bytes} [Tue May 31 14:30:43 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 31 14:30:44.304383 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a811485-d35f-46e3-9cb4-cbfa230cb67b None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:44.347329 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:44.518583 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a811485-d35f-46e3-9cb4-cbfa230cb67b None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:44.574147 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074898c8-2bb6-4b67-a947-a697315d8bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:44.575622 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074898c8-2bb6-4b67-a947-a697315d8bf2 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:44.575622 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074898c8-2bb6-4b67-a947-a697315d8bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:44.575622 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074898c8-2bb6-4b67-a947-a697315d8bf2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:44.598687 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074898c8-2bb6-4b67-a947-a697315d8bf2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:44.602570 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074898c8-2bb6-4b67-a947-a697315d8bf2 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:44.637615 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-074898c8-2bb6-4b67-a947-a697315d8bf2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:44.637615 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:44.637615 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:44.637615 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:44.637615 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:44.637615 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:44.637615 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:44.637615 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:44.637615 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:44.637615 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:44.637615 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:44.637615 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:44.637615 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 14:30:44.637615 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 14:30:44.637615 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 14:30:44.638682 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 14:30:44.638682 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:44.638682 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:44.638682 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:44.638682 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:44.638682 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:44.638682 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:44.638682 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:44.638682 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:30:44.638682 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:44.638682 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:44.638682 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:44.638682 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:44.638682 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:44.638682 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:44.638682 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:44.638682 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:44.639662 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 14:30:44.639662 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 14:30:44.639662 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:44.639662 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:30:44.646571 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 425/847] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:30:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:44.650587 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ecabff-e5ab-4bd9-8706-51030331e4da None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:44.780247 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a8265a-aa8a-4377-b262-99a3b817d8b7 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:44.780557 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a8265a-aa8a-4377-b262-99a3b817d8b7 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:44.781007 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a8265a-aa8a-4377-b262-99a3b817d8b7 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:44.786925 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 426/848] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:30:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:30:44.792170 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda2ec4a-fc42-473a-832f-6c0059f9f1f2 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:44.792464 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda2ec4a-fc42-473a-832f-6c0059f9f1f2 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:44.792746 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda2ec4a-fc42-473a-832f-6c0059f9f1f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:44.823835 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:44.843355 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-fda2ec4a-fc42-473a-832f-6c0059f9f1f2 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:30:44.846060 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-fda2ec4a-fc42-473a-832f-6c0059f9f1f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:30:44.851403 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ecabff-e5ab-4bd9-8706-51030331e4da None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:44.913895 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761bdea6-ee7e-4594-ae60-9ab129ed80d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:44.915738 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761bdea6-ee7e-4594-ae60-9ab129ed80d1 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:44.916022 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761bdea6-ee7e-4594-ae60-9ab129ed80d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:44.916298 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761bdea6-ee7e-4594-ae60-9ab129ed80d1 None admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:44.917022 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761bdea6-ee7e-4594-ae60-9ab129ed80d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:44.917336 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761bdea6-ee7e-4594-ae60-9ab129ed80d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:44.918936 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761bdea6-ee7e-4594-ae60-9ab129ed80d1 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:44.946438 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 423/849] 10.222.0.15 () {56 vars in 1109 bytes} [Tue May 31 14:30:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:44.951973 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761bdea6-ee7e-4594-ae60-9ab129ed80d1 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:44.989417 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:44.997335 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 427/850] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:30:44 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 31 14:30:45.033996 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda2ec4a-fc42-473a-832f-6c0059f9f1f2 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:45.141000 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761bdea6-ee7e-4594-ae60-9ab129ed80d1 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:45.205350 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c493ba-1666-4414-bdf8-b32c0e9e8f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:45.209069 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c493ba-1666-4414-bdf8-b32c0e9e8f23 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:45.209363 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c493ba-1666-4414-bdf8-b32c0e9e8f23 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:45.209648 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c493ba-1666-4414-bdf8-b32c0e9e8f23 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:45.210134 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda2ec4a-fc42-473a-832f-6c0059f9f1f2 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:45.218986 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c493ba-1666-4414-bdf8-b32c0e9e8f23 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:45.220569 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c493ba-1666-4414-bdf8-b32c0e9e8f23 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:45.236215 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-46c493ba-1666-4414-bdf8-b32c0e9e8f23 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 14:30:45.236215 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:45.236215 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:45.236215 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:45.236215 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:45.236215 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:45.236215 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:45.236215 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:45.236215 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:45.236215 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:45.236215 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:45.236215 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:45.236215 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 14:30:45.236215 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 14:30:45.236215 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 14:30:45.237237 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 14:30:45.237237 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:45.237237 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:45.237237 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:45.237237 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:45.237237 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:45.237237 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:45.237237 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:45.237237 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:30:45.237237 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:45.237237 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:45.237237 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:45.237237 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:45.237237 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:45.237237 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:45.237237 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:45.237237 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:45.238212 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 14:30:45.238212 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 14:30:45.238212 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 14:30:45.238212 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 14:30:45.238212 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 14:30:45.238212 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 14:30:45.238212 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 14:30:45.238212 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:30:45.241850 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 424/851] 10.222.0.15 () {56 vars in 1111 bytes} [Tue May 31 14:30:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 14:30:45.243693 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e2e954-3207-4f91-9a0a-06e478209769 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:45.244250 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e2e954-3207-4f91-9a0a-06e478209769 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:45.244738 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e2e954-3207-4f91-9a0a-06e478209769 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:45.246378 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 425/852] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:30:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:30:45.247433 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e2e954-3207-4f91-9a0a-06e478209769 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:45.263848 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402bb6cc-2565-452d-84ca-853f5a5304f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:45.264761 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402bb6cc-2565-452d-84ca-853f5a5304f5 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:45.265039 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402bb6cc-2565-452d-84ca-853f5a5304f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:45.265320 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402bb6cc-2565-452d-84ca-853f5a5304f5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:45.275054 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:45.279882 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402bb6cc-2565-452d-84ca-853f5a5304f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 14:30:45.288041 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-402bb6cc-2565-452d-84ca-853f5a5304f5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 31 14:30:45.288041 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:45.288041 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:45.288041 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:45.288041 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:45.288041 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:45.288041 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:45.288041 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:45.288041 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:45.288041 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:45.288041 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:45.288041 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:45.288041 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 14:30:45.288041 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 14:30:45.288041 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 14:30:45.288041 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 14:30:45.293019 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 14:30:45.293019 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 14:30:45.293019 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 14:30:45.293019 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 14:30:45.293019 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:45.293019 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:45.293019 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:45.293019 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:45.293019 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:45.293019 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:45.293019 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:45.293019 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:30:45.293019 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:45.293019 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:45.293019 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:45.293019 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:45.293886 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:45.293886 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:45.293886 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:45.293886 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:45.293886 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 14:30:45.293886 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 14:30:45.293886 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 14:30:45.293886 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 14:30:45.293886 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 14:30:45.293886 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 14:30:45.293886 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 31 14:30:45.293886 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:30:45.293886 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 428/853] 10.222.0.15 () {56 vars in 1102 bytes} [Tue May 31 14:30:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:45.293886 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adcb1c4-ffbb-447e-b0e4-7c5d44a1baf1 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:45.295181 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adcb1c4-ffbb-447e-b0e4-7c5d44a1baf1 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:45.295181 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adcb1c4-ffbb-447e-b0e4-7c5d44a1baf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:45.314866 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-0adcb1c4-ffbb-447e-b0e4-7c5d44a1baf1 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:30:45.316236 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-0adcb1c4-ffbb-447e-b0e4-7c5d44a1baf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:30:45.390016 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:45.405179 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e2e954-3207-4f91-9a0a-06e478209769 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:45.413378 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 429/854] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:30:45 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 14:30:45.413378 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adcb1c4-ffbb-447e-b0e4-7c5d44a1baf1 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:45.454906 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584ecd78-2270-4c06-aa45-37ac8c0c26b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:45.455821 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584ecd78-2270-4c06-aa45-37ac8c0c26b7 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:45.456273 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584ecd78-2270-4c06-aa45-37ac8c0c26b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:45.456652 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584ecd78-2270-4c06-aa45-37ac8c0c26b7 None admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:45.457718 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584ecd78-2270-4c06-aa45-37ac8c0c26b7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:45.458313 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584ecd78-2270-4c06-aa45-37ac8c0c26b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:45.459772 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584ecd78-2270-4c06-aa45-37ac8c0c26b7 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:45.473530 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 426/855] 10.222.0.15 () {56 vars in 1148 bytes} [Tue May 31 14:30:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:45.474906 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584ecd78-2270-4c06-aa45-37ac8c0c26b7 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:45.543853 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adcb1c4-ffbb-447e-b0e4-7c5d44a1baf1 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:45.557402 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:45.587969 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e486f20b-1daa-41ff-a447-cb3520a385d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:45.588518 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e486f20b-1daa-41ff-a447-cb3520a385d1 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:45.588800 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e486f20b-1daa-41ff-a447-cb3520a385d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:45.589109 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e486f20b-1daa-41ff-a447-cb3520a385d1 None admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:45.590187 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e486f20b-1daa-41ff-a447-cb3520a385d1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:45.590187 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e486f20b-1daa-41ff-a447-cb3520a385d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:45.591511 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e486f20b-1daa-41ff-a447-cb3520a385d1 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:45.596699 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584ecd78-2270-4c06-aa45-37ac8c0c26b7 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:45.601576 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 430/856] 10.222.0.15 () {56 vars in 1103 bytes} [Tue May 31 14:30:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:45.602421 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e486f20b-1daa-41ff-a447-cb3520a385d1 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:45.637569 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a51a9c-33be-49f6-80e5-821578d5b447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:45.639022 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a51a9c-33be-49f6-80e5-821578d5b447 None admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:45.639668 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a51a9c-33be-49f6-80e5-821578d5b447 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:45.639668 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a51a9c-33be-49f6-80e5-821578d5b447 None admin] PATH_INFO: `/v3/services` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:45.640328 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a51a9c-33be-49f6-80e5-821578d5b447 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:45.641717 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a51a9c-33be-49f6-80e5-821578d5b447 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:45.660875 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:45.705437 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e486f20b-1daa-41ff-a447-cb3520a385d1 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:45.734271 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 427/857] 10.222.0.15 () {60 vars in 1141 bytes} [Tue May 31 14:30:45 2022] POST /identity/v3/services => generated 251 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:30:45.736598 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a219e8-f542-4956-876f-61c01ccfd36c None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:45.736900 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a219e8-f542-4956-876f-61c01ccfd36c None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:45.737182 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a219e8-f542-4956-876f-61c01ccfd36c None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:45.740276 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 428/858] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:30:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:30:45.740506 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a219e8-f542-4956-876f-61c01ccfd36c None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:45.754504 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7727aee9-6acb-49e5-941b-5d71e7a2eac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:45.755829 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7727aee9-6acb-49e5-941b-5d71e7a2eac7 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:45.755829 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7727aee9-6acb-49e5-941b-5d71e7a2eac7 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:45.755829 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7727aee9-6acb-49e5-941b-5d71e7a2eac7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:45.756982 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7727aee9-6acb-49e5-941b-5d71e7a2eac7 None admin] RBAC: Adding query filter params (role.id=76c53e2c353644f885028a0226c06146, scope.project.id=ffff4334538649fdba1beb80cad207fa, user.id=e158f461c66e4d779f23fb7760672897) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:45.757568 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7727aee9-6acb-49e5-941b-5d71e7a2eac7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:45.759324 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7727aee9-6acb-49e5-941b-5d71e7a2eac7 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:45.779011 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 431/859] 10.222.0.15 () {56 vars in 1374 bytes} [Tue May 31 14:30:45 2022] GET /identity/v3/role_assignments?user.id=e158f461c66e4d779f23fb7760672897&scope.project.id=ffff4334538649fdba1beb80cad207fa&role.id=76c53e2c353644f885028a0226c06146 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:45.780554 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9c6bfc-09fd-4505-9845-2a856577a981 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:45.780846 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9c6bfc-09fd-4505-9845-2a856577a981 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:45.790590 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9c6bfc-09fd-4505-9845-2a856577a981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:45.838589 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-1b9c6bfc-09fd-4505-9845-2a856577a981 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:30:45.838589 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-1b9c6bfc-09fd-4505-9845-2a856577a981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:30:45.935079 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a219e8-f542-4956-876f-61c01ccfd36c None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:45.979099 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:45.989876 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c4612b-6d9c-4a4a-8a6e-804acc0a5528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:45.990738 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c4612b-6d9c-4a4a-8a6e-804acc0a5528 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:45.997505 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c4612b-6d9c-4a4a-8a6e-804acc0a5528 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:45.997505 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c4612b-6d9c-4a4a-8a6e-804acc0a5528 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:46.005955 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c4612b-6d9c-4a4a-8a6e-804acc0a5528 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:46.008335 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c4612b-6d9c-4a4a-8a6e-804acc0a5528 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:46.009329 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 432/860] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:30:45 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 14:30:46.033116 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9c6bfc-09fd-4505-9845-2a856577a981 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:46.038325 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-e0c4612b-6d9c-4a4a-8a6e-804acc0a5528 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:46.038325 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:46.038325 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:46.038325 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:46.038325 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:46.038325 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:46.038325 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:46.038325 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:46.038325 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:46.038325 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:46.038325 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:46.038325 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:46.038325 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 14:30:46.038325 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 14:30:46.038325 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 14:30:46.039357 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 14:30:46.039357 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:46.039357 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:46.039357 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:46.039357 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:46.039357 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:46.039357 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:46.039357 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:46.039357 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:30:46.039357 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:46.039357 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:46.039357 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:46.039357 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:46.039357 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:46.039357 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:46.039357 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:46.039357 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:46.040300 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 14:30:46.040300 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 14:30:46.040300 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:46.040300 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:30:46.041957 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 429/861] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:30:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:46.045301 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c4612b-6d9c-4a4a-8a6e-804acc0a5528 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:46.099185 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:46.181142 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9c6bfc-09fd-4505-9845-2a856577a981 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:46.186355 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c4612b-6d9c-4a4a-8a6e-804acc0a5528 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:46.223488 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effd1bcf-0e86-4a11-bd0b-7b81429ae8e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:46.224426 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd1bcf-0e86-4a11-bd0b-7b81429ae8e7 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:46.224815 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd1bcf-0e86-4a11-bd0b-7b81429ae8e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:46.225923 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd1bcf-0e86-4a11-bd0b-7b81429ae8e7 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:46.227585 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effd1bcf-0e86-4a11-bd0b-7b81429ae8e7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:46.227709 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e31444c-ef53-4abc-a114-ac0545a3fc64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:46.228366 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e31444c-ef53-4abc-a114-ac0545a3fc64 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:46.234577 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effd1bcf-0e86-4a11-bd0b-7b81429ae8e7 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:46.234765 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e31444c-ef53-4abc-a114-ac0545a3fc64 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:46.234765 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e31444c-ef53-4abc-a114-ac0545a3fc64 None admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:46.234765 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e31444c-ef53-4abc-a114-ac0545a3fc64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:46.234765 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e31444c-ef53-4abc-a114-ac0545a3fc64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:46.235661 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e31444c-ef53-4abc-a114-ac0545a3fc64 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:46.249426 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-effd1bcf-0e86-4a11-bd0b-7b81429ae8e7 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 31 14:30:46.249426 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:46.249426 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 31 14:30:46.249426 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 31 14:30:46.249426 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 31 14:30:46.249426 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 31 14:30:46.249426 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 31 14:30:46.249426 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 14:30:46.249426 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 31 14:30:46.249426 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:30:46.249426 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 31 14:30:46.249426 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:30:46.249426 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:46.249426 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:46.249426 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:46.249426 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:46.250466 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:46.250466 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:46.250466 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:46.250466 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:46.250466 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:46.250466 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:46.250466 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:46.250466 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 31 14:30:46.250466 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_service(service_id) May 31 14:30:46.250466 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 31 14:30:46.250466 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 31 14:30:46.250466 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:46.250466 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:46.250466 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:46.250466 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:46.250466 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:46.251388 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:46.251388 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:46.251388 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:30:46.251388 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:46.251388 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:46.251388 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:46.251388 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:46.251388 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:46.251388 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:46.251388 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:46.251388 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:46.251388 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 31 14:30:46.251388 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 14:30:46.251388 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 31 14:30:46.251388 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:30:46.251388 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 433/863] 10.222.0.15 () {56 vars in 1132 bytes} [Tue May 31 14:30:46 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 14:30:46.258611 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 430/863] 10.222.0.15 () {56 vars in 1109 bytes} [Tue May 31 14:30:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 14:30:46.258752 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effd1bcf-0e86-4a11-bd0b-7b81429ae8e7 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:46.262152 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e31444c-ef53-4abc-a114-ac0545a3fc64 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:46.311806 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:46.375616 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e31444c-ef53-4abc-a114-ac0545a3fc64 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:46.426690 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effd1bcf-0e86-4a11-bd0b-7b81429ae8e7 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:46.438323 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8814a83c-994a-458a-8a52-eac958a7d04e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:46.438907 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:46.440018 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8814a83c-994a-458a-8a52-eac958a7d04e None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:46.440519 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8814a83c-994a-458a-8a52-eac958a7d04e None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:46.441010 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8814a83c-994a-458a-8a52-eac958a7d04e None admin] PATH_INFO: `/v3/services` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:46.442450 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8814a83c-994a-458a-8a52-eac958a7d04e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:46.443024 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8814a83c-994a-458a-8a52-eac958a7d04e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:46.444698 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8814a83c-994a-458a-8a52-eac958a7d04e None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:46.461467 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 431/864] 10.222.0.15 () {56 vars in 1126 bytes} [Tue May 31 14:30:46 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 14:30:46.463675 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8814a83c-994a-458a-8a52-eac958a7d04e None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:46.499348 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdce591-ad5c-4e6d-a6d7-1e7a7e5d80dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:46.500274 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdce591-ad5c-4e6d-a6d7-1e7a7e5d80dc None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:46.500567 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdce591-ad5c-4e6d-a6d7-1e7a7e5d80dc None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:46.500857 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdce591-ad5c-4e6d-a6d7-1e7a7e5d80dc None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:46.513185 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdce591-ad5c-4e6d-a6d7-1e7a7e5d80dc None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:46.515540 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdce591-ad5c-4e6d-a6d7-1e7a7e5d80dc None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:46.544019 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-afdce591-ad5c-4e6d-a6d7-1e7a7e5d80dc None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 31 14:30:46.544019 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:46.544019 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:46.544019 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:46.544019 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:46.544019 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:46.544019 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:46.544019 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:46.544019 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:46.544019 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:46.544019 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:46.544019 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:46.544019 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 14:30:46.544019 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 14:30:46.544019 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 14:30:46.544019 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 14:30:46.545059 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:46.545059 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:46.545059 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 14:30:46.545059 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 14:30:46.545059 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 14:30:46.545059 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 14:30:46.545059 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:46.545059 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:46.545059 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:46.545059 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:46.545059 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:46.545059 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:30:46.545059 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:46.545059 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:46.545059 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:46.545059 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:46.545059 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:46.545059 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:46.546014 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:46.546014 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:46.546014 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 14:30:46.546014 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 14:30:46.546014 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 14:30:46.546014 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 14:30:46.546014 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 14:30:46.546014 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 14:30:46.546014 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 31 14:30:46.546014 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:30:46.551598 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 434/865] 10.222.0.15 () {56 vars in 1117 bytes} [Tue May 31 14:30:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:46.553486 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdce591-ad5c-4e6d-a6d7-1e7a7e5d80dc None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:46.628382 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8814a83c-994a-458a-8a52-eac958a7d04e None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:46.642995 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:46.681808 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaa7753-1b3e-4f88-b63c-a5db5a3454b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:46.682750 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaa7753-1b3e-4f88-b63c-a5db5a3454b1 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:46.683073 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaa7753-1b3e-4f88-b63c-a5db5a3454b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:46.683834 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaa7753-1b3e-4f88-b63c-a5db5a3454b1 None admin] PATH_INFO: `/v3/services` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:46.684655 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaa7753-1b3e-4f88-b63c-a5db5a3454b1 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:46.685288 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaa7753-1b3e-4f88-b63c-a5db5a3454b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:46.687429 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaa7753-1b3e-4f88-b63c-a5db5a3454b1 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:46.692470 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdce591-ad5c-4e6d-a6d7-1e7a7e5d80dc None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:46.709861 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 432/866] 10.222.0.15 () {56 vars in 1126 bytes} [Tue May 31 14:30:46 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:46.734151 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6208bcd4-4620-40d5-a779-d5af4e50f288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:46.735386 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6208bcd4-4620-40d5-a779-d5af4e50f288 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:46.735818 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6208bcd4-4620-40d5-a779-d5af4e50f288 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:46.736238 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6208bcd4-4620-40d5-a779-d5af4e50f288 None admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:46.737252 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6208bcd4-4620-40d5-a779-d5af4e50f288 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:46.737708 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6208bcd4-4620-40d5-a779-d5af4e50f288 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:46.739898 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6208bcd4-4620-40d5-a779-d5af4e50f288 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:46.762569 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 435/867] 10.222.0.15 () {56 vars in 1149 bytes} [Tue May 31 14:30:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:46.771753 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaa7753-1b3e-4f88-b63c-a5db5a3454b1 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:46.896081 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaa7753-1b3e-4f88-b63c-a5db5a3454b1 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:46.935891 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71444d1d-0179-461c-b9d5-365d17a2adfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:46.936935 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71444d1d-0179-461c-b9d5-365d17a2adfb None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:46.937426 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71444d1d-0179-461c-b9d5-365d17a2adfb None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:46.937904 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71444d1d-0179-461c-b9d5-365d17a2adfb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:47.000628 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:47.033396 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71444d1d-0179-461c-b9d5-365d17a2adfb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:47.039812 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71444d1d-0179-461c-b9d5-365d17a2adfb None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:47.152282 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 433/868] 10.222.0.15 () {58 vars in 1282 bytes} [Tue May 31 14:30:46 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 31 14:30:47.164150 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6208bcd4-4620-40d5-a779-d5af4e50f288 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:47.219026 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:47.308260 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6208bcd4-4620-40d5-a779-d5af4e50f288 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:47.346646 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379658b7-d5f7-4767-939f-3be5c371b787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:47.348297 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379658b7-d5f7-4767-939f-3be5c371b787 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:47.348780 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379658b7-d5f7-4767-939f-3be5c371b787 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:47.349248 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379658b7-d5f7-4767-939f-3be5c371b787 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:47.361102 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379658b7-d5f7-4767-939f-3be5c371b787 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:47.362903 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379658b7-d5f7-4767-939f-3be5c371b787 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:47.383304 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-379658b7-d5f7-4767-939f-3be5c371b787 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:47.383304 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:47.383304 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:47.383304 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:47.383304 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:47.383304 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:47.383304 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:47.383304 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:47.383304 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:47.383304 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:47.383304 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:47.383304 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:47.383304 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 14:30:47.383304 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 14:30:47.383304 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 14:30:47.384240 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 14:30:47.384240 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:47.384240 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:47.384240 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:47.384240 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:47.384240 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:47.384240 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:47.384240 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:47.384240 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:30:47.384240 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:47.384240 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:47.384240 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:47.384240 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:47.384240 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:47.384240 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:47.384240 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:47.384240 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:47.385122 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 14:30:47.385122 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 14:30:47.385122 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:47.385122 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:30:47.387250 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 436/869] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:30:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:47.395021 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71444d1d-0179-461c-b9d5-365d17a2adfb None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:47.476147 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:47.508011 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71444d1d-0179-461c-b9d5-365d17a2adfb None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:47.543672 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034df9cd-6a2e-45ce-8041-b9526562709c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:47.544725 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034df9cd-6a2e-45ce-8041-b9526562709c None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:47.545213 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034df9cd-6a2e-45ce-8041-b9526562709c None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:47.545701 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034df9cd-6a2e-45ce-8041-b9526562709c None admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:47.546841 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034df9cd-6a2e-45ce-8041-b9526562709c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:47.547381 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034df9cd-6a2e-45ce-8041-b9526562709c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:47.548962 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034df9cd-6a2e-45ce-8041-b9526562709c None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:47.563327 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 434/870] 10.222.0.15 () {56 vars in 1109 bytes} [Tue May 31 14:30:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:47.569549 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379658b7-d5f7-4767-939f-3be5c371b787 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:47.656823 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:47.685745 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379658b7-d5f7-4767-939f-3be5c371b787 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:47.722024 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4c4092-9656-4fb6-addf-7525725a52ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:47.723896 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4c4092-9656-4fb6-addf-7525725a52ab None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:47.724383 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4c4092-9656-4fb6-addf-7525725a52ab None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:47.724894 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4c4092-9656-4fb6-addf-7525725a52ab None admin] PATH_INFO: `/v3/projects/service` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:47.732422 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4c4092-9656-4fb6-addf-7525725a52ab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:47.734143 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4c4092-9656-4fb6-addf-7525725a52ab None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:47.749886 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-3a4c4092-9656-4fb6-addf-7525725a52ab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 14:30:47.749886 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:47.749886 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:47.749886 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:47.749886 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:47.749886 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:47.749886 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:47.749886 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:47.749886 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:47.749886 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:47.749886 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:47.749886 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:47.749886 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 14:30:47.749886 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 14:30:47.749886 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 14:30:47.750852 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 14:30:47.750852 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:47.750852 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:47.750852 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:47.750852 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:47.750852 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:47.750852 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:47.750852 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:47.750852 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:30:47.750852 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:47.750852 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:47.750852 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:47.750852 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:47.750852 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:47.750852 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:47.750852 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:47.750852 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:47.751766 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 14:30:47.751766 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 14:30:47.751766 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 14:30:47.751766 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 14:30:47.751766 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 14:30:47.751766 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 14:30:47.751766 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 14:30:47.751766 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:30:47.754300 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 437/871] 10.222.0.15 () {56 vars in 1111 bytes} [Tue May 31 14:30:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:47.762806 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034df9cd-6a2e-45ce-8041-b9526562709c None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:47.871207 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034df9cd-6a2e-45ce-8041-b9526562709c None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:47.908743 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d979e7fc-230b-4397-a467-4505f47f4770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:47.910854 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d979e7fc-230b-4397-a467-4505f47f4770 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:47.911376 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:47.911974 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d979e7fc-230b-4397-a467-4505f47f4770 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:47.912697 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d979e7fc-230b-4397-a467-4505f47f4770 None admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:47.913860 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d979e7fc-230b-4397-a467-4505f47f4770 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:47.914413 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d979e7fc-230b-4397-a467-4505f47f4770 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:47.916165 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d979e7fc-230b-4397-a467-4505f47f4770 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:47.933368 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 435/872] 10.222.0.15 () {56 vars in 1148 bytes} [Tue May 31 14:30:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:47.939930 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4c4092-9656-4fb6-addf-7525725a52ab None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:48.053281 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4c4092-9656-4fb6-addf-7525725a52ab None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:48.094041 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f1a1b3-99cc-4f9f-a4f3-74646bedc70d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:48.095144 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f1a1b3-99cc-4f9f-a4f3-74646bedc70d None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:48.095659 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f1a1b3-99cc-4f9f-a4f3-74646bedc70d None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:48.096143 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f1a1b3-99cc-4f9f-a4f3-74646bedc70d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:48.097216 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f1a1b3-99cc-4f9f-a4f3-74646bedc70d None admin] RBAC: Adding query filter params (role.id=4fa2a9add9bc4786a62e7b5cae3cc051, scope.project.id=ffff4334538649fdba1beb80cad207fa, user.id=735d2518c8404bd991acee533b314039) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:48.098344 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f1a1b3-99cc-4f9f-a4f3-74646bedc70d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:48.100088 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f1a1b3-99cc-4f9f-a4f3-74646bedc70d None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:48.102540 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:48.108893 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 438/873] 10.222.0.15 () {56 vars in 1374 bytes} [Tue May 31 14:30:47 2022] GET /identity/v3/role_assignments?user.id=735d2518c8404bd991acee533b314039&scope.project.id=ffff4334538649fdba1beb80cad207fa&role.id=4fa2a9add9bc4786a62e7b5cae3cc051 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:48.286441 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899cf620-ec2e-4fb0-8a65-3bc6a6f05eb1 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:48.286441 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899cf620-ec2e-4fb0-8a65-3bc6a6f05eb1 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:48.286441 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899cf620-ec2e-4fb0-8a65-3bc6a6f05eb1 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:48.286441 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 436/874] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:30:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:30:48.296345 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e35d5b0-efb5-4992-9322-384c38410bd7 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:48.296680 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e35d5b0-efb5-4992-9322-384c38410bd7 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:48.296928 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e35d5b0-efb5-4992-9322-384c38410bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:48.326653 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-2e35d5b0-efb5-4992-9322-384c38410bd7 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:30:48.328235 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-2e35d5b0-efb5-4992-9322-384c38410bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:30:48.404403 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 439/875] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:30:48 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 14:30:48.429356 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899cf620-ec2e-4fb0-8a65-3bc6a6f05eb1 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:48.463406 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023a773b-ad1b-41b3-9cc4-9f12dddaf082 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:48.464039 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023a773b-ad1b-41b3-9cc4-9f12dddaf082 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:48.464695 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023a773b-ad1b-41b3-9cc4-9f12dddaf082 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:48.466259 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 440/876] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:30:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 31 14:30:48.472577 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9f74fe-cbd5-4fdd-8bdb-198c9d7adaff None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:48.472877 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9f74fe-cbd5-4fdd-8bdb-198c9d7adaff None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:48.473134 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9f74fe-cbd5-4fdd-8bdb-198c9d7adaff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:48.495010 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-2e9f74fe-cbd5-4fdd-8bdb-198c9d7adaff None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:30:48.496786 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-2e9f74fe-cbd5-4fdd-8bdb-198c9d7adaff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:30:48.584723 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899cf620-ec2e-4fb0-8a65-3bc6a6f05eb1 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:48.637162 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f23335f-1028-459e-b6e4-76321bf43fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:48.638374 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f23335f-1028-459e-b6e4-76321bf43fe6 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:48.639077 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f23335f-1028-459e-b6e4-76321bf43fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:48.639572 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f23335f-1028-459e-b6e4-76321bf43fe6 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:48.640428 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f23335f-1028-459e-b6e4-76321bf43fe6 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:48.642042 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f23335f-1028-459e-b6e4-76321bf43fe6 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:48.653800 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 441/877] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:30:48 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 31 14:30:48.663286 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-6f23335f-1028-459e-b6e4-76321bf43fe6 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 31 14:30:48.663286 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:48.663286 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 31 14:30:48.663286 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 31 14:30:48.663286 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 31 14:30:48.663286 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 31 14:30:48.663286 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 31 14:30:48.663286 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 14:30:48.663286 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 31 14:30:48.663286 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:30:48.663286 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 31 14:30:48.663286 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:30:48.663286 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:48.663286 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:48.663286 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:48.663286 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:48.663286 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:48.664320 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:48.664320 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:48.664320 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:48.664320 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:48.664320 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:48.664320 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:48.664320 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 31 14:30:48.664320 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_service(service_id) May 31 14:30:48.664320 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 31 14:30:48.664320 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 31 14:30:48.664320 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:48.664320 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:48.664320 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:48.664320 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:48.664320 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:48.664320 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:48.665141 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:48.665141 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:30:48.665141 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:48.665141 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:48.665141 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:48.665141 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:48.665141 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:48.665141 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:48.665141 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:48.665141 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:48.665141 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 31 14:30:48.665141 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 14:30:48.665141 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 31 14:30:48.665141 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:30:48.668076 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 437/878] 10.222.0.15 () {56 vars in 1114 bytes} [Tue May 31 14:30:48 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:48.674318 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9f74fe-cbd5-4fdd-8bdb-198c9d7adaff None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:48.689787 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f23335f-1028-459e-b6e4-76321bf43fe6 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:48.747619 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:48.760279 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:48.804033 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9f74fe-cbd5-4fdd-8bdb-198c9d7adaff None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:48.813565 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f23335f-1028-459e-b6e4-76321bf43fe6 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:48.854179 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb14f363-42e2-4a61-9096-ac4e0fdcfaba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:48.855771 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb14f363-42e2-4a61-9096-ac4e0fdcfaba None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:48.856475 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb14f363-42e2-4a61-9096-ac4e0fdcfaba None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:48.856827 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb14f363-42e2-4a61-9096-ac4e0fdcfaba None admin] PATH_INFO: `/v3/services` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:48.857631 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb14f363-42e2-4a61-9096-ac4e0fdcfaba None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:48.860580 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad601ce-884f-4068-aa1b-3fc3e86aa63d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:48.861061 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb14f363-42e2-4a61-9096-ac4e0fdcfaba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:48.861817 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad601ce-884f-4068-aa1b-3fc3e86aa63d None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:48.862298 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad601ce-884f-4068-aa1b-3fc3e86aa63d None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:48.862751 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb14f363-42e2-4a61-9096-ac4e0fdcfaba None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:48.863500 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad601ce-884f-4068-aa1b-3fc3e86aa63d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:48.864330 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad601ce-884f-4068-aa1b-3fc3e86aa63d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:48.866073 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad601ce-884f-4068-aa1b-3fc3e86aa63d None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:48.874585 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 442/879] 10.222.0.15 () {56 vars in 1114 bytes} [Tue May 31 14:30:48 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:48.880431 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb14f363-42e2-4a61-9096-ac4e0fdcfaba None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:48.885139 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-fad601ce-884f-4068-aa1b-3fc3e86aa63d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 31 14:30:48.885139 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:48.885139 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 31 14:30:48.885139 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 31 14:30:48.885139 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 31 14:30:48.885139 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 31 14:30:48.885139 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 31 14:30:48.885139 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 14:30:48.885139 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 31 14:30:48.885139 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:30:48.885139 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 31 14:30:48.885139 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:30:48.885139 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:48.885139 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:48.885139 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:48.885139 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:48.885139 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:48.887011 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:48.887011 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:48.887011 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:48.887011 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:48.887011 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:48.887011 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:48.887011 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 31 14:30:48.887011 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_service(service_id) May 31 14:30:48.887011 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 31 14:30:48.887011 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 31 14:30:48.887011 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:48.887011 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:48.887011 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:48.887011 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:48.887011 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:48.887011 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:48.887841 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:48.887841 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:30:48.887841 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:48.887841 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:48.887841 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:48.887841 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:48.887841 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:48.887841 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:48.887841 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:48.887841 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:48.887841 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 31 14:30:48.887841 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 14:30:48.887841 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 31 14:30:48.887841 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:30:48.890728 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 438/880] 10.222.0.15 () {56 vars in 1126 bytes} [Tue May 31 14:30:48 2022] GET /identity/v3/services/object-store => generated 93 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 14:30:48.897708 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad601ce-884f-4068-aa1b-3fc3e86aa63d None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:49.021701 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad601ce-884f-4068-aa1b-3fc3e86aa63d None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:49.043501 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:49.063736 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e63840-2711-4230-bb1a-3782a0e94946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:49.064638 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb14f363-42e2-4a61-9096-ac4e0fdcfaba None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:49.069164 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e63840-2711-4230-bb1a-3782a0e94946 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:49.069164 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e63840-2711-4230-bb1a-3782a0e94946 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:49.069624 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e63840-2711-4230-bb1a-3782a0e94946 None admin] PATH_INFO: `/v3/services` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:49.070433 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e63840-2711-4230-bb1a-3782a0e94946 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:49.070897 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e63840-2711-4230-bb1a-3782a0e94946 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:49.072383 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e63840-2711-4230-bb1a-3782a0e94946 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:49.083422 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 439/881] 10.222.0.15 () {56 vars in 1122 bytes} [Tue May 31 14:30:48 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:49.088685 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e63840-2711-4230-bb1a-3782a0e94946 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:49.100636 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:49.115202 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599a925f-adae-4c4f-b259-fca1d33d3892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:49.116135 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a925f-adae-4c4f-b259-fca1d33d3892 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:49.116670 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a925f-adae-4c4f-b259-fca1d33d3892 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:49.117089 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599a925f-adae-4c4f-b259-fca1d33d3892 None admin] PATH_INFO: `/v3/services` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:49.118035 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599a925f-adae-4c4f-b259-fca1d33d3892 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:49.118535 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599a925f-adae-4c4f-b259-fca1d33d3892 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:49.120348 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599a925f-adae-4c4f-b259-fca1d33d3892 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:49.126495 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 443/882] 10.222.0.15 () {56 vars in 1114 bytes} [Tue May 31 14:30:48 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:49.135795 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599a925f-adae-4c4f-b259-fca1d33d3892 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:49.266686 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e63840-2711-4230-bb1a-3782a0e94946 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:49.309746 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599a925f-adae-4c4f-b259-fca1d33d3892 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:49.319800 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208f83b5-54a0-4834-a5e1-3fdec34ce8e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:49.320480 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f83b5-54a0-4834-a5e1-3fdec34ce8e5 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:49.320750 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f83b5-54a0-4834-a5e1-3fdec34ce8e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:49.321023 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f83b5-54a0-4834-a5e1-3fdec34ce8e5 None admin] PATH_INFO: `/v3/services` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:49.321721 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208f83b5-54a0-4834-a5e1-3fdec34ce8e5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:49.322023 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208f83b5-54a0-4834-a5e1-3fdec34ce8e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:49.323414 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208f83b5-54a0-4834-a5e1-3fdec34ce8e5 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:49.337854 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 440/883] 10.222.0.15 () {56 vars in 1122 bytes} [Tue May 31 14:30:49 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:49.339761 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbabca9-ace3-47c9-a873-237194db85d7 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:49.339900 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbabca9-ace3-47c9-a873-237194db85d7 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:49.340670 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbabca9-ace3-47c9-a873-237194db85d7 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:49.345667 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 441/884] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:30:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:30:49.352309 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91369172-8af3-41f7-96c4-e61c3624f892 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:49.352625 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91369172-8af3-41f7-96c4-e61c3624f892 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:49.352945 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91369172-8af3-41f7-96c4-e61c3624f892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:49.364695 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff83d20b-3814-47c2-a918-25071bfe65d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:49.366066 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff83d20b-3814-47c2-a918-25071bfe65d5 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:49.366066 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff83d20b-3814-47c2-a918-25071bfe65d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:49.366066 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff83d20b-3814-47c2-a918-25071bfe65d5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:49.366776 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff83d20b-3814-47c2-a918-25071bfe65d5 None admin] RBAC: Adding query filter params (interface=public, service_id=9bfeb188d17a4a75a444f6b4fda406bd, region_id=RegionOne) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:49.367092 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff83d20b-3814-47c2-a918-25071bfe65d5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:49.368644 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff83d20b-3814-47c2-a918-25071bfe65d5 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:49.378536 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-91369172-8af3-41f7-96c4-e61c3624f892 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:30:49.380369 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-91369172-8af3-41f7-96c4-e61c3624f892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:30:49.384630 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 444/885] 10.222.0.15 () {56 vars in 1251 bytes} [Tue May 31 14:30:49 2022] GET /identity/v3/endpoints?service_id=9bfeb188d17a4a75a444f6b4fda406bd&interface=public®ion_id=RegionOne => generated 194 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:49.385565 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff83d20b-3814-47c2-a918-25071bfe65d5 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:49.454840 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:49.474014 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:49.494131 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 442/886] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:30:49 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 14:30:49.526220 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91369172-8af3-41f7-96c4-e61c3624f892 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:49.577140 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff83d20b-3814-47c2-a918-25071bfe65d5 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:49.634658 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf97591-b0d8-4ca0-85f3-bd90e512a882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:49.634658 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf97591-b0d8-4ca0-85f3-bd90e512a882 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:49.634658 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf97591-b0d8-4ca0-85f3-bd90e512a882 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:49.634658 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf97591-b0d8-4ca0-85f3-bd90e512a882 None admin] PATH_INFO: `/v3/services` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:49.635043 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf97591-b0d8-4ca0-85f3-bd90e512a882 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:49.635043 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf97591-b0d8-4ca0-85f3-bd90e512a882 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:49.641153 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 445/887] 10.222.0.15 () {56 vars in 1087 bytes} [Tue May 31 14:30:49 2022] GET /identity/v3/services => generated 1011 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 14:30:49.705062 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91369172-8af3-41f7-96c4-e61c3624f892 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:49.752273 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f31f35d-4752-477d-a465-55c63705a806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:49.753048 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f31f35d-4752-477d-a465-55c63705a806 None admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:49.753332 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f31f35d-4752-477d-a465-55c63705a806 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:49.753644 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f31f35d-4752-477d-a465-55c63705a806 None admin] PATH_INFO: `/v3/services` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:49.754452 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f31f35d-4752-477d-a465-55c63705a806 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:49.755912 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f31f35d-4752-477d-a465-55c63705a806 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:49.878031 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 443/888] 10.222.0.15 () {60 vars in 1141 bytes} [Tue May 31 14:30:49 2022] POST /identity/v3/services => generated 269 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 14:30:50.744064 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c8827a-7263-4d00-a1f1-cc1f5859fcd6 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:50.744562 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c8827a-7263-4d00-a1f1-cc1f5859fcd6 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:50.744562 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c8827a-7263-4d00-a1f1-cc1f5859fcd6 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:50.746098 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 446/889] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:30:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:30:50.751826 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06410e06-26d2-4db7-89ae-85c23e5e4c9b None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:50.752235 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06410e06-26d2-4db7-89ae-85c23e5e4c9b None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:50.752414 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06410e06-26d2-4db7-89ae-85c23e5e4c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:50.770173 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-06410e06-26d2-4db7-89ae-85c23e5e4c9b None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:30:50.771384 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-06410e06-26d2-4db7-89ae-85c23e5e4c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:30:50.802882 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:50.847133 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 444/890] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:30:50 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 14:30:50.873583 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c8827a-7263-4d00-a1f1-cc1f5859fcd6 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:50.984054 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c8827a-7263-4d00-a1f1-cc1f5859fcd6 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:50.999502 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:51.025936 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae1f2e0-b89b-4882-8460-ec362ae562d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:51.027061 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1f2e0-b89b-4882-8460-ec362ae562d6 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:51.027486 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1f2e0-b89b-4882-8460-ec362ae562d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:51.027921 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1f2e0-b89b-4882-8460-ec362ae562d6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:51.038750 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae1f2e0-b89b-4882-8460-ec362ae562d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 14:30:51.047606 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-6ae1f2e0-b89b-4882-8460-ec362ae562d6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 31 14:30:51.047606 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:51.047606 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:51.047606 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:51.047606 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:51.047606 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:51.047606 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:51.047606 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:51.047606 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:51.047606 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:51.047606 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:51.047606 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:51.047606 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 14:30:51.047606 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 14:30:51.047606 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 14:30:51.047606 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 14:30:51.048734 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 14:30:51.048734 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 14:30:51.048734 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 14:30:51.048734 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 14:30:51.048734 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:51.048734 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:51.048734 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:51.048734 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:51.048734 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:51.048734 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:51.048734 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:51.048734 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:30:51.048734 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:51.048734 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:51.048734 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:51.048734 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:51.049587 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:51.049587 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:51.049587 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:51.049587 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:51.049587 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 14:30:51.049587 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 14:30:51.049587 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 14:30:51.049587 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 14:30:51.049587 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 14:30:51.049587 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 14:30:51.049587 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 31 14:30:51.049587 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:30:51.052355 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 447/891] 10.222.0.15 () {56 vars in 1120 bytes} [Tue May 31 14:30:50 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:51.058318 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06410e06-26d2-4db7-89ae-85c23e5e4c9b None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:51.162406 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06410e06-26d2-4db7-89ae-85c23e5e4c9b None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:51.199801 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646ebd7d-f9d2-495b-ae5c-f52ec6d3e9d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:51.200719 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ebd7d-f9d2-495b-ae5c-f52ec6d3e9d4 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:51.201133 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ebd7d-f9d2-495b-ae5c-f52ec6d3e9d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:51.201534 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ebd7d-f9d2-495b-ae5c-f52ec6d3e9d4 None admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:51.202402 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646ebd7d-f9d2-495b-ae5c-f52ec6d3e9d4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:51.202896 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646ebd7d-f9d2-495b-ae5c-f52ec6d3e9d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:51.204414 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646ebd7d-f9d2-495b-ae5c-f52ec6d3e9d4 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:51.213427 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 445/892] 10.222.0.15 () {56 vars in 1115 bytes} [Tue May 31 14:30:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:51.223915 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae1f2e0-b89b-4882-8460-ec362ae562d6 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:51.335137 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae1f2e0-b89b-4882-8460-ec362ae562d6 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:51.370229 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578ac7c2-eade-4647-ba99-bf01c03726f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:51.371298 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ac7c2-eade-4647-ba99-bf01c03726f8 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:51.371724 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ac7c2-eade-4647-ba99-bf01c03726f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:51.372134 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ac7c2-eade-4647-ba99-bf01c03726f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:51.384270 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578ac7c2-eade-4647-ba99-bf01c03726f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:51.385895 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578ac7c2-eade-4647-ba99-bf01c03726f8 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:51.404553 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-578ac7c2-eade-4647-ba99-bf01c03726f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:51.404553 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:51.404553 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:51.404553 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:51.404553 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:51.404553 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:51.404553 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:51.404553 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:51.404553 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:51.404553 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:51.404553 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:51.404553 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:51.404553 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 14:30:51.404553 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 14:30:51.404553 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 14:30:51.405643 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 14:30:51.405643 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:51.405643 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:51.405643 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:51.405643 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:51.405643 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:51.405643 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:51.405643 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:51.405643 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:30:51.405643 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:51.405643 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:51.405643 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:51.405643 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:51.405643 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:51.405643 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:51.405643 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:51.405643 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:51.406518 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 14:30:51.406518 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 14:30:51.406518 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:51.406518 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:30:51.408622 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 448/893] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:30:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:51.416307 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646ebd7d-f9d2-495b-ae5c-f52ec6d3e9d4 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:51.447810 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:51.525331 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646ebd7d-f9d2-495b-ae5c-f52ec6d3e9d4 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:51.566636 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccab27f7-cf93-4dab-9421-2658d1f90232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:51.567546 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccab27f7-cf93-4dab-9421-2658d1f90232 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:51.567972 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccab27f7-cf93-4dab-9421-2658d1f90232 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:51.568390 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccab27f7-cf93-4dab-9421-2658d1f90232 None admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:51.569246 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccab27f7-cf93-4dab-9421-2658d1f90232 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:51.569693 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccab27f7-cf93-4dab-9421-2658d1f90232 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:51.571216 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccab27f7-cf93-4dab-9421-2658d1f90232 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:51.584642 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 446/894] 10.222.0.15 () {56 vars in 1109 bytes} [Tue May 31 14:30:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:51.591832 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578ac7c2-eade-4647-ba99-bf01c03726f8 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:51.623617 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:51.707738 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578ac7c2-eade-4647-ba99-bf01c03726f8 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:51.744714 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a793da-ec8c-4f90-96f7-1c78d3aca349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:51.746275 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a793da-ec8c-4f90-96f7-1c78d3aca349 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:51.746730 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a793da-ec8c-4f90-96f7-1c78d3aca349 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:51.747163 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a793da-ec8c-4f90-96f7-1c78d3aca349 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:51.757279 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a793da-ec8c-4f90-96f7-1c78d3aca349 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:51.758953 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a793da-ec8c-4f90-96f7-1c78d3aca349 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:51.775443 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-79a793da-ec8c-4f90-96f7-1c78d3aca349 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 31 14:30:51.775443 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:51.775443 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:51.775443 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:51.775443 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:51.775443 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:51.775443 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:51.775443 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:51.775443 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:51.775443 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:51.775443 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:51.775443 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:51.775443 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 14:30:51.775443 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 14:30:51.775443 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 14:30:51.775443 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 14:30:51.776419 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:51.776419 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:51.776419 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 14:30:51.776419 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 14:30:51.776419 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 14:30:51.776419 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 14:30:51.776419 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:51.776419 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:51.776419 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:51.776419 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:51.776419 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:51.776419 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:30:51.776419 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:51.776419 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:51.776419 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:51.776419 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:51.776419 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:51.776419 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:51.777387 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:51.777387 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:51.777387 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 14:30:51.777387 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 14:30:51.777387 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 14:30:51.777387 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 14:30:51.777387 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 14:30:51.777387 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 14:30:51.777387 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 31 14:30:51.777387 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:30:51.779664 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 449/895] 10.222.0.15 () {56 vars in 1117 bytes} [Tue May 31 14:30:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:51.786168 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccab27f7-cf93-4dab-9421-2658d1f90232 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:51.891002 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:51.898074 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccab27f7-cf93-4dab-9421-2658d1f90232 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:51.904923 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc9283-e927-477f-9534-aba95dabbb9f None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:51.905281 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc9283-e927-477f-9534-aba95dabbb9f None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:51.905566 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc9283-e927-477f-9534-aba95dabbb9f None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:51.910780 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 450/896] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:30:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 31 14:30:51.915109 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aafd75-f21f-4c0d-88ac-2b7eb0bdb6b5 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:51.918186 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aafd75-f21f-4c0d-88ac-2b7eb0bdb6b5 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:51.918186 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aafd75-f21f-4c0d-88ac-2b7eb0bdb6b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:51.938961 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ddd5fc-79fa-4b3e-8771-1320cec59b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:51.939800 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ddd5fc-79fa-4b3e-8771-1320cec59b00 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:51.940171 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ddd5fc-79fa-4b3e-8771-1320cec59b00 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:51.940558 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ddd5fc-79fa-4b3e-8771-1320cec59b00 None admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:51.941540 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ddd5fc-79fa-4b3e-8771-1320cec59b00 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:51.942050 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ddd5fc-79fa-4b3e-8771-1320cec59b00 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:51.943855 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ddd5fc-79fa-4b3e-8771-1320cec59b00 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:51.944280 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-56aafd75-f21f-4c0d-88ac-2b7eb0bdb6b5 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:30:51.945549 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-56aafd75-f21f-4c0d-88ac-2b7eb0bdb6b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:30:51.974269 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 447/897] 10.222.0.15 () {56 vars in 1149 bytes} [Tue May 31 14:30:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:51.978952 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ddd5fc-79fa-4b3e-8771-1320cec59b00 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:52.102019 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 451/898] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:30:51 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 31 14:30:52.138580 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aafd75-f21f-4c0d-88ac-2b7eb0bdb6b5 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:52.149117 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ddd5fc-79fa-4b3e-8771-1320cec59b00 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:52.191097 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:52.234579 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2fa361-e035-4da5-8e62-0c9904c6a93e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:52.234579 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2fa361-e035-4da5-8e62-0c9904c6a93e None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:52.234579 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2fa361-e035-4da5-8e62-0c9904c6a93e None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:52.234579 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2fa361-e035-4da5-8e62-0c9904c6a93e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:52.246748 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:52.327647 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2fa361-e035-4da5-8e62-0c9904c6a93e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:52.329373 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2fa361-e035-4da5-8e62-0c9904c6a93e None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:52.330454 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aafd75-f21f-4c0d-88ac-2b7eb0bdb6b5 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:52.376893 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4af54c-722f-4b40-8417-1101d506060a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:52.377571 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4af54c-722f-4b40-8417-1101d506060a None admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:52.377850 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4af54c-722f-4b40-8417-1101d506060a None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:52.378672 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4af54c-722f-4b40-8417-1101d506060a None admin] PATH_INFO: `/v3/services` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:52.379403 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4af54c-722f-4b40-8417-1101d506060a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:52.380790 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4af54c-722f-4b40-8417-1101d506060a None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:52.454082 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 448/899] 10.222.0.15 () {58 vars in 1282 bytes} [Tue May 31 14:30:51 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 31 14:30:52.455090 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4e9bee-b685-4564-afc9-aba8b5715377 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:52.455385 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4e9bee-b685-4564-afc9-aba8b5715377 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:52.455664 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4e9bee-b685-4564-afc9-aba8b5715377 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:52.457719 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 449/900] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:30:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:30:52.460885 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4e9bee-b685-4564-afc9-aba8b5715377 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:52.477915 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 452/901] 10.222.0.15 () {60 vars in 1141 bytes} [Tue May 31 14:30:52 2022] POST /identity/v3/services => generated 241 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 14:30:52.480094 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa67453-6b49-4f83-b435-8f9000e7e5c1 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:52.480285 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa67453-6b49-4f83-b435-8f9000e7e5c1 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:52.480565 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa67453-6b49-4f83-b435-8f9000e7e5c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:52.507563 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-4fa67453-6b49-4f83-b435-8f9000e7e5c1 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:30:52.509889 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-4fa67453-6b49-4f83-b435-8f9000e7e5c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:30:52.542957 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:52.608423 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 453/902] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:30:52 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 14:30:52.609979 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096bdc23-3e04-4b27-bb2f-4393ac0c41f5 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:52.610373 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096bdc23-3e04-4b27-bb2f-4393ac0c41f5 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:52.610721 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096bdc23-3e04-4b27-bb2f-4393ac0c41f5 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:52.616768 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 454/903] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:30:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:30:52.618369 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2e7d14-8293-43a2-9cdd-db0b7ab7ecc6 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:52.618692 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2e7d14-8293-43a2-9cdd-db0b7ab7ecc6 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:52.618977 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2e7d14-8293-43a2-9cdd-db0b7ab7ecc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:52.628769 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:52.632396 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4e9bee-b685-4564-afc9-aba8b5715377 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:52.642187 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-7c2e7d14-8293-43a2-9cdd-db0b7ab7ecc6 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:30:52.644810 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-7c2e7d14-8293-43a2-9cdd-db0b7ab7ecc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:30:52.680036 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e52fe3-6c54-4d91-9606-5e9988414b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:52.681156 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e52fe3-6c54-4d91-9606-5e9988414b7a None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:52.681504 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e52fe3-6c54-4d91-9606-5e9988414b7a None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:52.681850 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e52fe3-6c54-4d91-9606-5e9988414b7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:52.695491 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e52fe3-6c54-4d91-9606-5e9988414b7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:52.697605 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e52fe3-6c54-4d91-9606-5e9988414b7a None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:52.719239 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-53e52fe3-6c54-4d91-9606-5e9988414b7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:52.719239 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:52.719239 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:52.719239 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:52.719239 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:52.719239 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:52.719239 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:52.719239 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:52.719239 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:52.719239 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:52.719239 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:52.719239 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:52.719239 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 14:30:52.719239 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 14:30:52.719239 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 14:30:52.720191 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 14:30:52.720191 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:52.720191 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:52.720191 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:52.720191 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:52.720191 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:52.720191 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:52.720191 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:52.720191 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:30:52.720191 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:52.720191 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:52.720191 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:52.720191 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:52.720191 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:52.720191 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:52.720191 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:52.720191 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:52.721127 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 14:30:52.721127 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 14:30:52.721127 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:52.721127 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:30:52.721608 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 450/904] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:30:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:52.722513 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e52fe3-6c54-4d91-9606-5e9988414b7a None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:52.753706 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 455/905] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:30:52 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 14:30:52.753706 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2e7d14-8293-43a2-9cdd-db0b7ab7ecc6 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:52.870861 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:52.880722 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e52fe3-6c54-4d91-9606-5e9988414b7a None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:52.889412 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2e7d14-8293-43a2-9cdd-db0b7ab7ecc6 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:52.927191 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:52.929075 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2578a490-0059-489e-bef9-fa1f9c6572b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:52.930001 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2578a490-0059-489e-bef9-fa1f9c6572b3 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:52.930372 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2578a490-0059-489e-bef9-fa1f9c6572b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:52.930692 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2578a490-0059-489e-bef9-fa1f9c6572b3 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:52.931473 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2578a490-0059-489e-bef9-fa1f9c6572b3 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:52.932857 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2578a490-0059-489e-bef9-fa1f9c6572b3 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:52.933973 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e211be2f-e895-4af7-9eb6-50ce553e78c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:52.934737 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e211be2f-e895-4af7-9eb6-50ce553e78c2 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:52.936104 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e211be2f-e895-4af7-9eb6-50ce553e78c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:52.945725 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e211be2f-e895-4af7-9eb6-50ce553e78c2 None admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:52.945725 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e211be2f-e895-4af7-9eb6-50ce553e78c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:52.945725 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e211be2f-e895-4af7-9eb6-50ce553e78c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:52.945725 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e211be2f-e895-4af7-9eb6-50ce553e78c2 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:52.947632 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-2578a490-0059-489e-bef9-fa1f9c6572b3 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 31 14:30:52.947632 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:52.947632 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 31 14:30:52.947632 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 31 14:30:52.947632 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 31 14:30:52.947632 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 31 14:30:52.947632 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 31 14:30:52.947632 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 14:30:52.947632 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 31 14:30:52.947632 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:30:52.947632 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 31 14:30:52.947632 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:30:52.947632 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:52.947632 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:52.947632 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:52.947632 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:52.947632 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:52.948591 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:52.948591 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:52.948591 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:52.948591 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:52.948591 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:52.948591 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:52.948591 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 31 14:30:52.948591 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_service(service_id) May 31 14:30:52.948591 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 31 14:30:52.948591 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 31 14:30:52.948591 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:52.948591 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:52.948591 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:52.948591 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:52.948591 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:52.948591 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:52.949440 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:52.949440 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:30:52.949440 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:52.949440 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:52.949440 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:52.949440 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:52.949440 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:52.949440 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:52.949440 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:52.949440 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:52.949440 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 31 14:30:52.949440 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 14:30:52.949440 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 31 14:30:52.949440 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:30:52.949440 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 451/906] 10.222.0.15 () {56 vars in 1114 bytes} [Tue May 31 14:30:52 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:52.950384 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2578a490-0059-489e-bef9-fa1f9c6572b3 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:52.959463 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 456/907] 10.222.0.15 () {56 vars in 1109 bytes} [Tue May 31 14:30:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:52.960681 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e211be2f-e895-4af7-9eb6-50ce553e78c2 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:53.076834 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2578a490-0059-489e-bef9-fa1f9c6572b3 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:53.085468 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e211be2f-e895-4af7-9eb6-50ce553e78c2 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:53.124793 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d5011a-9882-4c90-a7e5-91bd61128cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:53.125591 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d5011a-9882-4c90-a7e5-91bd61128cd8 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:53.125872 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d5011a-9882-4c90-a7e5-91bd61128cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:53.126148 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d5011a-9882-4c90-a7e5-91bd61128cd8 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:53.126829 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d5011a-9882-4c90-a7e5-91bd61128cd8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:53.127704 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbcf0ab-003a-45dc-8a6d-9e45dcbd9a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:53.128579 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbcf0ab-003a-45dc-8a6d-9e45dcbd9a33 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:53.129009 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbcf0ab-003a-45dc-8a6d-9e45dcbd9a33 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:53.129438 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbcf0ab-003a-45dc-8a6d-9e45dcbd9a33 None admin] PATH_INFO: `/v3/services` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:53.130394 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbcf0ab-003a-45dc-8a6d-9e45dcbd9a33 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:53.130874 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbcf0ab-003a-45dc-8a6d-9e45dcbd9a33 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:53.131433 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d5011a-9882-4c90-a7e5-91bd61128cd8 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:53.132540 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbcf0ab-003a-45dc-8a6d-9e45dcbd9a33 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:53.138340 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 457/908] 10.222.0.15 () {56 vars in 1114 bytes} [Tue May 31 14:30:52 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:53.139487 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbcf0ab-003a-45dc-8a6d-9e45dcbd9a33 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:53.145792 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-44d5011a-9882-4c90-a7e5-91bd61128cd8 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 31 14:30:53.145792 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:53.145792 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 31 14:30:53.145792 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 31 14:30:53.145792 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 31 14:30:53.145792 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 31 14:30:53.145792 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 31 14:30:53.145792 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 14:30:53.145792 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 31 14:30:53.145792 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:30:53.145792 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 31 14:30:53.145792 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:30:53.145792 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:53.145792 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:53.145792 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:53.145792 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:53.146772 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:53.146772 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:53.146772 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:53.146772 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:53.146772 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:53.146772 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:53.146772 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:53.146772 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 31 14:30:53.146772 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_service(service_id) May 31 14:30:53.146772 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 31 14:30:53.146772 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 31 14:30:53.146772 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:53.146772 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:53.146772 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:53.146772 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:53.146772 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:53.147864 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:53.147864 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:53.147864 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:30:53.147864 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:53.147864 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:53.147864 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:53.147864 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:53.147864 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:53.147864 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:53.147864 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:53.147864 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:53.147864 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 31 14:30:53.147864 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 14:30:53.147864 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 31 14:30:53.147864 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:30:53.147864 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 452/909] 10.222.0.15 () {56 vars in 1132 bytes} [Tue May 31 14:30:52 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:53.148921 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d5011a-9882-4c90-a7e5-91bd61128cd8 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:53.181075 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:53.211428 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:53.264362 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbcf0ab-003a-45dc-8a6d-9e45dcbd9a33 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:53.286669 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d5011a-9882-4c90-a7e5-91bd61128cd8 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:53.314407 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e868f55-39bf-40e2-8019-8264ce25fd0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:53.315571 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e868f55-39bf-40e2-8019-8264ce25fd0e None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:53.316133 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e868f55-39bf-40e2-8019-8264ce25fd0e None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:53.316594 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e868f55-39bf-40e2-8019-8264ce25fd0e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:53.325070 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e868f55-39bf-40e2-8019-8264ce25fd0e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:53.326564 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e868f55-39bf-40e2-8019-8264ce25fd0e None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:53.331833 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8efb7b3-f233-4bc0-88d9-d292dd7ea6e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:53.332449 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8efb7b3-f233-4bc0-88d9-d292dd7ea6e1 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:53.332733 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8efb7b3-f233-4bc0-88d9-d292dd7ea6e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:53.333020 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8efb7b3-f233-4bc0-88d9-d292dd7ea6e1 None admin] PATH_INFO: `/v3/services` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:53.333724 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8efb7b3-f233-4bc0-88d9-d292dd7ea6e1 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:53.334034 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8efb7b3-f233-4bc0-88d9-d292dd7ea6e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:53.335437 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8efb7b3-f233-4bc0-88d9-d292dd7ea6e1 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:53.342097 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 453/910] 10.222.0.15 () {56 vars in 1114 bytes} [Tue May 31 14:30:53 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:53.343015 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8efb7b3-f233-4bc0-88d9-d292dd7ea6e1 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:53.348641 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-0e868f55-39bf-40e2-8019-8264ce25fd0e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 14:30:53.348641 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:53.348641 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:53.348641 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:53.348641 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:53.348641 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:53.348641 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:53.348641 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:53.348641 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:53.348641 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:53.348641 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:53.348641 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:53.348641 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 14:30:53.348641 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 14:30:53.348641 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 14:30:53.349553 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 14:30:53.349553 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:53.349553 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:53.349553 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:53.349553 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:53.349553 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:53.349553 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:53.349553 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:53.349553 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:30:53.349553 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:53.349553 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:53.349553 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:53.349553 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:53.349553 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:53.349553 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:53.349553 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:53.349553 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:53.350469 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 14:30:53.350469 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 14:30:53.350469 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 14:30:53.350469 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 14:30:53.350469 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 14:30:53.350469 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 14:30:53.350469 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 14:30:53.350469 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:30:53.352833 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 458/911] 10.222.0.15 () {56 vars in 1111 bytes} [Tue May 31 14:30:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:53.354286 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e868f55-39bf-40e2-8019-8264ce25fd0e None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:53.456791 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:53.478322 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8efb7b3-f233-4bc0-88d9-d292dd7ea6e1 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:53.484217 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e868f55-39bf-40e2-8019-8264ce25fd0e None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:53.505210 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:53.526154 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248f7e5d-c006-42a7-913b-707e3a49e476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:53.527112 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248f7e5d-c006-42a7-913b-707e3a49e476 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:53.527564 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248f7e5d-c006-42a7-913b-707e3a49e476 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:53.527919 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248f7e5d-c006-42a7-913b-707e3a49e476 None admin] PATH_INFO: `/v3/services` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:53.528144 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aed4c3-f9b0-4a3a-b414-0608e8585df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:53.528782 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248f7e5d-c006-42a7-913b-707e3a49e476 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:53.528897 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aed4c3-f9b0-4a3a-b414-0608e8585df0 None admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:53.529211 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248f7e5d-c006-42a7-913b-707e3a49e476 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:53.529320 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aed4c3-f9b0-4a3a-b414-0608e8585df0 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:53.529609 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aed4c3-f9b0-4a3a-b414-0608e8585df0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:53.530414 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aed4c3-f9b0-4a3a-b414-0608e8585df0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:53.530841 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248f7e5d-c006-42a7-913b-707e3a49e476 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:53.532546 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aed4c3-f9b0-4a3a-b414-0608e8585df0 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:53.538744 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 454/912] 10.222.0.15 () {56 vars in 1126 bytes} [Tue May 31 14:30:53 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:53.539562 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248f7e5d-c006-42a7-913b-707e3a49e476 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:53.643425 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 459/913] 10.222.0.15 () {60 vars in 1144 bytes} [Tue May 31 14:30:53 2022] POST /identity/v3/endpoints => generated 346 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:30:53.645114 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aed4c3-f9b0-4a3a-b414-0608e8585df0 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:53.678922 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248f7e5d-c006-42a7-913b-707e3a49e476 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:53.737455 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7ecd74-e02b-4d96-8942-2412cc4d17b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:53.738507 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7ecd74-e02b-4d96-8942-2412cc4d17b0 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:53.739035 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7ecd74-e02b-4d96-8942-2412cc4d17b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:53.739532 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7ecd74-e02b-4d96-8942-2412cc4d17b0 None admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:53.741481 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7ecd74-e02b-4d96-8942-2412cc4d17b0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:53.741999 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7ecd74-e02b-4d96-8942-2412cc4d17b0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:53.743675 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7ecd74-e02b-4d96-8942-2412cc4d17b0 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:53.766003 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 455/914] 10.222.0.15 () {56 vars in 1148 bytes} [Tue May 31 14:30:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:53.767428 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7ecd74-e02b-4d96-8942-2412cc4d17b0 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:53.784219 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:53.867112 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aed4c3-f9b0-4a3a-b414-0608e8585df0 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:53.924809 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccb5672-07c6-4075-96c3-8a4fc12a8ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:53.926509 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccb5672-07c6-4075-96c3-8a4fc12a8ffd None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:53.927071 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccb5672-07c6-4075-96c3-8a4fc12a8ffd None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:53.927219 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccb5672-07c6-4075-96c3-8a4fc12a8ffd None admin] PATH_INFO: `/v3/services` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:53.928002 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccb5672-07c6-4075-96c3-8a4fc12a8ffd None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:53.928321 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccb5672-07c6-4075-96c3-8a4fc12a8ffd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:53.929506 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7ecd74-e02b-4d96-8942-2412cc4d17b0 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:53.931194 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccb5672-07c6-4075-96c3-8a4fc12a8ffd None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:53.944161 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 460/915] 10.222.0.15 () {56 vars in 1126 bytes} [Tue May 31 14:30:53 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:53.951832 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccb5672-07c6-4075-96c3-8a4fc12a8ffd None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:53.993592 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94acd7d0-b729-4f84-b162-0211adf6aaaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:53.994269 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94acd7d0-b729-4f84-b162-0211adf6aaaa None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:53.994574 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94acd7d0-b729-4f84-b162-0211adf6aaaa None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:53.994870 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94acd7d0-b729-4f84-b162-0211adf6aaaa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:53.995990 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94acd7d0-b729-4f84-b162-0211adf6aaaa None admin] RBAC: Adding query filter params (role.id=c71617921821419bba278e390d70ac77, scope.project.id=ffff4334538649fdba1beb80cad207fa, user.id=735d2518c8404bd991acee533b314039) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:53.996301 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94acd7d0-b729-4f84-b162-0211adf6aaaa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:53.998584 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94acd7d0-b729-4f84-b162-0211adf6aaaa None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:54.010048 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:54.011605 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 456/916] 10.222.0.15 () {56 vars in 1374 bytes} [Tue May 31 14:30:53 2022] GET /identity/v3/role_assignments?user.id=735d2518c8404bd991acee533b314039&scope.project.id=ffff4334538649fdba1beb80cad207fa&role.id=c71617921821419bba278e390d70ac77 => generated 259 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:54.090532 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccb5672-07c6-4075-96c3-8a4fc12a8ffd None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:54.133485 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bcfc8b-8cf8-4d1e-a6ea-6097d8eb839a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:54.134523 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bcfc8b-8cf8-4d1e-a6ea-6097d8eb839a None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:54.135042 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bcfc8b-8cf8-4d1e-a6ea-6097d8eb839a None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:54.135536 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bcfc8b-8cf8-4d1e-a6ea-6097d8eb839a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:54.136544 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bcfc8b-8cf8-4d1e-a6ea-6097d8eb839a None admin] RBAC: Adding query filter params (interface=public, service_id=42bafa23e4974a25af5ce8cb9ccfa886, region_id=RegionOne) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:54.137086 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bcfc8b-8cf8-4d1e-a6ea-6097d8eb839a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:54.138743 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bcfc8b-8cf8-4d1e-a6ea-6097d8eb839a None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:54.148174 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 461/917] 10.222.0.15 () {56 vars in 1251 bytes} [Tue May 31 14:30:53 2022] GET /identity/v3/endpoints?service_id=42bafa23e4974a25af5ce8cb9ccfa886&interface=public®ion_id=RegionOne => generated 194 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:54.155761 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94acd7d0-b729-4f84-b162-0211adf6aaaa None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:54.283916 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:54.327097 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94acd7d0-b729-4f84-b162-0211adf6aaaa None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:54.366257 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d39976f-b60c-4be7-ac38-9de64a141d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:54.367204 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d39976f-b60c-4be7-ac38-9de64a141d43 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:54.367675 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d39976f-b60c-4be7-ac38-9de64a141d43 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:54.368112 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d39976f-b60c-4be7-ac38-9de64a141d43 None admin] PATH_INFO: `/v3/services` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:54.368940 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d39976f-b60c-4be7-ac38-9de64a141d43 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:54.370467 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d39976f-b60c-4be7-ac38-9de64a141d43 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:54.377248 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 457/918] 10.222.0.15 () {56 vars in 1087 bytes} [Tue May 31 14:30:54 2022] GET /identity/v3/services => generated 1497 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:30:54.911331 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c655c-57cc-4bdf-a634-13fa842226c9 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:54.911843 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c655c-57cc-4bdf-a634-13fa842226c9 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:54.911921 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c655c-57cc-4bdf-a634-13fa842226c9 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:54.913528 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 462/919] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:30:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:30:54.922468 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5674eb88-8d2f-4bcc-be0f-86798b9e42e7 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:54.922791 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5674eb88-8d2f-4bcc-be0f-86798b9e42e7 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:54.923079 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5674eb88-8d2f-4bcc-be0f-86798b9e42e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:54.941224 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-5674eb88-8d2f-4bcc-be0f-86798b9e42e7 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:30:54.942424 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-5674eb88-8d2f-4bcc-be0f-86798b9e42e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:30:55.043188 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 458/920] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:30:54 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 14:30:55.071526 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4c655c-57cc-4bdf-a634-13fa842226c9 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:55.212264 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:55.219823 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4c655c-57cc-4bdf-a634-13fa842226c9 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:55.267585 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3355c226-59a2-4f19-beba-248306804a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:55.269273 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3355c226-59a2-4f19-beba-248306804a04 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:55.269766 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3355c226-59a2-4f19-beba-248306804a04 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:55.270272 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3355c226-59a2-4f19-beba-248306804a04 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:55.271168 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3355c226-59a2-4f19-beba-248306804a04 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:55.272835 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3355c226-59a2-4f19-beba-248306804a04 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:55.288855 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-3355c226-59a2-4f19-beba-248306804a04 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 31 14:30:55.288855 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:55.288855 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 31 14:30:55.288855 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 31 14:30:55.288855 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 31 14:30:55.288855 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 31 14:30:55.288855 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 31 14:30:55.288855 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 14:30:55.288855 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 31 14:30:55.288855 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:30:55.288855 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 31 14:30:55.288855 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:30:55.288855 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:55.288855 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:55.288855 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:55.288855 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:55.288855 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:55.289890 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:55.289890 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:55.289890 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:55.289890 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:55.289890 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:55.289890 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:55.289890 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 31 14:30:55.289890 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_service(service_id) May 31 14:30:55.289890 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 31 14:30:55.289890 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 31 14:30:55.289890 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:55.289890 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:55.289890 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:55.289890 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:55.289890 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:55.289890 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:55.290803 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:55.290803 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:30:55.290803 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:55.290803 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:55.290803 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:55.290803 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:55.290803 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:55.290803 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:55.290803 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:55.290803 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:55.290803 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 31 14:30:55.290803 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 14:30:55.290803 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 31 14:30:55.290803 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:30:55.294234 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 463/921] 10.222.0.15 () {56 vars in 1126 bytes} [Tue May 31 14:30:55 2022] GET /identity/v3/services/object-store => generated 93 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:55.300080 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5674eb88-8d2f-4bcc-be0f-86798b9e42e7 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:55.389858 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:55.436178 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5674eb88-8d2f-4bcc-be0f-86798b9e42e7 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:55.481229 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38b7b34-49a3-4d65-9f7d-29cf1a054082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:55.481995 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38b7b34-49a3-4d65-9f7d-29cf1a054082 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:55.482385 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38b7b34-49a3-4d65-9f7d-29cf1a054082 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:55.483794 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38b7b34-49a3-4d65-9f7d-29cf1a054082 None admin] PATH_INFO: `/v3/services` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:55.484624 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38b7b34-49a3-4d65-9f7d-29cf1a054082 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:55.485039 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38b7b34-49a3-4d65-9f7d-29cf1a054082 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:55.486516 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38b7b34-49a3-4d65-9f7d-29cf1a054082 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:55.495073 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 459/922] 10.222.0.15 () {56 vars in 1122 bytes} [Tue May 31 14:30:55 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:55.501083 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3355c226-59a2-4f19-beba-248306804a04 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:55.618040 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3355c226-59a2-4f19-beba-248306804a04 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:55.660838 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de740345-109e-4a44-b24d-06b93c295faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:55.661565 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de740345-109e-4a44-b24d-06b93c295faa None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:55.661859 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de740345-109e-4a44-b24d-06b93c295faa None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:55.662136 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de740345-109e-4a44-b24d-06b93c295faa None admin] PATH_INFO: `/v3/services` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:55.662901 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de740345-109e-4a44-b24d-06b93c295faa None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:55.663212 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de740345-109e-4a44-b24d-06b93c295faa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:55.664576 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de740345-109e-4a44-b24d-06b93c295faa None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:55.670317 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 464/923] 10.222.0.15 () {56 vars in 1122 bytes} [Tue May 31 14:30:55 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:55.682028 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38b7b34-49a3-4d65-9f7d-29cf1a054082 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:55.816296 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38b7b34-49a3-4d65-9f7d-29cf1a054082 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:55.851319 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:55.854964 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b17582-3346-4f8f-89c8-87b266cb088d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:55.855651 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b17582-3346-4f8f-89c8-87b266cb088d None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:55.855948 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b17582-3346-4f8f-89c8-87b266cb088d None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:55.856228 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b17582-3346-4f8f-89c8-87b266cb088d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:55.857041 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b17582-3346-4f8f-89c8-87b266cb088d None admin] RBAC: Adding query filter params (interface=public, service_id=e778753f339f46c0beda911bc0d9e34d, region_id=RegionOne) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:55.857357 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b17582-3346-4f8f-89c8-87b266cb088d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:55.858826 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b17582-3346-4f8f-89c8-87b266cb088d None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:55.865337 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 460/924] 10.222.0.15 () {56 vars in 1251 bytes} [Tue May 31 14:30:55 2022] GET /identity/v3/endpoints?service_id=e778753f339f46c0beda911bc0d9e34d&interface=public®ion_id=RegionOne => generated 194 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:55.873956 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de740345-109e-4a44-b24d-06b93c295faa None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:55.908964 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:55.992902 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de740345-109e-4a44-b24d-06b93c295faa None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:56.031581 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27c8aaa-cf35-4fb5-8393-87930fcaf97c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:56.032737 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c8aaa-cf35-4fb5-8393-87930fcaf97c None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:56.033198 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c8aaa-cf35-4fb5-8393-87930fcaf97c None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:56.033618 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c8aaa-cf35-4fb5-8393-87930fcaf97c None admin] PATH_INFO: `/v3/services` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:56.034460 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27c8aaa-cf35-4fb5-8393-87930fcaf97c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:56.036719 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27c8aaa-cf35-4fb5-8393-87930fcaf97c None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:56.043613 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 465/925] 10.222.0.15 () {56 vars in 1087 bytes} [Tue May 31 14:30:55 2022] GET /identity/v3/services => generated 1497 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:30:56.249389 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6fe9c3-7b73-434c-bc37-daeed6a21b99 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:56.249886 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6fe9c3-7b73-434c-bc37-daeed6a21b99 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:56.249886 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6fe9c3-7b73-434c-bc37-daeed6a21b99 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:56.251769 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 461/926] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:30:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:30:56.259312 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166fa7b2-2c56-467a-b433-88fbb43669f6 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:56.259604 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166fa7b2-2c56-467a-b433-88fbb43669f6 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:56.259887 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166fa7b2-2c56-467a-b433-88fbb43669f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:56.299326 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-166fa7b2-2c56-467a-b433-88fbb43669f6 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:30:56.299326 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-166fa7b2-2c56-467a-b433-88fbb43669f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:30:56.389937 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 466/927] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:30:56 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 14:30:56.408487 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6fe9c3-7b73-434c-bc37-daeed6a21b99 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:56.535413 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6fe9c3-7b73-434c-bc37-daeed6a21b99 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:56.585698 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e978c1-93e9-4c21-9079-492756d35f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:56.586372 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e978c1-93e9-4c21-9079-492756d35f88 None admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:56.586700 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e978c1-93e9-4c21-9079-492756d35f88 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:56.586981 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e978c1-93e9-4c21-9079-492756d35f88 None admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:56.587700 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e978c1-93e9-4c21-9079-492756d35f88 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:56.589165 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e978c1-93e9-4c21-9079-492756d35f88 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:56.591198 dv-cinder-839793-14-smb devstack@keystone.service[80502]: WARNING keystone.server.flask.common [None req-16e978c1-93e9-4c21-9079-492756d35f88 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 31 14:30:56.635797 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8abc9b-2148-4b52-b859-20c8fd31d52d None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:56.636163 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8abc9b-2148-4b52-b859-20c8fd31d52d None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:56.636375 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8abc9b-2148-4b52-b859-20c8fd31d52d None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:56.638061 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 467/928] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:30:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:30:56.642897 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbcd17f-e559-4895-ba64-71cb75b23386 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:56.643440 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbcd17f-e559-4895-ba64-71cb75b23386 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:56.643793 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbcd17f-e559-4895-ba64-71cb75b23386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:56.647237 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.sql.core [None req-16e978c1-93e9-4c21-9079-492756d35f88 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 31 14:30:56.647237 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 31 14:30:56.647237 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [parameters: {'id': '3c63cf677e1b45f3aa33f2937e297704', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 31 14:30:56.647237 dv-cinder-839793-14-smb devstack@keystone.service[80502]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80502) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 31 14:30:56.668358 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-16e978c1-93e9-4c21-9079-492756d35f88 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3c63cf677e1b45f3aa33f2937e297704.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3c63cf677e1b45f3aa33f2937e297704. May 31 14:30:56.668358 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:56.668358 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 31 14:30:56.668358 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application self.dialect.do_execute( May 31 14:30:56.668358 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 31 14:30:56.668358 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 31 14:30:56.668358 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 31 14:30:56.668358 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application result = self._query(query) May 31 14:30:56.668358 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 31 14:30:56.668358 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application conn.query(q) May 31 14:30:56.668358 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 31 14:30:56.668358 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 31 14:30:56.668358 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 31 14:30:56.669398 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application result.read() May 31 14:30:56.669398 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 31 14:30:56.669398 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 31 14:30:56.669398 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 31 14:30:56.669398 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application packet.raise_for_error() May 31 14:30:56.669398 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 31 14:30:56.669398 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 31 14:30:56.669398 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 31 14:30:56.669398 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 31 14:30:56.669398 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 31 14:30:56.669398 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:30:56.669398 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 31 14:30:56.669398 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:30:56.669398 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:56.669398 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 31 14:30:56.669398 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 31 14:30:56.669398 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 31 14:30:56.669398 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return project_ref.to_dict() May 31 14:30:56.670615 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 31 14:30:56.670615 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application next(self.gen) May 31 14:30:56.670615 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 31 14:30:56.670615 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application yield resource May 31 14:30:56.670615 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 31 14:30:56.670615 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application next(self.gen) May 31 14:30:56.670615 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 31 14:30:56.670615 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application self.session.rollback() May 31 14:30:56.670615 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 31 14:30:56.670615 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application self.force_reraise() May 31 14:30:56.670615 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 31 14:30:56.670615 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise self.value May 31 14:30:56.670615 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 31 14:30:56.670615 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 31 14:30:56.670615 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 31 14:30:56.670615 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application session.commit() May 31 14:30:56.670615 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 31 14:30:56.671742 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 31 14:30:56.671742 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 31 14:30:56.671742 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application self._prepare_impl() May 31 14:30:56.671742 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 31 14:30:56.671742 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application self.session.flush() May 31 14:30:56.671742 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 31 14:30:56.671742 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application self._flush(objects) May 31 14:30:56.671742 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 31 14:30:56.671742 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 31 14:30:56.671742 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 31 14:30:56.671742 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application compat.raise_( May 31 14:30:56.671742 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 31 14:30:56.671742 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception May 31 14:30:56.671742 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 31 14:30:56.671742 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application flush_context.execute() May 31 14:30:56.671742 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 31 14:30:56.671742 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rec.execute(self) May 31 14:30:56.672847 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 31 14:30:56.672847 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 31 14:30:56.672847 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 31 14:30:56.672847 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application _emit_insert_statements( May 31 14:30:56.672847 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 31 14:30:56.672847 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application c = connection._execute_20( May 31 14:30:56.672847 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 31 14:30:56.672847 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 31 14:30:56.672847 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 31 14:30:56.672847 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 31 14:30:56.672847 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 31 14:30:56.672847 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ret = self._execute_context( May 31 14:30:56.672847 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 31 14:30:56.672847 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 31 14:30:56.672847 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 31 14:30:56.673843 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 31 14:30:56.673843 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 31 14:30:56.673843 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception May 31 14:30:56.673843 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 31 14:30:56.673843 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application self.dialect.do_execute( May 31 14:30:56.673843 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 31 14:30:56.673843 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 31 14:30:56.673843 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 31 14:30:56.673843 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application result = self._query(query) May 31 14:30:56.673843 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 31 14:30:56.673843 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application conn.query(q) May 31 14:30:56.673843 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 31 14:30:56.673843 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 31 14:30:56.673843 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 31 14:30:56.673843 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application result.read() May 31 14:30:56.673843 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 31 14:30:56.673843 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 31 14:30:56.675558 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 31 14:30:56.675558 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application packet.raise_for_error() May 31 14:30:56.675558 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 31 14:30:56.675558 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 31 14:30:56.675558 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 31 14:30:56.675558 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 31 14:30:56.675558 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 31 14:30:56.675558 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 31 14:30:56.675558 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [parameters: {'id': '3c63cf677e1b45f3aa33f2937e297704', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 31 14:30:56.675558 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 31 14:30:56.675558 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:30:56.675558 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 31 14:30:56.675558 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:30:56.675558 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:56.675558 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 31 14:30:56.676526 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 31 14:30:56.676526 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 31 14:30:56.676526 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 31 14:30:56.676526 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 31 14:30:56.676526 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:30:56.676526 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 31 14:30:56.676526 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:30:56.676526 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:56.676526 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:56.676526 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:56.676526 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:56.676526 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:56.676526 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:56.676526 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:56.676526 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:56.676526 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:56.676526 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:56.677638 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:56.677638 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 31 14:30:56.677638 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 31 14:30:56.677638 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:56.677638 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:56.677638 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 31 14:30:56.677638 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.Conflict( May 31 14:30:56.677638 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3c63cf677e1b45f3aa33f2937e297704. May 31 14:30:56.677638 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:30:56.678250 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-8cbcd17f-e559-4895-ba64-71cb75b23386 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:30:56.678347 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 462/929] 10.222.0.15 () {60 vars in 1140 bytes} [Tue May 31 14:30:56 2022] POST /identity/v3/projects => generated 262 bytes in 266 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:56.691644 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-8cbcd17f-e559-4895-ba64-71cb75b23386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:30:56.691850 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e978c1-93e9-4c21-9079-492756d35f88 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:56.714577 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:56.776428 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:56.792909 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 468/930] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:30:56 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 31 14:30:56.829090 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbcd17f-e559-4895-ba64-71cb75b23386 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:56.837431 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e978c1-93e9-4c21-9079-492756d35f88 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:56.904294 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1edb01-963f-4eb3-a321-850aa5433621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:56.905100 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1edb01-963f-4eb3-a321-850aa5433621 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:56.905379 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1edb01-963f-4eb3-a321-850aa5433621 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:56.905653 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1edb01-963f-4eb3-a321-850aa5433621 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:56.919603 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1edb01-963f-4eb3-a321-850aa5433621 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:56.921254 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1edb01-963f-4eb3-a321-850aa5433621 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:56.951197 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-bc1edb01-963f-4eb3-a321-850aa5433621 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 14:30:56.951197 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:56.951197 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:56.951197 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:56.951197 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:56.951197 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:56.951197 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:56.951197 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:56.951197 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:56.951197 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:56.951197 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:56.951197 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:56.951197 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 14:30:56.951197 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 14:30:56.951197 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 14:30:56.952137 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 14:30:56.952137 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:56.952137 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:56.952137 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:56.952137 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:56.952137 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:56.952137 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:56.952137 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:56.952137 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:30:56.952137 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:56.952137 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:56.952137 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:56.952137 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:56.952137 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:56.952137 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:56.952137 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:56.952137 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:56.953090 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 14:30:56.953090 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 14:30:56.953090 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 14:30:56.953090 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 14:30:56.953090 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 14:30:56.953090 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 14:30:56.953090 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 14:30:56.953090 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:30:56.954520 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 463/931] 10.222.0.15 () {56 vars in 1111 bytes} [Tue May 31 14:30:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:56.960293 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1edb01-963f-4eb3-a321-850aa5433621 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:57.006091 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbcd17f-e559-4895-ba64-71cb75b23386 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:57.056283 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeb1c69-b65d-4377-9727-ea04c640ff3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:57.057040 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeb1c69-b65d-4377-9727-ea04c640ff3e None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:57.057313 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeb1c69-b65d-4377-9727-ea04c640ff3e None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:57.057776 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeb1c69-b65d-4377-9727-ea04c640ff3e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:57.071276 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeb1c69-b65d-4377-9727-ea04c640ff3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 14:30:57.081995 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-6eeb1c69-b65d-4377-9727-ea04c640ff3e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 31 14:30:57.081995 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:57.081995 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:57.081995 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:57.081995 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:57.081995 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:57.081995 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:57.081995 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:57.081995 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:57.081995 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:57.081995 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:57.081995 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:57.081995 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 14:30:57.081995 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 14:30:57.081995 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 14:30:57.081995 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 14:30:57.083036 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 14:30:57.083036 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 14:30:57.083036 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 14:30:57.083036 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 14:30:57.083036 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:57.083036 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:57.083036 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:57.083036 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:57.083036 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:57.083036 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:57.083036 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:57.083036 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:30:57.083036 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:57.083036 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:57.083036 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:57.083036 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:57.088747 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:57.088747 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:57.088747 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:57.088747 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:57.088747 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 14:30:57.088747 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 14:30:57.088747 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 14:30:57.088747 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 14:30:57.088747 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 14:30:57.088747 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 14:30:57.088747 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 31 14:30:57.088747 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:30:57.088747 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 469/932] 10.222.0.15 () {56 vars in 1120 bytes} [Tue May 31 14:30:56 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 14:30:57.088747 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79523eb-1892-478d-961f-419f6ff5b791 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:57.089506 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79523eb-1892-478d-961f-419f6ff5b791 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:57.089506 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79523eb-1892-478d-961f-419f6ff5b791 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:57.089506 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 470/933] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:30:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:30:57.092439 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79523eb-1892-478d-961f-419f6ff5b791 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:57.110937 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:57.124992 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1edb01-963f-4eb3-a321-850aa5433621 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:57.135356 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:57.166812 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d7dcd2-be5f-4b78-89fb-0ac7ad8d7b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:57.167483 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d7dcd2-be5f-4b78-89fb-0ac7ad8d7b4c None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:57.167770 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d7dcd2-be5f-4b78-89fb-0ac7ad8d7b4c None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:57.168048 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d7dcd2-be5f-4b78-89fb-0ac7ad8d7b4c None admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:57.168792 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d7dcd2-be5f-4b78-89fb-0ac7ad8d7b4c None admin] RBAC: Adding query filter params (name=service) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:57.169280 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d7dcd2-be5f-4b78-89fb-0ac7ad8d7b4c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:57.171059 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d7dcd2-be5f-4b78-89fb-0ac7ad8d7b4c None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:57.203013 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 464/934] 10.222.0.15 () {56 vars in 1112 bytes} [Tue May 31 14:30:56 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:57.204850 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37526f8e-1fd5-44b8-b6fa-6bb0e519eb50 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:57.205357 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37526f8e-1fd5-44b8-b6fa-6bb0e519eb50 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:57.206371 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37526f8e-1fd5-44b8-b6fa-6bb0e519eb50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:57.223781 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79523eb-1892-478d-961f-419f6ff5b791 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:57.259359 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-37526f8e-1fd5-44b8-b6fa-6bb0e519eb50 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:30:57.260922 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-37526f8e-1fd5-44b8-b6fa-6bb0e519eb50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:30:57.274398 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3600247d-f422-47ac-b0e1-4451df2bdc84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:57.275617 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3600247d-f422-47ac-b0e1-4451df2bdc84 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:57.276459 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3600247d-f422-47ac-b0e1-4451df2bdc84 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:57.277161 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3600247d-f422-47ac-b0e1-4451df2bdc84 None admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:57.278479 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3600247d-f422-47ac-b0e1-4451df2bdc84 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:57.279312 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3600247d-f422-47ac-b0e1-4451df2bdc84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:57.281744 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3600247d-f422-47ac-b0e1-4451df2bdc84 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:57.313350 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 471/935] 10.222.0.15 () {56 vars in 1115 bytes} [Tue May 31 14:30:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:57.315395 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3600247d-f422-47ac-b0e1-4451df2bdc84 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:57.408113 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 465/936] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:30:57 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 14:30:57.441015 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37526f8e-1fd5-44b8-b6fa-6bb0e519eb50 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:57.472639 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:57.516927 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3600247d-f422-47ac-b0e1-4451df2bdc84 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:57.558453 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4cd57e-f2d0-4e68-bfdc-507638399c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:57.559457 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4cd57e-f2d0-4e68-bfdc-507638399c70 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:57.559746 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4cd57e-f2d0-4e68-bfdc-507638399c70 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:57.560026 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4cd57e-f2d0-4e68-bfdc-507638399c70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:57.564078 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:57.568107 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37526f8e-1fd5-44b8-b6fa-6bb0e519eb50 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:57.574303 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4cd57e-f2d0-4e68-bfdc-507638399c70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:57.575827 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4cd57e-f2d0-4e68-bfdc-507638399c70 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:57.594489 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-9f4cd57e-f2d0-4e68-bfdc-507638399c70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:57.594489 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:57.594489 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:57.594489 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:57.594489 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:57.594489 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:57.594489 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:57.594489 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:57.594489 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:57.594489 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:57.594489 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:57.594489 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:57.594489 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 14:30:57.594489 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 14:30:57.594489 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 14:30:57.595449 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 14:30:57.595449 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:57.595449 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:57.595449 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:57.595449 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:57.595449 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:57.595449 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:57.595449 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:57.595449 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:30:57.595449 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:57.595449 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:57.595449 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:57.595449 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:57.595449 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:57.595449 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:57.595449 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:57.595449 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:57.597044 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 14:30:57.597044 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 14:30:57.597044 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:57.597044 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:30:57.597044 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 472/937] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:30:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:57.604073 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4cd57e-f2d0-4e68-bfdc-507638399c70 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:57.610860 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b36482a-fceb-463d-b5ac-128a27ba2621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:57.611934 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b36482a-fceb-463d-b5ac-128a27ba2621 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:57.612880 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b36482a-fceb-463d-b5ac-128a27ba2621 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:57.613310 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b36482a-fceb-463d-b5ac-128a27ba2621 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:57.614107 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b36482a-fceb-463d-b5ac-128a27ba2621 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:57.615645 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b36482a-fceb-463d-b5ac-128a27ba2621 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:57.629813 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-2b36482a-fceb-463d-b5ac-128a27ba2621 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 31 14:30:57.629813 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:57.629813 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 31 14:30:57.629813 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 31 14:30:57.629813 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 31 14:30:57.629813 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 31 14:30:57.629813 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 31 14:30:57.629813 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 14:30:57.629813 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 31 14:30:57.629813 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:30:57.629813 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 31 14:30:57.629813 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:30:57.629813 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:57.629813 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:57.629813 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:57.629813 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:57.631645 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:57.631645 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:57.631645 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:57.631645 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:57.631645 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:57.631645 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:57.631645 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:57.631645 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 31 14:30:57.631645 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_service(service_id) May 31 14:30:57.631645 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 31 14:30:57.631645 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 31 14:30:57.631645 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:57.631645 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:57.631645 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:57.631645 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:57.631645 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:57.632700 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:57.632700 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:57.632700 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:30:57.632700 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:57.632700 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:57.632700 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:57.632700 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:57.632700 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:57.632700 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:57.632700 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:57.632700 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:57.632700 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 31 14:30:57.632700 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 14:30:57.632700 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 31 14:30:57.632700 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:30:57.635282 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 466/938] 10.222.0.15 () {56 vars in 1132 bytes} [Tue May 31 14:30:57 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:57.641398 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b36482a-fceb-463d-b5ac-128a27ba2621 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:57.738123 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4cd57e-f2d0-4e68-bfdc-507638399c70 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:57.784550 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b36482a-fceb-463d-b5ac-128a27ba2621 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:57.797218 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:57.815779 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc21fe9-6193-4e4f-a772-74f97a65f781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:57.816730 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc21fe9-6193-4e4f-a772-74f97a65f781 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:57.817190 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc21fe9-6193-4e4f-a772-74f97a65f781 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:57.817640 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc21fe9-6193-4e4f-a772-74f97a65f781 None admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:57.818534 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc21fe9-6193-4e4f-a772-74f97a65f781 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:57.819034 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc21fe9-6193-4e4f-a772-74f97a65f781 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:57.820578 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc21fe9-6193-4e4f-a772-74f97a65f781 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:57.845378 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 473/939] 10.222.0.15 () {56 vars in 1109 bytes} [Tue May 31 14:30:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:57.850215 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc21fe9-6193-4e4f-a772-74f97a65f781 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:57.854858 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c926b69d-0d34-41ae-befc-bb52992a010a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:57.855804 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c926b69d-0d34-41ae-befc-bb52992a010a None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:57.856305 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c926b69d-0d34-41ae-befc-bb52992a010a None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:57.856775 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c926b69d-0d34-41ae-befc-bb52992a010a None admin] PATH_INFO: `/v3/services` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:57.857672 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c926b69d-0d34-41ae-befc-bb52992a010a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:57.858171 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c926b69d-0d34-41ae-befc-bb52992a010a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:57.866175 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c926b69d-0d34-41ae-befc-bb52992a010a None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:57.879743 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 467/940] 10.222.0.15 () {56 vars in 1126 bytes} [Tue May 31 14:30:57 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:57.880886 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c926b69d-0d34-41ae-befc-bb52992a010a None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:57.930745 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:58.037784 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc21fe9-6193-4e4f-a772-74f97a65f781 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:58.083545 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c926b69d-0d34-41ae-befc-bb52992a010a None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:58.122523 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fbae12-84e4-423a-a1d0-8900d7ab1cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:58.123750 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fbae12-84e4-423a-a1d0-8900d7ab1cc8 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:58.124233 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fbae12-84e4-423a-a1d0-8900d7ab1cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:58.124717 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fbae12-84e4-423a-a1d0-8900d7ab1cc8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:58.133174 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fbae12-84e4-423a-a1d0-8900d7ab1cc8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:58.135968 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fbae12-84e4-423a-a1d0-8900d7ab1cc8 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:58.143106 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9108e52e-fb95-4b1b-b302-8c46727fbc16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:58.148447 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9108e52e-fb95-4b1b-b302-8c46727fbc16 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:58.148950 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9108e52e-fb95-4b1b-b302-8c46727fbc16 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:58.149436 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9108e52e-fb95-4b1b-b302-8c46727fbc16 None admin] PATH_INFO: `/v3/services` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:58.150375 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9108e52e-fb95-4b1b-b302-8c46727fbc16 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:58.150901 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9108e52e-fb95-4b1b-b302-8c46727fbc16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:58.152465 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9108e52e-fb95-4b1b-b302-8c46727fbc16 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:58.161781 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-b8fbae12-84e4-423a-a1d0-8900d7ab1cc8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 31 14:30:58.161781 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:58.161781 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:58.161781 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:58.161781 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:58.161781 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:58.161781 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:58.161781 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:58.161781 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:58.161781 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:58.161781 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:58.161781 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:58.161781 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 14:30:58.161781 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 14:30:58.161781 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 14:30:58.161781 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 14:30:58.162763 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:58.162763 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:58.162763 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 14:30:58.162763 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 14:30:58.162763 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 14:30:58.162763 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 14:30:58.162763 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:58.162763 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:58.162763 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:58.162763 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:58.162763 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:58.162763 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:30:58.162763 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:58.162763 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:58.162763 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:58.162763 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:58.162763 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:58.162763 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:58.163706 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:58.163706 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:58.163706 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 14:30:58.163706 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 14:30:58.163706 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 14:30:58.163706 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 14:30:58.163706 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 14:30:58.163706 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 14:30:58.163706 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 31 14:30:58.163706 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:30:58.170577 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 468/941] 10.222.0.15 () {56 vars in 1126 bytes} [Tue May 31 14:30:57 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:58.172394 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 474/942] 10.222.0.15 () {56 vars in 1117 bytes} [Tue May 31 14:30:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:58.175792 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9108e52e-fb95-4b1b-b302-8c46727fbc16 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:58.180050 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fbae12-84e4-423a-a1d0-8900d7ab1cc8 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:58.358372 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:58.448465 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:58.483337 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9108e52e-fb95-4b1b-b302-8c46727fbc16 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:58.538996 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fbae12-84e4-423a-a1d0-8900d7ab1cc8 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:58.600709 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf91b4a-fc51-45f1-b4d4-7564f3185119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:58.601640 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf91b4a-fc51-45f1-b4d4-7564f3185119 None admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:58.602072 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf91b4a-fc51-45f1-b4d4-7564f3185119 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:58.602617 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf91b4a-fc51-45f1-b4d4-7564f3185119 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:58.603538 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf91b4a-fc51-45f1-b4d4-7564f3185119 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:58.605117 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf91b4a-fc51-45f1-b4d4-7564f3185119 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:58.630576 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdac333-6246-4286-8077-630bc6349d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:58.631184 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdac333-6246-4286-8077-630bc6349d65 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:58.631658 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdac333-6246-4286-8077-630bc6349d65 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:58.631943 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdac333-6246-4286-8077-630bc6349d65 None admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:58.633159 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdac333-6246-4286-8077-630bc6349d65 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:58.633535 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdac333-6246-4286-8077-630bc6349d65 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:58.635044 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdac333-6246-4286-8077-630bc6349d65 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:58.660155 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 475/943] 10.222.0.15 () {56 vars in 1149 bytes} [Tue May 31 14:30:58 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 480 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:58.661561 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a9925-0f8d-415f-9b61-4ee25f6c54b1 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:58.662367 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a9925-0f8d-415f-9b61-4ee25f6c54b1 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:58.662843 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a9925-0f8d-415f-9b61-4ee25f6c54b1 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:58.664219 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 476/944] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:30:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:30:58.665104 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758a9925-0f8d-415f-9b61-4ee25f6c54b1 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:58.694585 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 469/945] 10.222.0.15 () {60 vars in 1144 bytes} [Tue May 31 14:30:58 2022] POST /identity/v3/endpoints => generated 347 bytes in 511 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:30:58.694585 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7899f9f-2239-4760-9076-33ff4f532f08 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:58.694585 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7899f9f-2239-4760-9076-33ff4f532f08 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:58.694585 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7899f9f-2239-4760-9076-33ff4f532f08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:58.712204 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-e7899f9f-2239-4760-9076-33ff4f532f08 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:30:58.718041 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-e7899f9f-2239-4760-9076-33ff4f532f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:30:58.909130 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 470/946] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:30:58 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 14:30:58.933680 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7899f9f-2239-4760-9076-33ff4f532f08 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:58.964458 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758a9925-0f8d-415f-9b61-4ee25f6c54b1 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:58.967831 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:59.021742 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3062d6f0-5ca6-46e9-b588-fa9c1f2dca94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:59.022881 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3062d6f0-5ca6-46e9-b588-fa9c1f2dca94 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:59.023358 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3062d6f0-5ca6-46e9-b588-fa9c1f2dca94 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:59.023997 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3062d6f0-5ca6-46e9-b588-fa9c1f2dca94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:59.037348 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3062d6f0-5ca6-46e9-b588-fa9c1f2dca94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:59.039332 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3062d6f0-5ca6-46e9-b588-fa9c1f2dca94 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:59.056842 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:59.068534 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-3062d6f0-5ca6-46e9-b588-fa9c1f2dca94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:59.068534 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:59.068534 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:59.068534 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:59.068534 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:59.068534 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:59.068534 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:59.068534 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:59.068534 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:59.068534 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:59.068534 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:59.068534 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:59.068534 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 14:30:59.068534 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 14:30:59.068534 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 14:30:59.069439 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 14:30:59.069439 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:59.069439 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:59.069439 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:59.069439 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:59.069439 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:59.069439 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:59.069439 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:59.069439 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:30:59.069439 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:59.069439 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:59.069439 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:59.069439 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:59.069439 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:59.069439 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:59.069439 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:59.069439 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:59.070343 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 14:30:59.070343 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 14:30:59.070343 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:30:59.070343 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:30:59.073893 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 477/947] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:30:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 409 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:59.079510 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3062d6f0-5ca6-46e9-b588-fa9c1f2dca94 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:59.088132 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7899f9f-2239-4760-9076-33ff4f532f08 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:59.162158 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5174e03-a557-4cca-8cf9-2e38fe393deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:59.163452 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5174e03-a557-4cca-8cf9-2e38fe393deb None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:59.163739 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5174e03-a557-4cca-8cf9-2e38fe393deb None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:59.164024 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5174e03-a557-4cca-8cf9-2e38fe393deb None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:59.164681 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5174e03-a557-4cca-8cf9-2e38fe393deb None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:59.166094 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5174e03-a557-4cca-8cf9-2e38fe393deb None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:59.187224 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-e5174e03-a557-4cca-8cf9-2e38fe393deb None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 31 14:30:59.187224 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:59.187224 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 31 14:30:59.187224 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 31 14:30:59.187224 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 31 14:30:59.187224 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 31 14:30:59.187224 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 31 14:30:59.187224 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 14:30:59.187224 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 31 14:30:59.187224 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:30:59.187224 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 31 14:30:59.187224 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:30:59.187224 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:59.187224 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:59.187224 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:59.187224 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:59.187224 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:59.188306 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:59.188306 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:59.188306 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:59.188306 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:59.188306 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:59.188306 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:59.188306 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 31 14:30:59.188306 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_service(service_id) May 31 14:30:59.188306 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 31 14:30:59.188306 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 31 14:30:59.188306 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:59.188306 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:59.188306 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:59.188306 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:59.188306 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:59.188306 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:59.189171 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:59.189171 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:30:59.189171 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:59.189171 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:59.189171 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:59.189171 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:59.189171 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:59.189171 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:59.189171 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:59.189171 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:59.189171 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 31 14:30:59.189171 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 14:30:59.189171 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 31 14:30:59.189171 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:30:59.192444 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 471/948] 10.222.0.15 () {56 vars in 1126 bytes} [Tue May 31 14:30:58 2022] GET /identity/v3/services/object-store => generated 93 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:30:59.199030 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5174e03-a557-4cca-8cf9-2e38fe393deb None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:59.261579 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3062d6f0-5ca6-46e9-b588-fa9c1f2dca94 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:59.315657 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046f2a50-6c86-47fc-9497-1e7d492e5097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:59.316542 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f2a50-6c86-47fc-9497-1e7d492e5097 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:59.316930 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f2a50-6c86-47fc-9497-1e7d492e5097 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:59.317219 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f2a50-6c86-47fc-9497-1e7d492e5097 None admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:59.317952 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046f2a50-6c86-47fc-9497-1e7d492e5097 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:59.318264 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046f2a50-6c86-47fc-9497-1e7d492e5097 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:59.320330 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046f2a50-6c86-47fc-9497-1e7d492e5097 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:59.338225 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5174e03-a557-4cca-8cf9-2e38fe393deb None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:59.342630 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 478/949] 10.222.0.15 () {56 vars in 1109 bytes} [Tue May 31 14:30:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:59.344133 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046f2a50-6c86-47fc-9497-1e7d492e5097 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:59.370525 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:59.388922 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10069e04-9393-4e6d-9e7a-28521ee9a411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:59.390149 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10069e04-9393-4e6d-9e7a-28521ee9a411 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:59.390448 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10069e04-9393-4e6d-9e7a-28521ee9a411 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:59.390777 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10069e04-9393-4e6d-9e7a-28521ee9a411 None admin] PATH_INFO: `/v3/services` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:59.391496 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10069e04-9393-4e6d-9e7a-28521ee9a411 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:59.391808 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10069e04-9393-4e6d-9e7a-28521ee9a411 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:59.393848 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10069e04-9393-4e6d-9e7a-28521ee9a411 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:59.397027 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:59.405278 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 472/950] 10.222.0.15 () {56 vars in 1122 bytes} [Tue May 31 14:30:59 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:30:59.411397 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10069e04-9393-4e6d-9e7a-28521ee9a411 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:59.483236 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046f2a50-6c86-47fc-9497-1e7d492e5097 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:59.529980 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10069e04-9393-4e6d-9e7a-28521ee9a411 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:59.530667 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3bc8c0-d965-4354-94dc-6279f8a42932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:59.531372 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3bc8c0-d965-4354-94dc-6279f8a42932 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:59.531659 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3bc8c0-d965-4354-94dc-6279f8a42932 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:59.532189 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3bc8c0-d965-4354-94dc-6279f8a42932 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:59.541920 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3bc8c0-d965-4354-94dc-6279f8a42932 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:59.544300 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3bc8c0-d965-4354-94dc-6279f8a42932 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:59.561278 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-7e3bc8c0-d965-4354-94dc-6279f8a42932 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 14:30:59.561278 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:30:59.561278 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:30:59.561278 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:30:59.561278 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:30:59.561278 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:30:59.561278 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:30:59.561278 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:30:59.561278 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:30:59.561278 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:30:59.561278 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:30:59.561278 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:30:59.561278 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 14:30:59.561278 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 14:30:59.561278 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 14:30:59.562257 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 14:30:59.562257 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:30:59.562257 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:30:59.562257 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:30:59.562257 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:30:59.562257 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:30:59.562257 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:30:59.562257 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:30:59.562257 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:30:59.562257 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:30:59.562257 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:30:59.562257 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:30:59.562257 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:30:59.562257 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:30:59.562257 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:30:59.562257 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:30:59.562257 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:30:59.563277 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 14:30:59.563277 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 14:30:59.563277 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 14:30:59.563277 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 14:30:59.563277 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 14:30:59.563277 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 14:30:59.563277 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 14:30:59.563277 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:30:59.565875 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 479/951] 10.222.0.15 () {56 vars in 1111 bytes} [Tue May 31 14:30:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 14:30:59.571504 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3bc8c0-d965-4354-94dc-6279f8a42932 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:59.578677 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b89647-f45a-4b09-8a75-7419070811da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:59.579645 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b89647-f45a-4b09-8a75-7419070811da None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:59.580148 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b89647-f45a-4b09-8a75-7419070811da None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:59.581145 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b89647-f45a-4b09-8a75-7419070811da None admin] PATH_INFO: `/v3/services` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:59.582068 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b89647-f45a-4b09-8a75-7419070811da None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:59.582598 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b89647-f45a-4b09-8a75-7419070811da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:59.584179 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b89647-f45a-4b09-8a75-7419070811da None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:59.594614 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 473/952] 10.222.0.15 () {56 vars in 1122 bytes} [Tue May 31 14:30:59 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 14:30:59.595775 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b89647-f45a-4b09-8a75-7419070811da None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:59.664501 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:59.676311 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:59.700490 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3bc8c0-d965-4354-94dc-6279f8a42932 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:59.715329 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b89647-f45a-4b09-8a75-7419070811da None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:59.737636 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cb75d8-3c50-4cf9-8952-001936dc5874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:59.739828 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb75d8-3c50-4cf9-8952-001936dc5874 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:59.740336 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb75d8-3c50-4cf9-8952-001936dc5874 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:59.740820 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb75d8-3c50-4cf9-8952-001936dc5874 None admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:59.741848 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cb75d8-3c50-4cf9-8952-001936dc5874 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:30:59.742376 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cb75d8-3c50-4cf9-8952-001936dc5874 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:59.744028 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cb75d8-3c50-4cf9-8952-001936dc5874 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:59.757738 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b72353-1200-46ba-87e1-24366c77f6b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:59.758274 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 480/953] 10.222.0.15 () {56 vars in 1148 bytes} [Tue May 31 14:30:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 14:30:59.758486 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b72353-1200-46ba-87e1-24366c77f6b6 None admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:59.762818 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b72353-1200-46ba-87e1-24366c77f6b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:59.763342 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b72353-1200-46ba-87e1-24366c77f6b6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:59.764335 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cb75d8-3c50-4cf9-8952-001936dc5874 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:30:59.765488 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b72353-1200-46ba-87e1-24366c77f6b6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:59.766904 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b72353-1200-46ba-87e1-24366c77f6b6 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:59.859951 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 474/954] 10.222.0.15 () {60 vars in 1144 bytes} [Tue May 31 14:30:59 2022] POST /identity/v3/endpoints => generated 349 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:30:59.861270 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c0e181-b7fc-459a-a532-5c28dd7c3541 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:59.861619 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c0e181-b7fc-459a-a532-5c28dd7c3541 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:59.861902 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c0e181-b7fc-459a-a532-5c28dd7c3541 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:59.863338 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 475/955] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:30:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:30:59.869260 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed9d5b-8cd2-44c7-baaa-9e694672b73a None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:59.869705 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed9d5b-8cd2-44c7-baaa-9e694672b73a None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:59.869885 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed9d5b-8cd2-44c7-baaa-9e694672b73a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:59.888357 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cb75d8-3c50-4cf9-8952-001936dc5874 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:30:59.889181 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-efed9d5b-8cd2-44c7-baaa-9e694672b73a None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:30:59.890459 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-efed9d5b-8cd2-44c7-baaa-9e694672b73a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:30:59.946123 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:30:59.951418 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46824710-99db-4778-82b9-fc150bd77090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:30:59.952392 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46824710-99db-4778-82b9-fc150bd77090 None admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:30:59.952675 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46824710-99db-4778-82b9-fc150bd77090 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:30:59.952960 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46824710-99db-4778-82b9-fc150bd77090 None admin] PATH_INFO: `/v3/projects/ffff4334538649fdba1beb80cad207fa/users/735d2518c8404bd991acee533b314039/roles/c71617921821419bba278e390d70ac77` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:30:59.956619 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46824710-99db-4778-82b9-fc150bd77090 None admin] RBAC: Authorizing `identity:create_grant(project_id=ffff4334538649fdba1beb80cad207fa, user_id=735d2518c8404bd991acee533b314039, role_id=c71617921821419bba278e390d70ac77)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:30:59.960990 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46824710-99db-4778-82b9-fc150bd77090 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:30:59.980296 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 476/956] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:30:59 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 14:31:00.007045 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efed9d5b-8cd2-44c7-baaa-9e694672b73a None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:00.063545 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:00.073248 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 481/957] 10.222.0.15 () {58 vars in 1439 bytes} [Tue May 31 14:30:59 2022] PUT /identity/v3/projects/ffff4334538649fdba1beb80cad207fa/users/735d2518c8404bd991acee533b314039/roles/c71617921821419bba278e390d70ac77 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:31:00.131230 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efed9d5b-8cd2-44c7-baaa-9e694672b73a None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:00.174894 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958fd6a7-6f3f-4184-a3d2-2cab78d03c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:00.175592 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958fd6a7-6f3f-4184-a3d2-2cab78d03c74 None admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:00.176457 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958fd6a7-6f3f-4184-a3d2-2cab78d03c74 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:00.178632 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958fd6a7-6f3f-4184-a3d2-2cab78d03c74 None admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:00.178632 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958fd6a7-6f3f-4184-a3d2-2cab78d03c74 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:00.179874 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958fd6a7-6f3f-4184-a3d2-2cab78d03c74 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:00.242506 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.sql.core [None req-958fd6a7-6f3f-4184-a3d2-2cab78d03c74 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 31 14:31:00.242506 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 31 14:31:00.242506 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [parameters: {'user_id': '147f8122343b40be9d5bd2c86ffb097e', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 31 14:31:00.242506 dv-cinder-839793-14-smb devstack@keystone.service[80502]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80502) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 31 14:31:00.250666 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-958fd6a7-6f3f-4184-a3d2-2cab78d03c74 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 31 14:31:00.250666 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:31:00.250666 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 31 14:31:00.250666 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application self.dialect.do_execute( May 31 14:31:00.250666 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 31 14:31:00.250666 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 31 14:31:00.250666 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 31 14:31:00.250666 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application result = self._query(query) May 31 14:31:00.250666 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 31 14:31:00.250666 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application conn.query(q) May 31 14:31:00.250666 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 31 14:31:00.250666 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 31 14:31:00.250666 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 31 14:31:00.250666 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application result.read() May 31 14:31:00.250666 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 31 14:31:00.259311 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 31 14:31:00.259311 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 31 14:31:00.259311 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application packet.raise_for_error() May 31 14:31:00.259311 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 31 14:31:00.259311 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 31 14:31:00.259311 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 31 14:31:00.259311 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 31 14:31:00.259311 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 31 14:31:00.259311 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:31:00.259311 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 31 14:31:00.259311 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:31:00.259311 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:31:00.259311 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 31 14:31:00.259311 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 31 14:31:00.259311 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 31 14:31:00.259311 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 31 14:31:00.259311 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 31 14:31:00.259311 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application next(self.gen) May 31 14:31:00.260304 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 31 14:31:00.260304 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application yield resource May 31 14:31:00.260304 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 31 14:31:00.260304 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application next(self.gen) May 31 14:31:00.260304 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 31 14:31:00.260304 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application self.session.rollback() May 31 14:31:00.260304 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 31 14:31:00.260304 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application self.force_reraise() May 31 14:31:00.260304 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 31 14:31:00.260304 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise self.value May 31 14:31:00.260304 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 31 14:31:00.260304 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 31 14:31:00.260304 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 31 14:31:00.260304 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application session.commit() May 31 14:31:00.260304 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 31 14:31:00.260304 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 31 14:31:00.260304 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 31 14:31:00.261221 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application self._prepare_impl() May 31 14:31:00.261221 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 31 14:31:00.261221 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application self.session.flush() May 31 14:31:00.261221 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 31 14:31:00.261221 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application self._flush(objects) May 31 14:31:00.261221 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 31 14:31:00.261221 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 31 14:31:00.261221 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 31 14:31:00.261221 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application compat.raise_( May 31 14:31:00.261221 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 31 14:31:00.261221 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception May 31 14:31:00.261221 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 31 14:31:00.261221 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application flush_context.execute() May 31 14:31:00.261221 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 31 14:31:00.261221 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rec.execute(self) May 31 14:31:00.261221 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 31 14:31:00.261221 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 31 14:31:00.262120 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 31 14:31:00.262120 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application _emit_insert_statements( May 31 14:31:00.262120 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 31 14:31:00.262120 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application result = connection._execute_20( May 31 14:31:00.262120 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 31 14:31:00.262120 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 31 14:31:00.262120 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 31 14:31:00.262120 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 31 14:31:00.262120 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 31 14:31:00.262120 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ret = self._execute_context( May 31 14:31:00.262120 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 31 14:31:00.262120 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 31 14:31:00.262120 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 31 14:31:00.262120 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 31 14:31:00.262120 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 31 14:31:00.262120 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception May 31 14:31:00.263038 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 31 14:31:00.263038 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application self.dialect.do_execute( May 31 14:31:00.263038 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 31 14:31:00.263038 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 31 14:31:00.263038 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 31 14:31:00.263038 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application result = self._query(query) May 31 14:31:00.263038 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 31 14:31:00.263038 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application conn.query(q) May 31 14:31:00.263038 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 31 14:31:00.263038 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 31 14:31:00.263038 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 31 14:31:00.263038 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application result.read() May 31 14:31:00.263038 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 31 14:31:00.263038 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 31 14:31:00.263038 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 31 14:31:00.263038 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application packet.raise_for_error() May 31 14:31:00.263931 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 31 14:31:00.263931 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 31 14:31:00.263931 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 31 14:31:00.263931 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 31 14:31:00.263931 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 31 14:31:00.263931 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 31 14:31:00.263931 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [parameters: {'user_id': '147f8122343b40be9d5bd2c86ffb097e', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 31 14:31:00.263931 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 31 14:31:00.263931 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:31:00.263931 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 31 14:31:00.263931 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:31:00.263931 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:31:00.263931 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:31:00.263931 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:31:00.263931 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:31:00.264750 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:31:00.264750 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:31:00.264750 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:31:00.264750 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:31:00.264750 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:31:00.264750 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:31:00.264750 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:31:00.264750 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 31 14:31:00.264750 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 31 14:31:00.264750 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:31:00.264750 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:31:00.264750 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 14:31:00.264750 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 14:31:00.264750 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 14:31:00.264750 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 14:31:00.264750 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 31 14:31:00.264750 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 31 14:31:00.265663 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 31 14:31:00.265663 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 31 14:31:00.265663 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 31 14:31:00.265663 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 31 14:31:00.265663 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 31 14:31:00.265663 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:31:00.265663 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 477/958] 10.222.0.15 () {60 vars in 1131 bytes} [Tue May 31 14:31:00 2022] POST /identity/v3/users => generated 160 bytes in 247 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 31 14:31:00.272484 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46824710-99db-4778-82b9-fc150bd77090 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:00.398311 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46824710-99db-4778-82b9-fc150bd77090 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:00.437480 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e41209-ea1f-44c8-925f-245c369d438a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:00.438431 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e41209-ea1f-44c8-925f-245c369d438a None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:00.438820 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e41209-ea1f-44c8-925f-245c369d438a None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:00.439170 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e41209-ea1f-44c8-925f-245c369d438a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:00.447405 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e41209-ea1f-44c8-925f-245c369d438a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:00.448974 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e41209-ea1f-44c8-925f-245c369d438a None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:00.464914 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-c7e41209-ea1f-44c8-925f-245c369d438a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 31 14:31:00.464914 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:31:00.464914 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:31:00.464914 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:31:00.464914 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:31:00.464914 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:31:00.464914 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:31:00.464914 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:31:00.464914 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:31:00.464914 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:31:00.464914 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:31:00.464914 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:31:00.464914 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 14:31:00.464914 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 14:31:00.464914 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 14:31:00.464914 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 14:31:00.465895 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:31:00.465895 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:31:00.465895 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 14:31:00.465895 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 14:31:00.465895 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 14:31:00.465895 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 14:31:00.465895 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:31:00.465895 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:31:00.465895 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:31:00.465895 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:31:00.465895 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:31:00.465895 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:31:00.465895 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:31:00.465895 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:31:00.465895 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:31:00.465895 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:31:00.465895 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:31:00.465895 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:31:00.467249 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:31:00.467249 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:31:00.467249 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 14:31:00.467249 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 14:31:00.467249 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 14:31:00.467249 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 14:31:00.467249 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 14:31:00.467249 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 14:31:00.467249 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 31 14:31:00.467249 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:31:00.467249 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 482/959] 10.222.0.15 () {56 vars in 1099 bytes} [Tue May 31 14:31:00 2022] GET /identity/v3/users/cinder => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:31:00.473170 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958fd6a7-6f3f-4184-a3d2-2cab78d03c74 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:00.585054 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958fd6a7-6f3f-4184-a3d2-2cab78d03c74 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:00.610584 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:00.621270 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32c8027-3862-44f3-a788-cfe37ae81b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:00.624836 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c8027-3862-44f3-a788-cfe37ae81b5d None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:00.624836 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c8027-3862-44f3-a788-cfe37ae81b5d None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:00.624836 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c8027-3862-44f3-a788-cfe37ae81b5d None admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:00.624836 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32c8027-3862-44f3-a788-cfe37ae81b5d None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:31:00.624836 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32c8027-3862-44f3-a788-cfe37ae81b5d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:00.626286 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32c8027-3862-44f3-a788-cfe37ae81b5d None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:00.670474 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 478/960] 10.222.0.15 () {56 vars in 1101 bytes} [Tue May 31 14:31:00 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:31:01.185842 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd2b8d-c7e9-4db2-b346-ddd7102f9cdc None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:01.186365 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd2b8d-c7e9-4db2-b346-ddd7102f9cdc None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:01.186484 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cd2b8d-c7e9-4db2-b346-ddd7102f9cdc None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:01.187913 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 483/961] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:31:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:31:01.193085 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de850faa-3d74-42c1-bbd8-5c81bab3d779 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:01.193383 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de850faa-3d74-42c1-bbd8-5c81bab3d779 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:01.193661 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de850faa-3d74-42c1-bbd8-5c81bab3d779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:01.211203 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-de850faa-3d74-42c1-bbd8-5c81bab3d779 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:31:01.212693 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-de850faa-3d74-42c1-bbd8-5c81bab3d779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:31:01.279551 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 479/962] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:31:01 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 14:31:01.307053 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cd2b8d-c7e9-4db2-b346-ddd7102f9cdc None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:01.362324 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:01.410150 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cd2b8d-c7e9-4db2-b346-ddd7102f9cdc None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:01.444727 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a90c25b-a95c-4e23-9d35-c2c5db144bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:01.445452 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a90c25b-a95c-4e23-9d35-c2c5db144bd4 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:01.445841 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a90c25b-a95c-4e23-9d35-c2c5db144bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:01.446159 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a90c25b-a95c-4e23-9d35-c2c5db144bd4 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:01.446839 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a90c25b-a95c-4e23-9d35-c2c5db144bd4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:01.448196 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a90c25b-a95c-4e23-9d35-c2c5db144bd4 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:01.459912 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-9a90c25b-a95c-4e23-9d35-c2c5db144bd4 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 31 14:31:01.459912 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:31:01.459912 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 31 14:31:01.459912 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 31 14:31:01.459912 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 31 14:31:01.459912 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 31 14:31:01.459912 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 31 14:31:01.459912 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 14:31:01.459912 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 31 14:31:01.459912 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:31:01.459912 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 31 14:31:01.459912 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:31:01.459912 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:31:01.459912 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:31:01.459912 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:31:01.459912 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:31:01.459912 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:31:01.461002 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:31:01.461002 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:31:01.461002 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:31:01.461002 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:31:01.461002 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:31:01.461002 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:31:01.461002 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 31 14:31:01.461002 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_service(service_id) May 31 14:31:01.461002 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 31 14:31:01.461002 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 31 14:31:01.461002 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:31:01.461002 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:31:01.461002 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:31:01.461002 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:31:01.461002 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:31:01.461002 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:31:01.461878 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:31:01.461878 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:31:01.461878 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:31:01.461878 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:31:01.461878 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:31:01.461878 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:31:01.461878 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:31:01.461878 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:31:01.461878 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:31:01.461878 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:31:01.461878 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 31 14:31:01.461878 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 14:31:01.461878 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 31 14:31:01.461878 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:31:01.463292 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 484/963] 10.222.0.15 () {56 vars in 1111 bytes} [Tue May 31 14:31:01 2022] GET /identity/v3/services/compute => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:31:01.467029 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de850faa-3d74-42c1-bbd8-5c81bab3d779 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:01.565671 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:01.569457 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de850faa-3d74-42c1-bbd8-5c81bab3d779 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:01.603517 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048ecc08-f955-4614-b5cb-d3ef3de15c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:01.604174 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048ecc08-f955-4614-b5cb-d3ef3de15c3d None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:01.604454 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048ecc08-f955-4614-b5cb-d3ef3de15c3d None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:01.604733 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048ecc08-f955-4614-b5cb-d3ef3de15c3d None admin] PATH_INFO: `/v3/services` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:01.605431 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048ecc08-f955-4614-b5cb-d3ef3de15c3d None admin] RBAC: Adding query filter params (name=compute) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:31:01.605737 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048ecc08-f955-4614-b5cb-d3ef3de15c3d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:01.607132 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048ecc08-f955-4614-b5cb-d3ef3de15c3d None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:01.612077 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 480/964] 10.222.0.15 () {56 vars in 1112 bytes} [Tue May 31 14:31:01 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:31:01.617452 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a90c25b-a95c-4e23-9d35-c2c5db144bd4 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:01.716781 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a90c25b-a95c-4e23-9d35-c2c5db144bd4 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:01.732940 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:01.755192 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8ac179-fd0f-4149-a552-6d7ed5091c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:01.755866 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8ac179-fd0f-4149-a552-6d7ed5091c01 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:01.756153 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8ac179-fd0f-4149-a552-6d7ed5091c01 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:01.756435 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8ac179-fd0f-4149-a552-6d7ed5091c01 None admin] PATH_INFO: `/v3/services` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:01.757193 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8ac179-fd0f-4149-a552-6d7ed5091c01 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:31:01.757501 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8ac179-fd0f-4149-a552-6d7ed5091c01 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:01.758904 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8ac179-fd0f-4149-a552-6d7ed5091c01 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:01.765005 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 485/965] 10.222.0.15 () {56 vars in 1112 bytes} [Tue May 31 14:31:01 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:31:02.315960 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a443cc-be41-4ea0-be0e-92820f88f008 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:02.316278 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a443cc-be41-4ea0-be0e-92820f88f008 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:02.316530 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a443cc-be41-4ea0-be0e-92820f88f008 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:02.318043 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 481/966] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:31:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:31:02.323154 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8898ffa-82ac-4ac6-8d9a-92cb305367c5 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:02.323578 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8898ffa-82ac-4ac6-8d9a-92cb305367c5 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:02.323736 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8898ffa-82ac-4ac6-8d9a-92cb305367c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:02.340334 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-c8898ffa-82ac-4ac6-8d9a-92cb305367c5 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:31:02.341513 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-c8898ffa-82ac-4ac6-8d9a-92cb305367c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:31:02.408808 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 486/967] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:31:02 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 14:31:02.432074 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a443cc-be41-4ea0-be0e-92820f88f008 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:02.437729 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a3aa8-3bf8-4468-b239-d15c63f17f21 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:02.438018 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a3aa8-3bf8-4468-b239-d15c63f17f21 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:02.438295 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a3aa8-3bf8-4468-b239-d15c63f17f21 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:02.440295 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 487/968] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:31:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 31 14:31:02.445428 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f03b801-d9cb-407e-ada9-15c7b3fe91d0 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:02.445722 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f03b801-d9cb-407e-ada9-15c7b3fe91d0 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:02.446082 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f03b801-d9cb-407e-ada9-15c7b3fe91d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:02.462269 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-0f03b801-d9cb-407e-ada9-15c7b3fe91d0 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:31:02.463434 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-0f03b801-d9cb-407e-ada9-15c7b3fe91d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:31:02.535126 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 488/969] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:31:02 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 31 14:31:02.545406 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a443cc-be41-4ea0-be0e-92820f88f008 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:02.559640 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f03b801-d9cb-407e-ada9-15c7b3fe91d0 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:02.580287 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980c13e6-997b-491f-9ed4-1881489675f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:02.581116 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c13e6-997b-491f-9ed4-1881489675f2 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:02.581369 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c13e6-997b-491f-9ed4-1881489675f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:02.581635 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c13e6-997b-491f-9ed4-1881489675f2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:02.582279 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980c13e6-997b-491f-9ed4-1881489675f2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:02.583675 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980c13e6-997b-491f-9ed4-1881489675f2 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:02.596117 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-980c13e6-997b-491f-9ed4-1881489675f2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 31 14:31:02.596117 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:31:02.596117 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 31 14:31:02.596117 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 31 14:31:02.596117 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 31 14:31:02.596117 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 31 14:31:02.596117 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 31 14:31:02.596117 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 14:31:02.596117 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 31 14:31:02.596117 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:31:02.596117 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 31 14:31:02.596117 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:31:02.596117 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:31:02.596117 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:31:02.596117 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:31:02.596117 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:31:02.596117 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:31:02.597154 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:31:02.597154 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:31:02.597154 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:31:02.597154 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:31:02.597154 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:31:02.597154 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:31:02.597154 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 31 14:31:02.597154 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_service(service_id) May 31 14:31:02.597154 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 31 14:31:02.597154 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 31 14:31:02.597154 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:31:02.597154 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:31:02.597154 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:31:02.597154 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:31:02.597154 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:31:02.597154 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:31:02.603201 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:31:02.603201 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:31:02.603201 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:31:02.603201 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:31:02.603201 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:31:02.603201 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:31:02.603201 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:31:02.603201 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:31:02.603201 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:31:02.603201 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:31:02.603201 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 31 14:31:02.603201 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 14:31:02.603201 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 31 14:31:02.603201 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:31:02.603201 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 482/970] 10.222.0.15 () {56 vars in 1126 bytes} [Tue May 31 14:31:02 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:31:02.604470 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980c13e6-997b-491f-9ed4-1881489675f2 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:02.608086 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:02.635830 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:02.667771 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f03b801-d9cb-407e-ada9-15c7b3fe91d0 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:02.705230 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ca32e8-f612-4aaa-9b12-a2e510f8c6f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:02.706040 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca32e8-f612-4aaa-9b12-a2e510f8c6f7 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:02.706322 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca32e8-f612-4aaa-9b12-a2e510f8c6f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:02.706631 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca32e8-f612-4aaa-9b12-a2e510f8c6f7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:02.710100 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980c13e6-997b-491f-9ed4-1881489675f2 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:02.717026 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ca32e8-f612-4aaa-9b12-a2e510f8c6f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 14:31:02.725617 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-80ca32e8-f612-4aaa-9b12-a2e510f8c6f7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 31 14:31:02.725617 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:31:02.725617 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:31:02.725617 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:31:02.725617 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:31:02.725617 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:31:02.725617 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:31:02.725617 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:31:02.725617 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:31:02.725617 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:31:02.725617 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:31:02.725617 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:31:02.725617 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 14:31:02.725617 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 14:31:02.725617 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 14:31:02.725617 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 14:31:02.726570 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 14:31:02.726570 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 14:31:02.726570 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 14:31:02.726570 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 14:31:02.726570 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:31:02.726570 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:31:02.726570 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:31:02.726570 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:31:02.726570 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:31:02.726570 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:31:02.726570 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:31:02.726570 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:31:02.726570 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:31:02.726570 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:31:02.726570 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:31:02.726570 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:31:02.727426 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:31:02.727426 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:31:02.727426 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:31:02.727426 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:31:02.727426 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 14:31:02.727426 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 14:31:02.727426 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 14:31:02.727426 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 14:31:02.727426 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 14:31:02.727426 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 14:31:02.727426 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 31 14:31:02.727426 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:31:02.727426 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 489/971] 10.222.0.15 () {56 vars in 1120 bytes} [Tue May 31 14:31:02 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 14:31:02.732550 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ca32e8-f612-4aaa-9b12-a2e510f8c6f7 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:02.746508 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53789107-200f-4b4c-b6dc-ff2ac07a0896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:02.747198 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53789107-200f-4b4c-b6dc-ff2ac07a0896 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:02.747479 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53789107-200f-4b4c-b6dc-ff2ac07a0896 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:02.747752 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53789107-200f-4b4c-b6dc-ff2ac07a0896 None admin] PATH_INFO: `/v3/services` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:02.748446 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53789107-200f-4b4c-b6dc-ff2ac07a0896 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:31:02.748754 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53789107-200f-4b4c-b6dc-ff2ac07a0896 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:02.750108 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53789107-200f-4b4c-b6dc-ff2ac07a0896 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:02.755608 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 483/972] 10.222.0.15 () {56 vars in 1122 bytes} [Tue May 31 14:31:02 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 14:31:02.760747 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53789107-200f-4b4c-b6dc-ff2ac07a0896 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:02.833557 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:02.836516 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ca32e8-f612-4aaa-9b12-a2e510f8c6f7 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:02.854240 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:02.863247 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53789107-200f-4b4c-b6dc-ff2ac07a0896 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:02.878222 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01940043-4d7d-4aa9-a398-9cbe88774d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:02.879078 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01940043-4d7d-4aa9-a398-9cbe88774d53 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:02.879363 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01940043-4d7d-4aa9-a398-9cbe88774d53 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:02.879926 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01940043-4d7d-4aa9-a398-9cbe88774d53 None admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:02.880669 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01940043-4d7d-4aa9-a398-9cbe88774d53 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:31:02.880975 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01940043-4d7d-4aa9-a398-9cbe88774d53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:02.882369 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01940043-4d7d-4aa9-a398-9cbe88774d53 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:02.891264 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 490/973] 10.222.0.15 () {56 vars in 1115 bytes} [Tue May 31 14:31:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 14:31:02.897125 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01940043-4d7d-4aa9-a398-9cbe88774d53 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:02.904031 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55906e16-ed66-4513-a1ff-ec23b0a60655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:02.904695 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55906e16-ed66-4513-a1ff-ec23b0a60655 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:02.904977 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55906e16-ed66-4513-a1ff-ec23b0a60655 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:02.905247 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55906e16-ed66-4513-a1ff-ec23b0a60655 None admin] PATH_INFO: `/v3/services` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:02.906235 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55906e16-ed66-4513-a1ff-ec23b0a60655 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:31:02.906235 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55906e16-ed66-4513-a1ff-ec23b0a60655 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:02.907879 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55906e16-ed66-4513-a1ff-ec23b0a60655 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:02.913451 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 484/974] 10.222.0.15 () {56 vars in 1122 bytes} [Tue May 31 14:31:02 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:31:02.919064 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55906e16-ed66-4513-a1ff-ec23b0a60655 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:03.008007 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01940043-4d7d-4aa9-a398-9cbe88774d53 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:03.024356 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55906e16-ed66-4513-a1ff-ec23b0a60655 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:03.045117 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1689dc6-2a8d-410c-bcde-b9bea31ed61a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:03.045908 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1689dc6-2a8d-410c-bcde-b9bea31ed61a None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:03.046197 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1689dc6-2a8d-410c-bcde-b9bea31ed61a None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:03.046472 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1689dc6-2a8d-410c-bcde-b9bea31ed61a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:03.057710 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1689dc6-2a8d-410c-bcde-b9bea31ed61a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:03.059211 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1689dc6-2a8d-410c-bcde-b9bea31ed61a None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:03.060986 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4f9319-fb06-420e-9f63-b7bd6ef4b2d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:03.061814 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4f9319-fb06-420e-9f63-b7bd6ef4b2d6 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:03.062237 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4f9319-fb06-420e-9f63-b7bd6ef4b2d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:03.062771 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4f9319-fb06-420e-9f63-b7bd6ef4b2d6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:03.064008 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4f9319-fb06-420e-9f63-b7bd6ef4b2d6 None admin] RBAC: Adding query filter params (interface=admin, service_id=e778753f339f46c0beda911bc0d9e34d, region_id=RegionOne) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:31:03.064499 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4f9319-fb06-420e-9f63-b7bd6ef4b2d6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:03.066519 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4f9319-fb06-420e-9f63-b7bd6ef4b2d6 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:03.073346 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 485/975] 10.222.0.15 () {56 vars in 1249 bytes} [Tue May 31 14:31:02 2022] GET /identity/v3/endpoints?service_id=e778753f339f46c0beda911bc0d9e34d&interface=admin®ion_id=RegionOne => generated 193 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 14:31:03.076873 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-b1689dc6-2a8d-410c-bcde-b9bea31ed61a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:31:03.076873 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:31:03.076873 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:31:03.076873 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:31:03.076873 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:31:03.076873 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:31:03.076873 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:31:03.076873 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:31:03.076873 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:31:03.076873 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:31:03.076873 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:31:03.076873 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:31:03.076873 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 14:31:03.076873 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 14:31:03.076873 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 14:31:03.077768 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 14:31:03.077768 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:31:03.077768 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:31:03.077768 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:31:03.077768 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:31:03.077768 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:31:03.077768 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:31:03.077768 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:31:03.077768 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:31:03.077768 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:31:03.077768 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:31:03.077768 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:31:03.077768 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:31:03.077768 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:31:03.077768 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:31:03.077768 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:31:03.077768 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:31:03.078809 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 14:31:03.078809 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 14:31:03.078809 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:31:03.078809 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:31:03.079050 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4f9319-fb06-420e-9f63-b7bd6ef4b2d6 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:03.083134 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 491/976] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:31:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:31:03.084024 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1689dc6-2a8d-410c-bcde-b9bea31ed61a None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:03.101530 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:03.102791 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:03.189632 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1689dc6-2a8d-410c-bcde-b9bea31ed61a None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:03.190031 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4f9319-fb06-420e-9f63-b7bd6ef4b2d6 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:03.226006 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbd995f-937c-4ff7-91cb-6e1bcc75bf6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:03.226191 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3a0a96-9dd2-495c-a93b-5261f4e4397e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:03.226703 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd995f-937c-4ff7-91cb-6e1bcc75bf6e None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:03.226881 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a0a96-9dd2-495c-a93b-5261f4e4397e None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:03.227000 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd995f-937c-4ff7-91cb-6e1bcc75bf6e None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:03.227172 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a0a96-9dd2-495c-a93b-5261f4e4397e None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:03.227268 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd995f-937c-4ff7-91cb-6e1bcc75bf6e None admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:03.227437 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a0a96-9dd2-495c-a93b-5261f4e4397e None admin] PATH_INFO: `/v3/services` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:03.227962 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbd995f-937c-4ff7-91cb-6e1bcc75bf6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:31:03.228129 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3a0a96-9dd2-495c-a93b-5261f4e4397e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:03.228280 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbd995f-937c-4ff7-91cb-6e1bcc75bf6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:03.229470 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3a0a96-9dd2-495c-a93b-5261f4e4397e None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:03.229626 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbd995f-937c-4ff7-91cb-6e1bcc75bf6e None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:03.235716 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 486/977] 10.222.0.15 () {56 vars in 1087 bytes} [Tue May 31 14:31:03 2022] GET /identity/v3/services => generated 1497 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:31:03.245984 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 492/978] 10.222.0.15 () {56 vars in 1109 bytes} [Tue May 31 14:31:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:31:03.247232 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3a0a96-9dd2-495c-a93b-5261f4e4397e None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:03.356615 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:03.373831 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3a0a96-9dd2-495c-a93b-5261f4e4397e None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:03.416399 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6deb31-a56d-4ec5-a087-3894a5c09c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:03.417244 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6deb31-a56d-4ec5-a087-3894a5c09c83 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:03.417531 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6deb31-a56d-4ec5-a087-3894a5c09c83 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:03.417806 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6deb31-a56d-4ec5-a087-3894a5c09c83 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:03.425983 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6deb31-a56d-4ec5-a087-3894a5c09c83 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:03.427501 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6deb31-a56d-4ec5-a087-3894a5c09c83 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:03.444197 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-0a6deb31-a56d-4ec5-a087-3894a5c09c83 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 31 14:31:03.444197 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:31:03.444197 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:31:03.444197 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:31:03.444197 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:31:03.444197 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:31:03.444197 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:31:03.444197 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:31:03.444197 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:31:03.444197 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:31:03.444197 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:31:03.444197 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:31:03.444197 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 14:31:03.444197 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 14:31:03.444197 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 14:31:03.444197 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 14:31:03.445179 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:31:03.445179 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:31:03.445179 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 14:31:03.445179 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 14:31:03.445179 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 14:31:03.445179 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 14:31:03.445179 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:31:03.445179 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:31:03.445179 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:31:03.445179 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:31:03.445179 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:31:03.445179 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:31:03.445179 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:31:03.445179 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:31:03.445179 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:31:03.445179 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:31:03.445179 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:31:03.445179 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:31:03.446119 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:31:03.446119 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:31:03.446119 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 14:31:03.446119 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 14:31:03.446119 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 14:31:03.446119 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 14:31:03.446119 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 14:31:03.446119 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 14:31:03.446119 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 31 14:31:03.446119 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:31:03.446119 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 487/979] 10.222.0.15 () {56 vars in 1117 bytes} [Tue May 31 14:31:03 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:31:03.451144 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbd995f-937c-4ff7-91cb-6e1bcc75bf6e None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:03.530946 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:03.555261 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbd995f-937c-4ff7-91cb-6e1bcc75bf6e None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:03.590036 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402b8201-6f54-4d44-9567-b054cd840de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:03.590747 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b8201-6f54-4d44-9567-b054cd840de0 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:03.591037 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b8201-6f54-4d44-9567-b054cd840de0 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:03.591319 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b8201-6f54-4d44-9567-b054cd840de0 None admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:03.592145 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402b8201-6f54-4d44-9567-b054cd840de0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:31:03.592456 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402b8201-6f54-4d44-9567-b054cd840de0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:03.593888 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402b8201-6f54-4d44-9567-b054cd840de0 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:03.611423 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 493/980] 10.222.0.15 () {56 vars in 1149 bytes} [Tue May 31 14:31:03 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:31:03.617236 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6deb31-a56d-4ec5-a087-3894a5c09c83 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:03.721538 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6deb31-a56d-4ec5-a087-3894a5c09c83 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:03.758461 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8e7600-f2e9-4403-85d5-fa2373dc0d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:03.759143 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e7600-f2e9-4403-85d5-fa2373dc0d4f None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:03.759429 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e7600-f2e9-4403-85d5-fa2373dc0d4f None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:03.759706 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e7600-f2e9-4403-85d5-fa2373dc0d4f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:03.774877 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:03.828695 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8e7600-f2e9-4403-85d5-fa2373dc0d4f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:03.830178 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8e7600-f2e9-4403-85d5-fa2373dc0d4f None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:03.926847 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 488/981] 10.222.0.15 () {58 vars in 1282 bytes} [Tue May 31 14:31:03 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 31 14:31:03.932366 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402b8201-6f54-4d44-9567-b054cd840de0 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:04.035189 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402b8201-6f54-4d44-9567-b054cd840de0 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:04.036725 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b97a5a-dd36-494f-918b-e85bfe7f4071 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:04.037015 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b97a5a-dd36-494f-918b-e85bfe7f4071 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:04.037296 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b97a5a-dd36-494f-918b-e85bfe7f4071 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:04.038829 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 489/982] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:31:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:31:04.043479 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f08aa7-a0cb-4300-a19c-8b6d74fc58da None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:04.043769 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f08aa7-a0cb-4300-a19c-8b6d74fc58da None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:04.044050 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f08aa7-a0cb-4300-a19c-8b6d74fc58da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:04.060709 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-92f08aa7-a0cb-4300-a19c-8b6d74fc58da None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:31:04.061889 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-92f08aa7-a0cb-4300-a19c-8b6d74fc58da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:31:04.067265 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:04.072871 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4aa9c1-af45-494d-af0a-61d87988e90b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:04.073676 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4aa9c1-af45-494d-af0a-61d87988e90b None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:04.073970 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4aa9c1-af45-494d-af0a-61d87988e90b None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:04.074250 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4aa9c1-af45-494d-af0a-61d87988e90b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:04.085133 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4aa9c1-af45-494d-af0a-61d87988e90b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:04.086619 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4aa9c1-af45-494d-af0a-61d87988e90b None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:04.103359 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:04.104666 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-fa4aa9c1-af45-494d-af0a-61d87988e90b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:31:04.104666 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:31:04.104666 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:31:04.104666 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:31:04.104666 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:31:04.104666 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:31:04.104666 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:31:04.104666 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:31:04.104666 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:31:04.104666 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:31:04.104666 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:31:04.104666 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:31:04.104666 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 14:31:04.104666 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 14:31:04.104666 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 14:31:04.105770 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 14:31:04.105770 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:31:04.105770 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:31:04.105770 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:31:04.105770 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:31:04.105770 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:31:04.105770 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:31:04.105770 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:31:04.105770 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:31:04.105770 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:31:04.105770 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:31:04.105770 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:31:04.105770 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:31:04.105770 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:31:04.105770 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:31:04.105770 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:31:04.105770 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:31:04.106864 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 14:31:04.106864 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 14:31:04.106864 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:31:04.106864 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:31:04.114051 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 494/983] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:31:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:31:04.116644 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4aa9c1-af45-494d-af0a-61d87988e90b None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:04.142743 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 490/984] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:31:04 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 31 14:31:04.159223 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f08aa7-a0cb-4300-a19c-8b6d74fc58da None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:04.223171 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4aa9c1-af45-494d-af0a-61d87988e90b None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:04.258771 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac58ac0d-72d9-449a-87ca-ebe5cfc6c6e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:04.259461 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac58ac0d-72d9-449a-87ca-ebe5cfc6c6e1 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:04.259714 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac58ac0d-72d9-449a-87ca-ebe5cfc6c6e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:04.259992 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac58ac0d-72d9-449a-87ca-ebe5cfc6c6e1 None admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:04.260708 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac58ac0d-72d9-449a-87ca-ebe5cfc6c6e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:31:04.261018 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac58ac0d-72d9-449a-87ca-ebe5cfc6c6e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:04.262511 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac58ac0d-72d9-449a-87ca-ebe5cfc6c6e1 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:04.268468 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f08aa7-a0cb-4300-a19c-8b6d74fc58da None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:04.273728 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 495/985] 10.222.0.15 () {56 vars in 1109 bytes} [Tue May 31 14:31:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:31:04.279091 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac58ac0d-72d9-449a-87ca-ebe5cfc6c6e1 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:04.312909 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c314444-ec32-425e-9ffb-161d8a1e243d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:04.313906 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c314444-ec32-425e-9ffb-161d8a1e243d None admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:04.314505 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c314444-ec32-425e-9ffb-161d8a1e243d None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:04.314806 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c314444-ec32-425e-9ffb-161d8a1e243d None admin] PATH_INFO: `/v3/services` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:04.315529 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c314444-ec32-425e-9ffb-161d8a1e243d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:04.316906 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c314444-ec32-425e-9ffb-161d8a1e243d None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:04.330837 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:04.385296 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac58ac0d-72d9-449a-87ca-ebe5cfc6c6e1 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:04.418006 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 491/986] 10.222.0.15 () {60 vars in 1141 bytes} [Tue May 31 14:31:04 2022] POST /identity/v3/services => generated 242 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:31:04.431109 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2d8882-24f7-4907-b6c0-3ac00b932bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:04.431976 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2d8882-24f7-4907-b6c0-3ac00b932bbc None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:04.432266 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2d8882-24f7-4907-b6c0-3ac00b932bbc None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:04.432547 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2d8882-24f7-4907-b6c0-3ac00b932bbc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:04.440835 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2d8882-24f7-4907-b6c0-3ac00b932bbc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:04.443260 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2d8882-24f7-4907-b6c0-3ac00b932bbc None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:04.460685 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-4f2d8882-24f7-4907-b6c0-3ac00b932bbc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 14:31:04.460685 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:31:04.460685 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:31:04.460685 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:31:04.460685 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:31:04.460685 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:31:04.460685 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:31:04.460685 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:31:04.460685 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:31:04.460685 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:31:04.460685 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:31:04.460685 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:31:04.460685 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 14:31:04.460685 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 14:31:04.460685 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 14:31:04.462157 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 14:31:04.462157 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:31:04.462157 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:31:04.462157 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:31:04.462157 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:31:04.462157 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:31:04.462157 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:31:04.462157 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:31:04.462157 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:31:04.462157 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:31:04.462157 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:31:04.462157 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:31:04.462157 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:31:04.462157 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:31:04.462157 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:31:04.462157 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:31:04.462157 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:31:04.469305 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 14:31:04.469305 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 14:31:04.469305 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 14:31:04.469305 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 14:31:04.469305 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 14:31:04.469305 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 14:31:04.469305 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 14:31:04.469305 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:31:04.469305 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 496/987] 10.222.0.15 () {56 vars in 1111 bytes} [Tue May 31 14:31:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 14:31:04.469951 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c314444-ec32-425e-9ffb-161d8a1e243d None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:04.507972 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:04.580612 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c314444-ec32-425e-9ffb-161d8a1e243d None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:04.617063 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4722cda-add6-4e16-956b-1ce97657f009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:04.617926 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4722cda-add6-4e16-956b-1ce97657f009 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:04.618496 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4722cda-add6-4e16-956b-1ce97657f009 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:04.618686 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4722cda-add6-4e16-956b-1ce97657f009 None admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:04.619588 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4722cda-add6-4e16-956b-1ce97657f009 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:31:04.619992 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4722cda-add6-4e16-956b-1ce97657f009 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:04.621625 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4722cda-add6-4e16-956b-1ce97657f009 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:04.635499 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 492/988] 10.222.0.15 () {56 vars in 1148 bytes} [Tue May 31 14:31:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:31:04.641719 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2d8882-24f7-4907-b6c0-3ac00b932bbc None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:04.753271 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:04.756681 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2d8882-24f7-4907-b6c0-3ac00b932bbc None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:04.792490 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221d9d94-34f1-4d5e-94b2-a509c4be7121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:04.793244 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221d9d94-34f1-4d5e-94b2-a509c4be7121 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:04.793606 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221d9d94-34f1-4d5e-94b2-a509c4be7121 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:04.793962 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221d9d94-34f1-4d5e-94b2-a509c4be7121 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:04.794899 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221d9d94-34f1-4d5e-94b2-a509c4be7121 None admin] RBAC: Adding query filter params (role.id=c71617921821419bba278e390d70ac77, scope.project.id=ffff4334538649fdba1beb80cad207fa, user.id=735d2518c8404bd991acee533b314039) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:31:04.795288 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221d9d94-34f1-4d5e-94b2-a509c4be7121 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:04.796839 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221d9d94-34f1-4d5e-94b2-a509c4be7121 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:04.803188 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 497/989] 10.222.0.15 () {56 vars in 1374 bytes} [Tue May 31 14:31:04 2022] GET /identity/v3/role_assignments?user.id=735d2518c8404bd991acee533b314039&scope.project.id=ffff4334538649fdba1beb80cad207fa&role.id=c71617921821419bba278e390d70ac77 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:31:05.523246 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a80308-3501-496e-a5a5-91e5b438232f None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:05.523614 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a80308-3501-496e-a5a5-91e5b438232f None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:05.523818 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a80308-3501-496e-a5a5-91e5b438232f None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:05.525343 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 493/990] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:31:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:31:05.530597 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3553f5-932d-419a-bc00-e719513a28c1 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:05.531045 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3553f5-932d-419a-bc00-e719513a28c1 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:05.531226 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3553f5-932d-419a-bc00-e719513a28c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:05.548129 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-2e3553f5-932d-419a-bc00-e719513a28c1 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:31:05.549732 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-2e3553f5-932d-419a-bc00-e719513a28c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:31:05.621443 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 498/991] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:31:05 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 31 14:31:05.644924 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a80308-3501-496e-a5a5-91e5b438232f None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:05.741715 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:05.749912 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a80308-3501-496e-a5a5-91e5b438232f None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:05.784258 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9109bf1c-bbfd-4337-b69b-4c379d5ef857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:05.785061 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9109bf1c-bbfd-4337-b69b-4c379d5ef857 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:05.785346 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9109bf1c-bbfd-4337-b69b-4c379d5ef857 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:05.785626 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9109bf1c-bbfd-4337-b69b-4c379d5ef857 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:05.786278 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9109bf1c-bbfd-4337-b69b-4c379d5ef857 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:05.787790 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9109bf1c-bbfd-4337-b69b-4c379d5ef857 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:05.801041 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-9109bf1c-bbfd-4337-b69b-4c379d5ef857 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 31 14:31:05.801041 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:31:05.801041 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 31 14:31:05.801041 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 31 14:31:05.801041 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 31 14:31:05.801041 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 31 14:31:05.801041 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 31 14:31:05.801041 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 14:31:05.801041 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 31 14:31:05.801041 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:31:05.801041 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 31 14:31:05.801041 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:31:05.801041 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:31:05.801041 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:31:05.801041 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:31:05.801041 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:31:05.801041 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:31:05.802008 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:31:05.802008 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:31:05.802008 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:31:05.802008 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:31:05.802008 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:31:05.802008 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:31:05.802008 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 31 14:31:05.802008 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_service(service_id) May 31 14:31:05.802008 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 31 14:31:05.802008 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 31 14:31:05.802008 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:31:05.802008 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:31:05.802008 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:31:05.802008 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:31:05.802008 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:31:05.802008 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:31:05.803229 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:31:05.803229 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:31:05.803229 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:31:05.803229 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:31:05.803229 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:31:05.803229 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:31:05.803229 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:31:05.803229 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:31:05.803229 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:31:05.803229 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:31:05.803229 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 31 14:31:05.803229 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 14:31:05.803229 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 31 14:31:05.803229 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:31:05.806868 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 494/992] 10.222.0.15 () {56 vars in 1126 bytes} [Tue May 31 14:31:05 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:31:05.808306 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3553f5-932d-419a-bc00-e719513a28c1 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:05.899282 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:05.906785 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3553f5-932d-419a-bc00-e719513a28c1 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:05.941303 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9a90bf-49f9-467c-80d1-00a4a468766c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:05.941997 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9a90bf-49f9-467c-80d1-00a4a468766c None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:05.942282 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9a90bf-49f9-467c-80d1-00a4a468766c None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:05.942590 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9a90bf-49f9-467c-80d1-00a4a468766c None admin] PATH_INFO: `/v3/services` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:05.943318 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9a90bf-49f9-467c-80d1-00a4a468766c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:31:05.943631 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9a90bf-49f9-467c-80d1-00a4a468766c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:05.945036 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9a90bf-49f9-467c-80d1-00a4a468766c None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:05.955255 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 499/993] 10.222.0.15 () {56 vars in 1122 bytes} [Tue May 31 14:31:05 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:31:05.956310 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9109bf1c-bbfd-4337-b69b-4c379d5ef857 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:06.057750 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9109bf1c-bbfd-4337-b69b-4c379d5ef857 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:06.092964 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdfef37-81a2-4a34-a5ff-e2a31f24a47f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:06.093632 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdfef37-81a2-4a34-a5ff-e2a31f24a47f None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:06.093919 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdfef37-81a2-4a34-a5ff-e2a31f24a47f None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:06.094203 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdfef37-81a2-4a34-a5ff-e2a31f24a47f None admin] PATH_INFO: `/v3/services` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:06.094939 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdfef37-81a2-4a34-a5ff-e2a31f24a47f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:31:06.095250 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdfef37-81a2-4a34-a5ff-e2a31f24a47f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:06.097170 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdfef37-81a2-4a34-a5ff-e2a31f24a47f None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:06.106895 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 495/994] 10.222.0.15 () {56 vars in 1122 bytes} [Tue May 31 14:31:05 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:31:06.107872 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9a90bf-49f9-467c-80d1-00a4a468766c None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:06.206763 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9a90bf-49f9-467c-80d1-00a4a468766c None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:06.241183 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaad7971-584b-4dfc-bac3-14e2bdb6152e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:06.241843 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaad7971-584b-4dfc-bac3-14e2bdb6152e None admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:06.242132 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaad7971-584b-4dfc-bac3-14e2bdb6152e None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:06.242415 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaad7971-584b-4dfc-bac3-14e2bdb6152e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:06.243187 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaad7971-584b-4dfc-bac3-14e2bdb6152e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:06.244556 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaad7971-584b-4dfc-bac3-14e2bdb6152e None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:06.328586 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 500/995] 10.222.0.15 () {60 vars in 1144 bytes} [Tue May 31 14:31:06 2022] POST /identity/v3/endpoints => generated 325 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 14:31:06.716896 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c78b89-e2c6-4386-a016-0f7e07a66310 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:06.716896 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c78b89-e2c6-4386-a016-0f7e07a66310 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:06.717519 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c78b89-e2c6-4386-a016-0f7e07a66310 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:06.718529 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 496/996] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:31:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:31:06.724240 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae472c4-e7ff-46bd-9b0d-c9d5d48837af None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:06.724657 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae472c4-e7ff-46bd-9b0d-c9d5d48837af None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:06.724824 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae472c4-e7ff-46bd-9b0d-c9d5d48837af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:06.742310 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-dae472c4-e7ff-46bd-9b0d-c9d5d48837af None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:31:06.743787 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-dae472c4-e7ff-46bd-9b0d-c9d5d48837af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:31:06.760244 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:06.825079 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 501/997] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:31:06 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 14:31:06.848519 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c78b89-e2c6-4386-a016-0f7e07a66310 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:06.874032 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:06.951348 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c78b89-e2c6-4386-a016-0f7e07a66310 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:06.983317 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29ea989-d5b1-4f4c-b7e3-308c9e58e299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:06.984043 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29ea989-d5b1-4f4c-b7e3-308c9e58e299 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:06.984324 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29ea989-d5b1-4f4c-b7e3-308c9e58e299 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:06.984597 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29ea989-d5b1-4f4c-b7e3-308c9e58e299 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:06.985240 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29ea989-d5b1-4f4c-b7e3-308c9e58e299 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:06.987173 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29ea989-d5b1-4f4c-b7e3-308c9e58e299 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:06.998695 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-c29ea989-d5b1-4f4c-b7e3-308c9e58e299 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 31 14:31:06.998695 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:31:06.998695 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 31 14:31:06.998695 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 31 14:31:06.998695 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 31 14:31:06.998695 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 31 14:31:06.998695 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 31 14:31:06.998695 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 14:31:06.998695 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 31 14:31:06.998695 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:31:06.998695 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 31 14:31:06.998695 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:31:06.998695 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:31:06.998695 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:31:06.998695 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:31:06.998695 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:31:06.998695 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:31:06.999671 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:31:06.999671 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:31:06.999671 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:31:06.999671 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:31:06.999671 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:31:06.999671 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:31:06.999671 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 31 14:31:06.999671 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_service(service_id) May 31 14:31:06.999671 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 31 14:31:06.999671 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 31 14:31:06.999671 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:31:06.999671 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:31:06.999671 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:31:06.999671 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:31:06.999671 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:31:06.999671 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:31:07.006103 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:31:07.006103 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:31:07.006103 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:31:07.006103 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:31:07.006103 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:31:07.006103 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:31:07.006103 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:31:07.006103 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:31:07.006103 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:31:07.006103 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:31:07.006103 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 31 14:31:07.006103 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 14:31:07.006103 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 31 14:31:07.006103 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:31:07.006103 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 497/998] 10.222.0.15 () {56 vars in 1111 bytes} [Tue May 31 14:31:06 2022] GET /identity/v3/services/compute => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:31:07.008677 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae472c4-e7ff-46bd-9b0d-c9d5d48837af None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:07.088938 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce542c-e185-44f8-aece-167a0fe9e520 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:07.089232 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce542c-e185-44f8-aece-167a0fe9e520 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:07.089518 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce542c-e185-44f8-aece-167a0fe9e520 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:07.090945 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 498/999] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:31:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 31 14:31:07.095776 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9183fe3-51d0-453e-befb-1ede8ef5ed36 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:07.096147 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9183fe3-51d0-453e-befb-1ede8ef5ed36 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:07.096494 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9183fe3-51d0-453e-befb-1ede8ef5ed36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:07.113848 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-c9183fe3-51d0-453e-befb-1ede8ef5ed36 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:31:07.115060 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-c9183fe3-51d0-453e-befb-1ede8ef5ed36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:31:07.116180 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae472c4-e7ff-46bd-9b0d-c9d5d48837af None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:07.154991 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9505bf18-7f1c-400f-b3e2-f491773e228b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:07.155663 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9505bf18-7f1c-400f-b3e2-f491773e228b None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:07.155946 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9505bf18-7f1c-400f-b3e2-f491773e228b None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:07.156476 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9505bf18-7f1c-400f-b3e2-f491773e228b None admin] PATH_INFO: `/v3/services` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:07.157481 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9505bf18-7f1c-400f-b3e2-f491773e228b None admin] RBAC: Adding query filter params (name=compute) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:31:07.157481 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9505bf18-7f1c-400f-b3e2-f491773e228b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:07.159387 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9505bf18-7f1c-400f-b3e2-f491773e228b None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:07.164426 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 502/1000] 10.222.0.15 () {56 vars in 1112 bytes} [Tue May 31 14:31:07 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:31:07.170105 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9505bf18-7f1c-400f-b3e2-f491773e228b None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:07.181501 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:07.187593 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 499/1001] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:31:07 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 31 14:31:07.209215 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9183fe3-51d0-453e-befb-1ede8ef5ed36 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:07.229086 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:07.272055 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9505bf18-7f1c-400f-b3e2-f491773e228b None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:07.312601 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c066d38b-386d-4ff3-b0c2-2124538c2791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:07.313279 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c066d38b-386d-4ff3-b0c2-2124538c2791 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:07.313567 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c066d38b-386d-4ff3-b0c2-2124538c2791 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:07.313844 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c066d38b-386d-4ff3-b0c2-2124538c2791 None admin] PATH_INFO: `/v3/services` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:07.314700 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c066d38b-386d-4ff3-b0c2-2124538c2791 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:31:07.315010 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c066d38b-386d-4ff3-b0c2-2124538c2791 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:07.316377 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c066d38b-386d-4ff3-b0c2-2124538c2791 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:07.316971 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9183fe3-51d0-453e-befb-1ede8ef5ed36 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:07.321430 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 503/1002] 10.222.0.15 () {56 vars in 1112 bytes} [Tue May 31 14:31:07 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 14:31:07.327139 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c066d38b-386d-4ff3-b0c2-2124538c2791 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:07.357704 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b096e34f-afe8-4f02-add1-e4cf4ceb02b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:07.359036 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b096e34f-afe8-4f02-add1-e4cf4ceb02b0 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:07.359544 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b096e34f-afe8-4f02-add1-e4cf4ceb02b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:07.360040 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b096e34f-afe8-4f02-add1-e4cf4ceb02b0 None admin] PATH_INFO: `/v3/services/image` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:07.362210 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b096e34f-afe8-4f02-add1-e4cf4ceb02b0 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:07.363786 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b096e34f-afe8-4f02-add1-e4cf4ceb02b0 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:07.379052 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-b096e34f-afe8-4f02-add1-e4cf4ceb02b0 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 31 14:31:07.379052 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:31:07.379052 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 31 14:31:07.379052 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 31 14:31:07.379052 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 31 14:31:07.379052 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 31 14:31:07.379052 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 31 14:31:07.379052 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 14:31:07.379052 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 31 14:31:07.379052 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:31:07.379052 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 31 14:31:07.379052 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:31:07.379052 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:31:07.379052 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:31:07.379052 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:31:07.379052 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:31:07.379052 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:31:07.380046 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:31:07.380046 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:31:07.380046 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:31:07.380046 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:31:07.380046 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:31:07.380046 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:31:07.380046 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 31 14:31:07.380046 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_service(service_id) May 31 14:31:07.380046 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 31 14:31:07.380046 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 31 14:31:07.380046 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:31:07.380046 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:31:07.380046 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:31:07.380046 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:31:07.380046 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:31:07.380046 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:31:07.381709 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:31:07.381709 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:31:07.381709 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:31:07.381709 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:31:07.381709 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:31:07.381709 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:31:07.381709 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:31:07.381709 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:31:07.381709 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:31:07.381709 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:31:07.381709 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 31 14:31:07.381709 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 14:31:07.381709 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 31 14:31:07.381709 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:31:07.381709 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 500/1003] 10.222.0.15 () {56 vars in 1105 bytes} [Tue May 31 14:31:07 2022] GET /identity/v3/services/image => generated 86 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 14:31:07.386265 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b096e34f-afe8-4f02-add1-e4cf4ceb02b0 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:07.398578 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:07.429963 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c066d38b-386d-4ff3-b0c2-2124538c2791 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:07.468667 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae8fdaa-1f61-4abf-8302-99bb2f8317ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:07.469336 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae8fdaa-1f61-4abf-8302-99bb2f8317ff None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:07.469619 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae8fdaa-1f61-4abf-8302-99bb2f8317ff None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:07.469946 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae8fdaa-1f61-4abf-8302-99bb2f8317ff None admin] PATH_INFO: `/v3/endpoints` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:07.471799 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae8fdaa-1f61-4abf-8302-99bb2f8317ff None admin] RBAC: Adding query filter params (interface=public, service_id=8f9a5af0459c4565b611f4cf2049da10, region_id=RegionOne) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:31:07.472112 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae8fdaa-1f61-4abf-8302-99bb2f8317ff None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:07.473827 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae8fdaa-1f61-4abf-8302-99bb2f8317ff None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:07.476907 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:07.486581 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 504/1004] 10.222.0.15 () {56 vars in 1251 bytes} [Tue May 31 14:31:07 2022] GET /identity/v3/endpoints?service_id=8f9a5af0459c4565b611f4cf2049da10&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 14:31:07.488639 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae8fdaa-1f61-4abf-8302-99bb2f8317ff None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:07.496363 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b096e34f-afe8-4f02-add1-e4cf4ceb02b0 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:07.535712 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d410f958-5be5-4748-9b10-6191238a1d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:07.536297 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d410f958-5be5-4748-9b10-6191238a1d97 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:07.536582 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d410f958-5be5-4748-9b10-6191238a1d97 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:07.536856 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d410f958-5be5-4748-9b10-6191238a1d97 None admin] PATH_INFO: `/v3/services` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:07.537551 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d410f958-5be5-4748-9b10-6191238a1d97 None admin] RBAC: Adding query filter params (name=image) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:31:07.537855 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d410f958-5be5-4748-9b10-6191238a1d97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:07.539246 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d410f958-5be5-4748-9b10-6191238a1d97 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:07.544343 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 501/1005] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:31:07 2022] GET /identity/v3/services?name=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 14:31:07.549954 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d410f958-5be5-4748-9b10-6191238a1d97 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:07.595539 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae8fdaa-1f61-4abf-8302-99bb2f8317ff None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:07.632768 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d6c1b3-e0f8-4e1d-89ae-d328cc4bb93a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:07.633592 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d6c1b3-e0f8-4e1d-89ae-d328cc4bb93a None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:07.633877 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d6c1b3-e0f8-4e1d-89ae-d328cc4bb93a None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:07.634154 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d6c1b3-e0f8-4e1d-89ae-d328cc4bb93a None admin] PATH_INFO: `/v3/services` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:07.634890 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d6c1b3-e0f8-4e1d-89ae-d328cc4bb93a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:07.636470 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d6c1b3-e0f8-4e1d-89ae-d328cc4bb93a None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:07.638244 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:07.644236 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 505/1006] 10.222.0.15 () {56 vars in 1087 bytes} [Tue May 31 14:31:07 2022] GET /identity/v3/services => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 14:31:07.662928 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d410f958-5be5-4748-9b10-6191238a1d97 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:07.701643 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dec12e-8c35-49aa-a3ee-bc0e7f03ea4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:07.702342 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dec12e-8c35-49aa-a3ee-bc0e7f03ea4e None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:07.702659 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dec12e-8c35-49aa-a3ee-bc0e7f03ea4e None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:07.702940 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dec12e-8c35-49aa-a3ee-bc0e7f03ea4e None admin] PATH_INFO: `/v3/services` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:07.703658 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dec12e-8c35-49aa-a3ee-bc0e7f03ea4e None admin] RBAC: Adding query filter params (type=image) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:31:07.703967 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dec12e-8c35-49aa-a3ee-bc0e7f03ea4e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:07.705431 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dec12e-8c35-49aa-a3ee-bc0e7f03ea4e None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:07.718961 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 502/1007] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:31:07 2022] GET /identity/v3/services?type=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 14:31:08.600242 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc0a13-691b-4163-9697-7b388e24342d None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:08.600742 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc0a13-691b-4163-9697-7b388e24342d None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:08.600742 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc0a13-691b-4163-9697-7b388e24342d None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:08.602194 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 506/1008] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:31:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:31:08.607315 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945e1ca6-fba1-4b5c-b4ec-cd9f1ba846c2 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:08.607608 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945e1ca6-fba1-4b5c-b4ec-cd9f1ba846c2 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:08.607889 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945e1ca6-fba1-4b5c-b4ec-cd9f1ba846c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:08.624121 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-945e1ca6-fba1-4b5c-b4ec-cd9f1ba846c2 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:31:08.625285 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-945e1ca6-fba1-4b5c-b4ec-cd9f1ba846c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:31:08.627948 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:08.692902 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 503/1009] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:31:08 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 14:31:08.716984 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcc0a13-691b-4163-9697-7b388e24342d None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:08.819497 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcc0a13-691b-4163-9697-7b388e24342d None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:08.858333 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d784d1a9-97bd-49e6-9a6d-46639f19cf78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:08.859079 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d784d1a9-97bd-49e6-9a6d-46639f19cf78 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:08.859367 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d784d1a9-97bd-49e6-9a6d-46639f19cf78 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:08.859644 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d784d1a9-97bd-49e6-9a6d-46639f19cf78 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:08.860878 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d784d1a9-97bd-49e6-9a6d-46639f19cf78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:08.862357 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d784d1a9-97bd-49e6-9a6d-46639f19cf78 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:08.864181 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 507/1010] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:31:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:31:08.869686 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945e1ca6-fba1-4b5c-b4ec-cd9f1ba846c2 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:08.968167 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945e1ca6-fba1-4b5c-b4ec-cd9f1ba846c2 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:09.001234 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee16c31-ff48-414a-a0e8-181b49f0800d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:09.002442 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee16c31-ff48-414a-a0e8-181b49f0800d None admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:09.002762 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee16c31-ff48-414a-a0e8-181b49f0800d None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:09.003044 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee16c31-ff48-414a-a0e8-181b49f0800d None admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:09.003762 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee16c31-ff48-414a-a0e8-181b49f0800d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:09.005222 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee16c31-ff48-414a-a0e8-181b49f0800d None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:09.013265 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:09.094625 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 504/1011] 10.222.0.15 () {60 vars in 1141 bytes} [Tue May 31 14:31:08 2022] POST /identity/v3/projects => generated 311 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:31:09.931681 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf2884d-37fc-4a0c-b044-7adb503b5cd5 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:09.932206 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf2884d-37fc-4a0c-b044-7adb503b5cd5 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:09.932206 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf2884d-37fc-4a0c-b044-7adb503b5cd5 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:09.933610 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 508/1012] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:31:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:31:09.938860 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa8f500-f74c-48e5-8042-f75d87a3cd08 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:09.939286 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa8f500-f74c-48e5-8042-f75d87a3cd08 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:09.939451 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa8f500-f74c-48e5-8042-f75d87a3cd08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:09.956484 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-7aa8f500-f74c-48e5-8042-f75d87a3cd08 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:31:09.957644 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-7aa8f500-f74c-48e5-8042-f75d87a3cd08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:31:09.983095 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87b675f-62f7-4066-a2f6-2ab2e8786777 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:09.983369 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87b675f-62f7-4066-a2f6-2ab2e8786777 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:09.983649 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87b675f-62f7-4066-a2f6-2ab2e8786777 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:09.985114 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 509/1013] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:31:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 31 14:31:09.989705 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c518930f-591a-41b3-9eb9-8ec89ed234e0 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:09.989995 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c518930f-591a-41b3-9eb9-8ec89ed234e0 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:09.990345 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c518930f-591a-41b3-9eb9-8ec89ed234e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:10.006517 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-c518930f-591a-41b3-9eb9-8ec89ed234e0 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:31:10.007707 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-c518930f-591a-41b3-9eb9-8ec89ed234e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:31:10.025181 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 505/1014] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:31:09 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 14:31:10.048065 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa8f500-f74c-48e5-8042-f75d87a3cd08 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:10.069724 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:10.076257 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 510/1015] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:31:09 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 31 14:31:10.103306 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c518930f-591a-41b3-9eb9-8ec89ed234e0 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:10.150794 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa8f500-f74c-48e5-8042-f75d87a3cd08 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:10.172924 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:10.187206 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2dada3-bfb3-4d2b-b81a-1de0a61ddcec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:10.187941 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2dada3-bfb3-4d2b-b81a-1de0a61ddcec None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:10.188223 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2dada3-bfb3-4d2b-b81a-1de0a61ddcec None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:10.188499 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2dada3-bfb3-4d2b-b81a-1de0a61ddcec None admin] PATH_INFO: `/v3/services/compute` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:10.189657 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2dada3-bfb3-4d2b-b81a-1de0a61ddcec None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:10.191070 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2dada3-bfb3-4d2b-b81a-1de0a61ddcec None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:10.202850 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-be2dada3-bfb3-4d2b-b81a-1de0a61ddcec None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 31 14:31:10.202850 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:31:10.202850 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 31 14:31:10.202850 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 31 14:31:10.202850 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 31 14:31:10.202850 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 31 14:31:10.202850 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 31 14:31:10.202850 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 14:31:10.202850 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 31 14:31:10.202850 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:31:10.202850 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 31 14:31:10.202850 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:31:10.202850 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:31:10.202850 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:31:10.202850 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:31:10.202850 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:31:10.202850 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:31:10.203899 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:31:10.203899 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:31:10.203899 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:31:10.203899 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:31:10.203899 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:31:10.203899 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:31:10.203899 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 31 14:31:10.203899 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_service(service_id) May 31 14:31:10.203899 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 31 14:31:10.203899 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 31 14:31:10.203899 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:31:10.203899 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:31:10.203899 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:31:10.203899 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:31:10.203899 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:31:10.203899 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:31:10.205385 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:31:10.205385 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:31:10.205385 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:31:10.205385 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:31:10.205385 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:31:10.205385 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:31:10.205385 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:31:10.205385 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:31:10.205385 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:31:10.205385 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:31:10.205385 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 31 14:31:10.205385 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 14:31:10.205385 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 31 14:31:10.205385 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:31:10.205385 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 506/1016] 10.222.0.15 () {56 vars in 1111 bytes} [Tue May 31 14:31:10 2022] GET /identity/v3/services/compute => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 14:31:10.211477 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2dada3-bfb3-4d2b-b81a-1de0a61ddcec None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:10.220300 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c518930f-591a-41b3-9eb9-8ec89ed234e0 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:10.257806 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3877d5-c1f2-4a22-a6da-bc896dcdd4e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:10.258851 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3877d5-c1f2-4a22-a6da-bc896dcdd4e4 None admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:10.259284 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3877d5-c1f2-4a22-a6da-bc896dcdd4e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:10.259732 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3877d5-c1f2-4a22-a6da-bc896dcdd4e4 None admin] PATH_INFO: `/v3/services` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:10.260694 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3877d5-c1f2-4a22-a6da-bc896dcdd4e4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:10.262358 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3877d5-c1f2-4a22-a6da-bc896dcdd4e4 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:10.320313 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2dada3-bfb3-4d2b-b81a-1de0a61ddcec None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:10.343606 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 511/1017] 10.222.0.15 () {60 vars in 1141 bytes} [Tue May 31 14:31:10 2022] POST /identity/v3/services => generated 242 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 14:31:10.368596 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715158ac-3c09-42e3-b00b-0bc3aa41468d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:10.369287 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715158ac-3c09-42e3-b00b-0bc3aa41468d None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:10.369579 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715158ac-3c09-42e3-b00b-0bc3aa41468d None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:10.369857 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715158ac-3c09-42e3-b00b-0bc3aa41468d None admin] PATH_INFO: `/v3/services` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:10.370611 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715158ac-3c09-42e3-b00b-0bc3aa41468d None admin] RBAC: Adding query filter params (name=compute) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:31:10.370927 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715158ac-3c09-42e3-b00b-0bc3aa41468d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:10.372508 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715158ac-3c09-42e3-b00b-0bc3aa41468d None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:10.384234 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 507/1018] 10.222.0.15 () {56 vars in 1112 bytes} [Tue May 31 14:31:10 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 14:31:10.385663 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3877d5-c1f2-4a22-a6da-bc896dcdd4e4 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:10.452678 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:10.499593 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3877d5-c1f2-4a22-a6da-bc896dcdd4e4 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:10.537115 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05a3a62-4d20-454b-8feb-31c2bec5ea1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:10.537786 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05a3a62-4d20-454b-8feb-31c2bec5ea1b None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:10.538071 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05a3a62-4d20-454b-8feb-31c2bec5ea1b None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:10.538352 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05a3a62-4d20-454b-8feb-31c2bec5ea1b None admin] PATH_INFO: `/v3/services` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:10.539136 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05a3a62-4d20-454b-8feb-31c2bec5ea1b None admin] RBAC: Adding query filter params (type=compute) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:31:10.539445 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05a3a62-4d20-454b-8feb-31c2bec5ea1b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:10.540852 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05a3a62-4d20-454b-8feb-31c2bec5ea1b None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:10.546110 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 512/1019] 10.222.0.15 () {56 vars in 1112 bytes} [Tue May 31 14:31:10 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:31:10.552192 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715158ac-3c09-42e3-b00b-0bc3aa41468d None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:10.599875 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:10.653948 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715158ac-3c09-42e3-b00b-0bc3aa41468d None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:10.688481 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd373552-7daf-47af-af0b-146ac6dfdcc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:10.689671 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd373552-7daf-47af-af0b-146ac6dfdcc3 None admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:10.689951 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd373552-7daf-47af-af0b-146ac6dfdcc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:10.690223 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd373552-7daf-47af-af0b-146ac6dfdcc3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:10.690993 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd373552-7daf-47af-af0b-146ac6dfdcc3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:10.692350 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd373552-7daf-47af-af0b-146ac6dfdcc3 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:10.798577 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 508/1020] 10.222.0.15 () {60 vars in 1144 bytes} [Tue May 31 14:31:10 2022] POST /identity/v3/endpoints => generated 334 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:31:11.372503 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104d48f6-b59f-4a47-9882-3b4388d5a752 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:11.378878 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104d48f6-b59f-4a47-9882-3b4388d5a752 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:11.378878 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104d48f6-b59f-4a47-9882-3b4388d5a752 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:11.378878 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 513/1021] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:31:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:31:11.379815 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27973a9d-76d2-4d98-b00a-24e6f9007e07 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:11.380209 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27973a9d-76d2-4d98-b00a-24e6f9007e07 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:11.380398 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27973a9d-76d2-4d98-b00a-24e6f9007e07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:11.398635 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-27973a9d-76d2-4d98-b00a-24e6f9007e07 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:31:11.399870 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-27973a9d-76d2-4d98-b00a-24e6f9007e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:31:11.473781 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 509/1022] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:31:11 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 14:31:11.498375 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104d48f6-b59f-4a47-9882-3b4388d5a752 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:11.613119 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104d48f6-b59f-4a47-9882-3b4388d5a752 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:11.636640 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:11.651592 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4c881e-fd9a-4872-b94e-35f804238739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:11.652677 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c881e-fd9a-4872-b94e-35f804238739 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:11.653048 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c881e-fd9a-4872-b94e-35f804238739 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:11.653537 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c881e-fd9a-4872-b94e-35f804238739 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:11.655714 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4c881e-fd9a-4872-b94e-35f804238739 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:11.657803 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4c881e-fd9a-4872-b94e-35f804238739 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:11.660045 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 514/1023] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:31:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:31:11.665829 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27973a9d-76d2-4d98-b00a-24e6f9007e07 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:11.699734 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:11.786839 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27973a9d-76d2-4d98-b00a-24e6f9007e07 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:11.823191 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3213710d-503d-4d14-9502-1cf416c77f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:11.823861 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3213710d-503d-4d14-9502-1cf416c77f33 None admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:11.824145 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3213710d-503d-4d14-9502-1cf416c77f33 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:11.824422 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3213710d-503d-4d14-9502-1cf416c77f33 None admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:11.825140 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3213710d-503d-4d14-9502-1cf416c77f33 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:11.826647 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3213710d-503d-4d14-9502-1cf416c77f33 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:11.916653 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 510/1024] 10.222.0.15 () {60 vars in 1132 bytes} [Tue May 31 14:31:11 2022] POST /identity/v3/users => generated 285 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:31:12.651610 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff099b-93a5-4cbe-8247-b49e1b40690e None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:12.652123 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff099b-93a5-4cbe-8247-b49e1b40690e None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:12.652123 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff099b-93a5-4cbe-8247-b49e1b40690e None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:12.653462 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 515/1025] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:31:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:31:12.658982 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb0d4e-cb30-4f77-a8f9-dfcc97ed8de2 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:12.659387 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb0d4e-cb30-4f77-a8f9-dfcc97ed8de2 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:12.659568 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb0d4e-cb30-4f77-a8f9-dfcc97ed8de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:12.676083 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-1fdb0d4e-cb30-4f77-a8f9-dfcc97ed8de2 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:31:12.677249 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-1fdb0d4e-cb30-4f77-a8f9-dfcc97ed8de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:31:12.746355 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 511/1026] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:31:12 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 14:31:12.769365 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ff099b-93a5-4cbe-8247-b49e1b40690e None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:12.870970 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ff099b-93a5-4cbe-8247-b49e1b40690e None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:12.904358 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5a4cea-3ba1-4f83-81a1-888a0346d120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:12.905089 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a4cea-3ba1-4f83-81a1-888a0346d120 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:12.905371 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a4cea-3ba1-4f83-81a1-888a0346d120 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:12.905645 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a4cea-3ba1-4f83-81a1-888a0346d120 None admin] PATH_INFO: `/v3/services/image` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:12.906595 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5a4cea-3ba1-4f83-81a1-888a0346d120 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:12.908039 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5a4cea-3ba1-4f83-81a1-888a0346d120 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:12.920548 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-7d5a4cea-3ba1-4f83-81a1-888a0346d120 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 31 14:31:12.920548 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:31:12.920548 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 31 14:31:12.920548 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 31 14:31:12.920548 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 31 14:31:12.920548 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 31 14:31:12.920548 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 31 14:31:12.920548 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 14:31:12.920548 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 31 14:31:12.920548 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:31:12.920548 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 31 14:31:12.920548 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:31:12.920548 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:31:12.920548 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:31:12.920548 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:31:12.920548 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:31:12.920548 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:31:12.921628 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:31:12.921628 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:31:12.921628 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:31:12.921628 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:31:12.921628 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:31:12.921628 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:31:12.921628 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 31 14:31:12.921628 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_service(service_id) May 31 14:31:12.921628 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 31 14:31:12.921628 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 31 14:31:12.921628 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:31:12.921628 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:31:12.921628 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:31:12.921628 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:31:12.921628 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:31:12.921628 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:31:12.922518 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:31:12.922518 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:31:12.922518 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:31:12.922518 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:31:12.922518 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:31:12.922518 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:31:12.922518 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:31:12.922518 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:31:12.922518 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:31:12.922518 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:31:12.922518 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 31 14:31:12.922518 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 14:31:12.922518 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 31 14:31:12.922518 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:31:12.926953 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 516/1027] 10.222.0.15 () {56 vars in 1105 bytes} [Tue May 31 14:31:12 2022] GET /identity/v3/services/image => generated 86 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:31:12.928565 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdb0d4e-cb30-4f77-a8f9-dfcc97ed8de2 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:12.944115 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:13.027573 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdb0d4e-cb30-4f77-a8f9-dfcc97ed8de2 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:13.060895 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e18ef1-61e1-4bf1-8c06-e2c7c76a307b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:13.061552 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e18ef1-61e1-4bf1-8c06-e2c7c76a307b None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:13.061833 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e18ef1-61e1-4bf1-8c06-e2c7c76a307b None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:13.062102 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e18ef1-61e1-4bf1-8c06-e2c7c76a307b None admin] PATH_INFO: `/v3/services` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:13.062815 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e18ef1-61e1-4bf1-8c06-e2c7c76a307b None admin] RBAC: Adding query filter params (name=image) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:31:13.063118 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e18ef1-61e1-4bf1-8c06-e2c7c76a307b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:13.065142 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e18ef1-61e1-4bf1-8c06-e2c7c76a307b None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:13.076450 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 512/1028] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:31:12 2022] GET /identity/v3/services?name=image => generated 122 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 14:31:13.076654 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5a4cea-3ba1-4f83-81a1-888a0346d120 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:13.136276 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:13.182285 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5a4cea-3ba1-4f83-81a1-888a0346d120 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:13.214955 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f88a70-3a93-4a3c-a814-2a9b6603a954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:13.215614 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f88a70-3a93-4a3c-a814-2a9b6603a954 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:13.215895 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f88a70-3a93-4a3c-a814-2a9b6603a954 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:13.216169 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f88a70-3a93-4a3c-a814-2a9b6603a954 None admin] PATH_INFO: `/v3/services` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:13.216865 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f88a70-3a93-4a3c-a814-2a9b6603a954 None admin] RBAC: Adding query filter params (type=image) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:31:13.217171 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f88a70-3a93-4a3c-a814-2a9b6603a954 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:13.218517 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f88a70-3a93-4a3c-a814-2a9b6603a954 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:13.223966 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 517/1029] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:31:13 2022] GET /identity/v3/services?type=image => generated 350 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 14:31:13.229611 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e18ef1-61e1-4bf1-8c06-e2c7c76a307b None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:13.246483 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f041bbb2-dbf6-483d-831a-0dedf02b2fd5 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:13.246801 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f041bbb2-dbf6-483d-831a-0dedf02b2fd5 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:13.247078 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f041bbb2-dbf6-483d-831a-0dedf02b2fd5 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:13.248422 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 518/1030] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:31:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 31 14:31:13.253460 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d7658-0624-46fe-a2aa-3e69f233999f None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:13.253745 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d7658-0624-46fe-a2aa-3e69f233999f None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:13.254024 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d7658-0624-46fe-a2aa-3e69f233999f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:13.270403 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-419d7658-0624-46fe-a2aa-3e69f233999f None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:31:13.271599 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-419d7658-0624-46fe-a2aa-3e69f233999f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:31:13.328374 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:13.350937 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e18ef1-61e1-4bf1-8c06-e2c7c76a307b None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:13.351169 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 519/1031] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:31:13 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 31 14:31:13.376299 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419d7658-0624-46fe-a2aa-3e69f233999f None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:13.385679 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42abfc52-f420-493d-8039-b9bfe6d41b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:13.386353 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42abfc52-f420-493d-8039-b9bfe6d41b75 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:13.386657 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42abfc52-f420-493d-8039-b9bfe6d41b75 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:13.386930 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42abfc52-f420-493d-8039-b9bfe6d41b75 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:13.387704 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42abfc52-f420-493d-8039-b9bfe6d41b75 None admin] RBAC: Adding query filter params (interface=public, service_id=cf539d10a2da4289b7b912f4ec61bbd1, region_id=RegionOne) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:31:13.388010 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42abfc52-f420-493d-8039-b9bfe6d41b75 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:13.389365 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42abfc52-f420-493d-8039-b9bfe6d41b75 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:13.399076 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 513/1032] 10.222.0.15 () {56 vars in 1251 bytes} [Tue May 31 14:31:13 2022] GET /identity/v3/endpoints?service_id=cf539d10a2da4289b7b912f4ec61bbd1&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:31:13.400279 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42abfc52-f420-493d-8039-b9bfe6d41b75 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:13.426635 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:13.477004 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419d7658-0624-46fe-a2aa-3e69f233999f None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:13.507453 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42abfc52-f420-493d-8039-b9bfe6d41b75 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:13.512400 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed7e482-2f15-4a28-9aff-d190e32dc0df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:13.513310 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed7e482-2f15-4a28-9aff-d190e32dc0df None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:13.513595 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed7e482-2f15-4a28-9aff-d190e32dc0df None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:13.513880 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed7e482-2f15-4a28-9aff-d190e32dc0df None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:13.525276 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed7e482-2f15-4a28-9aff-d190e32dc0df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 14:31:13.534355 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-eed7e482-2f15-4a28-9aff-d190e32dc0df None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 31 14:31:13.534355 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:31:13.534355 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:31:13.534355 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:31:13.534355 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:31:13.534355 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:31:13.534355 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:31:13.534355 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:31:13.534355 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:31:13.534355 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:31:13.534355 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:31:13.534355 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:31:13.534355 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 14:31:13.534355 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 14:31:13.534355 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 14:31:13.534355 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 14:31:13.535335 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 14:31:13.535335 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 14:31:13.535335 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 14:31:13.535335 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 14:31:13.535335 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:31:13.535335 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:31:13.535335 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:31:13.535335 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:31:13.535335 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:31:13.535335 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:31:13.535335 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:31:13.535335 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:31:13.535335 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:31:13.535335 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:31:13.535335 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:31:13.535335 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:31:13.536212 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:31:13.536212 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:31:13.536212 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:31:13.536212 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:31:13.536212 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 14:31:13.536212 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 14:31:13.536212 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 14:31:13.536212 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 14:31:13.536212 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 14:31:13.536212 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 14:31:13.536212 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 31 14:31:13.536212 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:31:13.536212 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 520/1033] 10.222.0.15 () {56 vars in 1120 bytes} [Tue May 31 14:31:13 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:31:13.541322 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed7e482-2f15-4a28-9aff-d190e32dc0df None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:13.545598 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eff2151-e019-4b9a-a7ab-3ec16bec3655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:13.546260 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff2151-e019-4b9a-a7ab-3ec16bec3655 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:13.546542 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff2151-e019-4b9a-a7ab-3ec16bec3655 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:13.546843 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff2151-e019-4b9a-a7ab-3ec16bec3655 None admin] PATH_INFO: `/v3/services` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:13.547514 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eff2151-e019-4b9a-a7ab-3ec16bec3655 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:13.548918 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eff2151-e019-4b9a-a7ab-3ec16bec3655 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:13.555544 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 514/1034] 10.222.0.15 () {56 vars in 1087 bytes} [Tue May 31 14:31:13 2022] GET /identity/v3/services => generated 1957 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 14:31:13.660237 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed7e482-2f15-4a28-9aff-d190e32dc0df None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:13.670326 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:13.697209 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c424b0-5e15-4d07-8ed8-5a70dad3e43f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:13.697896 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c424b0-5e15-4d07-8ed8-5a70dad3e43f None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:13.698183 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c424b0-5e15-4d07-8ed8-5a70dad3e43f None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:13.698471 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c424b0-5e15-4d07-8ed8-5a70dad3e43f None admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:13.699264 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c424b0-5e15-4d07-8ed8-5a70dad3e43f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:31:13.699579 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c424b0-5e15-4d07-8ed8-5a70dad3e43f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:13.700995 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c424b0-5e15-4d07-8ed8-5a70dad3e43f None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:13.715707 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 521/1035] 10.222.0.15 () {56 vars in 1115 bytes} [Tue May 31 14:31:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 14:31:13.717635 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eff2151-e019-4b9a-a7ab-3ec16bec3655 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:13.722292 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:13.823869 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eff2151-e019-4b9a-a7ab-3ec16bec3655 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:13.858134 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dfec58-502e-464f-abc0-53838ad9368f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:13.858962 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dfec58-502e-464f-abc0-53838ad9368f None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:13.859246 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dfec58-502e-464f-abc0-53838ad9368f None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:13.859529 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dfec58-502e-464f-abc0-53838ad9368f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:13.869534 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dfec58-502e-464f-abc0-53838ad9368f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:13.871007 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dfec58-502e-464f-abc0-53838ad9368f None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:13.890849 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-d7dfec58-502e-464f-abc0-53838ad9368f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:31:13.890849 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:31:13.890849 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:31:13.890849 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:31:13.890849 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:31:13.890849 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:31:13.890849 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:31:13.890849 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:31:13.890849 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:31:13.890849 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:31:13.890849 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:31:13.890849 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:31:13.890849 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 14:31:13.890849 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 14:31:13.890849 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 14:31:13.892505 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 14:31:13.892505 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:31:13.892505 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:31:13.892505 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:31:13.892505 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:31:13.892505 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:31:13.892505 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:31:13.892505 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:31:13.892505 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:31:13.892505 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:31:13.892505 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:31:13.892505 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:31:13.892505 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:31:13.892505 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:31:13.892505 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:31:13.892505 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:31:13.892505 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:31:13.893459 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 14:31:13.893459 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 14:31:13.893459 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:31:13.893459 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:31:13.894303 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 515/1036] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:31:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:31:13.898576 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c424b0-5e15-4d07-8ed8-5a70dad3e43f None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:14.004026 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c424b0-5e15-4d07-8ed8-5a70dad3e43f None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:14.037727 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476a9081-ffee-4557-a77e-acd94e8aa700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:14.038391 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a9081-ffee-4557-a77e-acd94e8aa700 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:14.038711 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a9081-ffee-4557-a77e-acd94e8aa700 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:14.038997 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a9081-ffee-4557-a77e-acd94e8aa700 None admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:14.039727 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476a9081-ffee-4557-a77e-acd94e8aa700 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:31:14.040023 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476a9081-ffee-4557-a77e-acd94e8aa700 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:14.041387 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476a9081-ffee-4557-a77e-acd94e8aa700 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:14.057549 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 522/1037] 10.222.0.15 () {56 vars in 1109 bytes} [Tue May 31 14:31:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:31:14.059226 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dfec58-502e-464f-abc0-53838ad9368f None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:14.118613 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:14.165003 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dfec58-502e-464f-abc0-53838ad9368f None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:14.199032 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543fdc4b-d1f8-4eff-941c-5563cef4dec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:14.199965 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543fdc4b-d1f8-4eff-941c-5563cef4dec2 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:14.200357 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543fdc4b-d1f8-4eff-941c-5563cef4dec2 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:14.200737 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543fdc4b-d1f8-4eff-941c-5563cef4dec2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:14.208381 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543fdc4b-d1f8-4eff-941c-5563cef4dec2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:14.209923 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543fdc4b-d1f8-4eff-941c-5563cef4dec2 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:14.225016 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-543fdc4b-d1f8-4eff-941c-5563cef4dec2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 31 14:31:14.225016 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:31:14.225016 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:31:14.225016 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:31:14.225016 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:31:14.225016 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:31:14.225016 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:31:14.225016 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:31:14.225016 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:31:14.225016 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:31:14.225016 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:31:14.225016 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:31:14.225016 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 14:31:14.225016 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 14:31:14.225016 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 14:31:14.225016 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 14:31:14.226164 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:31:14.226164 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:31:14.226164 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 14:31:14.226164 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 14:31:14.226164 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 14:31:14.226164 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 14:31:14.226164 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:31:14.226164 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:31:14.226164 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:31:14.226164 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:31:14.226164 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:31:14.226164 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:31:14.226164 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:31:14.226164 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:31:14.226164 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:31:14.226164 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:31:14.226164 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:31:14.226164 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:31:14.227472 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:31:14.227472 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:31:14.227472 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 14:31:14.227472 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 14:31:14.227472 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 14:31:14.227472 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 14:31:14.227472 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 14:31:14.227472 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 14:31:14.227472 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 31 14:31:14.227472 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:31:14.229196 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 516/1038] 10.222.0.15 () {56 vars in 1093 bytes} [Tue May 31 14:31:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 14:31:14.234673 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476a9081-ffee-4557-a77e-acd94e8aa700 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:14.261505 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2303b551-808c-4987-9f1f-7df1af1e029c None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:14.261819 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2303b551-808c-4987-9f1f-7df1af1e029c None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:14.262102 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2303b551-808c-4987-9f1f-7df1af1e029c None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:14.266585 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 517/1039] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:31:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 31 14:31:14.269276 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf453237-7b76-4612-aa16-c520981f4b14 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:14.269557 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf453237-7b76-4612-aa16-c520981f4b14 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:14.269831 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf453237-7b76-4612-aa16-c520981f4b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:14.274124 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:14.287100 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-cf453237-7b76-4612-aa16-c520981f4b14 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:31:14.288295 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-cf453237-7b76-4612-aa16-c520981f4b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:31:14.359985 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476a9081-ffee-4557-a77e-acd94e8aa700 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:14.363788 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 518/1040] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:31:14 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 14:31:14.387827 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf453237-7b76-4612-aa16-c520981f4b14 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:14.403001 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d694fc-92e9-4d5f-982d-46948d2f677b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:14.403919 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d694fc-92e9-4d5f-982d-46948d2f677b None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:14.404212 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d694fc-92e9-4d5f-982d-46948d2f677b None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:14.404467 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d694fc-92e9-4d5f-982d-46948d2f677b None admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:14.405321 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d694fc-92e9-4d5f-982d-46948d2f677b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:31:14.405630 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d694fc-92e9-4d5f-982d-46948d2f677b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:14.407401 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d694fc-92e9-4d5f-982d-46948d2f677b None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:14.426816 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 523/1041] 10.222.0.15 () {56 vars in 1133 bytes} [Tue May 31 14:31:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:31:14.433164 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d694fc-92e9-4d5f-982d-46948d2f677b None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:14.440103 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:14.499092 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf453237-7b76-4612-aa16-c520981f4b14 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:14.525203 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:14.535109 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08276c5b-a022-4226-886c-bfc8a9516f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:14.535903 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08276c5b-a022-4226-886c-bfc8a9516f12 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:14.537349 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08276c5b-a022-4226-886c-bfc8a9516f12 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:14.537349 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08276c5b-a022-4226-886c-bfc8a9516f12 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:14.537658 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d694fc-92e9-4d5f-982d-46948d2f677b None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:14.546771 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08276c5b-a022-4226-886c-bfc8a9516f12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 14:31:14.555044 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-08276c5b-a022-4226-886c-bfc8a9516f12 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 31 14:31:14.555044 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:31:14.555044 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:31:14.555044 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:31:14.555044 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:31:14.555044 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:31:14.555044 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:31:14.555044 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:31:14.555044 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:31:14.555044 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:31:14.555044 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:31:14.555044 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:31:14.555044 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 14:31:14.555044 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 14:31:14.555044 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 14:31:14.555044 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 14:31:14.555990 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 14:31:14.555990 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 14:31:14.555990 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 14:31:14.555990 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 14:31:14.555990 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:31:14.555990 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:31:14.555990 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:31:14.555990 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:31:14.555990 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:31:14.555990 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:31:14.555990 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:31:14.555990 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:31:14.555990 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:31:14.555990 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:31:14.555990 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:31:14.555990 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:31:14.556855 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:31:14.556855 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:31:14.556855 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:31:14.556855 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:31:14.556855 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 14:31:14.556855 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 14:31:14.556855 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 14:31:14.556855 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 14:31:14.556855 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 14:31:14.556855 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 14:31:14.556855 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 31 14:31:14.556855 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:31:14.556855 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 519/1042] 10.222.0.15 () {56 vars in 1096 bytes} [Tue May 31 14:31:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 14:31:14.562354 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08276c5b-a022-4226-886c-bfc8a9516f12 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:14.578620 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ce9f30-c73a-4ade-8ae2-ffad51b2e87a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:14.579366 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ce9f30-c73a-4ade-8ae2-ffad51b2e87a None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:14.579655 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ce9f30-c73a-4ade-8ae2-ffad51b2e87a None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:14.579941 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ce9f30-c73a-4ade-8ae2-ffad51b2e87a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:14.652782 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ce9f30-c73a-4ade-8ae2-ffad51b2e87a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:14.654270 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ce9f30-c73a-4ade-8ae2-ffad51b2e87a None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:14.668027 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08276c5b-a022-4226-886c-bfc8a9516f12 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:14.676375 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:14.704923 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7397e2c4-ce84-4c2b-b987-90181b4a9de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:14.705605 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7397e2c4-ce84-4c2b-b987-90181b4a9de7 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:14.705895 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7397e2c4-ce84-4c2b-b987-90181b4a9de7 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:14.706179 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7397e2c4-ce84-4c2b-b987-90181b4a9de7 None admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:14.706961 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7397e2c4-ce84-4c2b-b987-90181b4a9de7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:31:14.707272 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7397e2c4-ce84-4c2b-b987-90181b4a9de7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:14.708642 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7397e2c4-ce84-4c2b-b987-90181b4a9de7 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:14.718607 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 520/1043] 10.222.0.15 () {56 vars in 1099 bytes} [Tue May 31 14:31:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 14:31:14.724448 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7397e2c4-ce84-4c2b-b987-90181b4a9de7 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:14.751339 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:14.765304 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 524/1044] 10.222.0.15 () {58 vars in 1282 bytes} [Tue May 31 14:31:14 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 31 14:31:14.771356 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ce9f30-c73a-4ade-8ae2-ffad51b2e87a None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:14.831966 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7397e2c4-ce84-4c2b-b987-90181b4a9de7 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:14.869508 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63444bf3-f68f-4a0a-939b-8efe8a7328c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:14.870387 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63444bf3-f68f-4a0a-939b-8efe8a7328c7 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:14.870703 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63444bf3-f68f-4a0a-939b-8efe8a7328c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:14.870989 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63444bf3-f68f-4a0a-939b-8efe8a7328c7 None admin] PATH_INFO: `/v3/users/25a3dd4ed3cc4e80bbad7c7094c9d1c6` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:14.884636 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63444bf3-f68f-4a0a-939b-8efe8a7328c7 None admin] RBAC: Authorizing `identity:get_user(user_id=25a3dd4ed3cc4e80bbad7c7094c9d1c6)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:14.886086 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63444bf3-f68f-4a0a-939b-8efe8a7328c7 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:14.887777 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 521/1045] 10.222.0.15 () {56 vars in 1177 bytes} [Tue May 31 14:31:14 2022] GET /identity/v3/users/25a3dd4ed3cc4e80bbad7c7094c9d1c6 => generated 285 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 14:31:14.894639 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63444bf3-f68f-4a0a-939b-8efe8a7328c7 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:14.897417 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ce9f30-c73a-4ade-8ae2-ffad51b2e87a None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:14.921003 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:14.933019 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f0d548-2893-4c62-9fd0-d89031cb798e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:14.934876 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f0d548-2893-4c62-9fd0-d89031cb798e None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:14.934876 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f0d548-2893-4c62-9fd0-d89031cb798e None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:14.934876 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f0d548-2893-4c62-9fd0-d89031cb798e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:14.947055 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f0d548-2893-4c62-9fd0-d89031cb798e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:14.948502 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f0d548-2893-4c62-9fd0-d89031cb798e None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:14.966570 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-50f0d548-2893-4c62-9fd0-d89031cb798e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:31:14.966570 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:31:14.966570 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:31:14.966570 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:31:14.966570 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:31:14.966570 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:31:14.966570 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:31:14.966570 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:31:14.966570 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:31:14.966570 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:31:14.966570 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:31:14.966570 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:31:14.966570 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 14:31:14.966570 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 14:31:14.966570 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 14:31:14.967483 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 14:31:14.967483 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:31:14.967483 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:31:14.967483 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:31:14.967483 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:31:14.967483 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:31:14.967483 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:31:14.967483 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:31:14.967483 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:31:14.967483 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:31:14.967483 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:31:14.967483 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:31:14.967483 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:31:14.967483 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:31:14.967483 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:31:14.967483 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:31:14.967483 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:31:14.968403 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 14:31:14.968403 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 14:31:14.968403 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:31:14.968403 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:31:14.968403 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 525/1046] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:31:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 14:31:14.973165 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f0d548-2893-4c62-9fd0-d89031cb798e None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:15.000507 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63444bf3-f68f-4a0a-939b-8efe8a7328c7 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:15.016375 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:15.040724 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dee9eb-2f29-4d51-b5ab-a37a44142979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:15.042465 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dee9eb-2f29-4d51-b5ab-a37a44142979 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:15.043433 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dee9eb-2f29-4d51-b5ab-a37a44142979 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:15.044026 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dee9eb-2f29-4d51-b5ab-a37a44142979 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:15.088348 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f0d548-2893-4c62-9fd0-d89031cb798e None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:15.122359 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dee9eb-2f29-4d51-b5ab-a37a44142979 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:15.124632 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dee9eb-2f29-4d51-b5ab-a37a44142979 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:15.125218 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2b829e-b789-407f-a6a9-a9018a161875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:15.126563 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2b829e-b789-407f-a6a9-a9018a161875 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:15.126859 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2b829e-b789-407f-a6a9-a9018a161875 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:15.127129 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2b829e-b789-407f-a6a9-a9018a161875 None admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:15.127839 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2b829e-b789-407f-a6a9-a9018a161875 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:31:15.128145 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2b829e-b789-407f-a6a9-a9018a161875 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:15.129481 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2b829e-b789-407f-a6a9-a9018a161875 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:15.141193 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 526/1047] 10.222.0.15 () {56 vars in 1109 bytes} [Tue May 31 14:31:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 14:31:15.148405 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2b829e-b789-407f-a6a9-a9018a161875 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:15.157868 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:15.232466 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 522/1048] 10.222.0.15 () {58 vars in 1282 bytes} [Tue May 31 14:31:14 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 31 14:31:15.239425 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dee9eb-2f29-4d51-b5ab-a37a44142979 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:15.255526 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:15.259214 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2b829e-b789-407f-a6a9-a9018a161875 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:15.300987 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d72651-fa99-4978-ac59-2d1b953168e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:15.301783 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d72651-fa99-4978-ac59-2d1b953168e6 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:15.302062 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d72651-fa99-4978-ac59-2d1b953168e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:15.302330 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d72651-fa99-4978-ac59-2d1b953168e6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:15.309275 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d72651-fa99-4978-ac59-2d1b953168e6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:15.310744 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d72651-fa99-4978-ac59-2d1b953168e6 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:15.324894 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-39d72651-fa99-4978-ac59-2d1b953168e6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 14:31:15.324894 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:31:15.324894 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:31:15.324894 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:31:15.324894 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:31:15.324894 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:31:15.324894 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:31:15.324894 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:31:15.324894 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:31:15.324894 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:31:15.324894 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:31:15.324894 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:31:15.324894 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 14:31:15.324894 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 14:31:15.324894 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 14:31:15.325908 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 14:31:15.325908 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:31:15.325908 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:31:15.325908 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:31:15.325908 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:31:15.325908 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:31:15.325908 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:31:15.325908 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:31:15.325908 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:31:15.325908 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:31:15.325908 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:31:15.325908 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:31:15.325908 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:31:15.325908 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:31:15.325908 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:31:15.325908 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:31:15.325908 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:31:15.327010 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 14:31:15.327010 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 14:31:15.327010 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 14:31:15.327010 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 14:31:15.327010 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 14:31:15.327010 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 14:31:15.327010 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 14:31:15.327010 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:31:15.327010 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 527/1049] 10.222.0.15 () {56 vars in 1111 bytes} [Tue May 31 14:31:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 14:31:15.331776 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d72651-fa99-4978-ac59-2d1b953168e6 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:15.348972 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dee9eb-2f29-4d51-b5ab-a37a44142979 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:15.377318 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:15.387471 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3ae1d6-6758-46f7-b87e-b603dbe2f36d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:15.388336 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ae1d6-6758-46f7-b87e-b603dbe2f36d None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:15.392579 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ae1d6-6758-46f7-b87e-b603dbe2f36d None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:15.392579 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ae1d6-6758-46f7-b87e-b603dbe2f36d None admin] PATH_INFO: `/v3/projects/d58a91e5d27b4171bad2aecfefada8cb` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:15.392579 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3ae1d6-6758-46f7-b87e-b603dbe2f36d None admin] RBAC: Authorizing `identity:get_project(project_id=d58a91e5d27b4171bad2aecfefada8cb)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:15.392579 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3ae1d6-6758-46f7-b87e-b603dbe2f36d None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:15.393273 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 523/1050] 10.222.0.15 () {56 vars in 1186 bytes} [Tue May 31 14:31:15 2022] GET /identity/v3/projects/d58a91e5d27b4171bad2aecfefada8cb => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 14:31:15.399163 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3ae1d6-6758-46f7-b87e-b603dbe2f36d None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:15.436055 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d72651-fa99-4978-ac59-2d1b953168e6 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:15.470856 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a106adc3-bd77-409b-afb0-52dc14469e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:15.471525 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a106adc3-bd77-409b-afb0-52dc14469e31 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:15.471809 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a106adc3-bd77-409b-afb0-52dc14469e31 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:15.472088 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a106adc3-bd77-409b-afb0-52dc14469e31 None admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:15.472876 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a106adc3-bd77-409b-afb0-52dc14469e31 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:31:15.473187 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a106adc3-bd77-409b-afb0-52dc14469e31 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:15.474656 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a106adc3-bd77-409b-afb0-52dc14469e31 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:15.487402 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 528/1051] 10.222.0.15 () {56 vars in 1148 bytes} [Tue May 31 14:31:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 14:31:15.493588 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a106adc3-bd77-409b-afb0-52dc14469e31 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:15.512850 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3ae1d6-6758-46f7-b87e-b603dbe2f36d None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:15.517703 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:15.551108 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d47a62-b872-484b-995e-849806d5dc97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:15.551765 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d47a62-b872-484b-995e-849806d5dc97 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:15.552045 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d47a62-b872-484b-995e-849806d5dc97 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:15.552318 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d47a62-b872-484b-995e-849806d5dc97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:15.553134 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d47a62-b872-484b-995e-849806d5dc97 None admin] RBAC: Adding query filter params (role.id=76c53e2c353644f885028a0226c06146, scope.project.id=d58a91e5d27b4171bad2aecfefada8cb, user.id=25a3dd4ed3cc4e80bbad7c7094c9d1c6) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:31:15.553441 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d47a62-b872-484b-995e-849806d5dc97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:15.554879 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d47a62-b872-484b-995e-849806d5dc97 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:15.560441 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 524/1052] 10.222.0.15 () {56 vars in 1374 bytes} [Tue May 31 14:31:15 2022] GET /identity/v3/role_assignments?user.id=25a3dd4ed3cc4e80bbad7c7094c9d1c6&scope.project.id=d58a91e5d27b4171bad2aecfefada8cb&role.id=76c53e2c353644f885028a0226c06146 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 14:31:15.602810 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a106adc3-bd77-409b-afb0-52dc14469e31 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:15.639894 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052eee01-56b2-4de9-8050-0b82f59ad7d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:15.640753 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052eee01-56b2-4de9-8050-0b82f59ad7d5 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:15.641142 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052eee01-56b2-4de9-8050-0b82f59ad7d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:15.641555 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052eee01-56b2-4de9-8050-0b82f59ad7d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:15.642565 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052eee01-56b2-4de9-8050-0b82f59ad7d5 None admin] RBAC: Adding query filter params (role.id=c71617921821419bba278e390d70ac77, scope.project.id=ffff4334538649fdba1beb80cad207fa, user.id=b57768d448e345ad8879bf29f21b48ea) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:31:15.642990 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052eee01-56b2-4de9-8050-0b82f59ad7d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:15.644564 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052eee01-56b2-4de9-8050-0b82f59ad7d5 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:15.658599 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 529/1053] 10.222.0.15 () {56 vars in 1374 bytes} [Tue May 31 14:31:15 2022] GET /identity/v3/role_assignments?user.id=b57768d448e345ad8879bf29f21b48ea&scope.project.id=ffff4334538649fdba1beb80cad207fa&role.id=c71617921821419bba278e390d70ac77 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 14:31:15.838307 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2629a398-d525-49e6-8ece-4432f9450edf None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:15.838863 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2629a398-d525-49e6-8ece-4432f9450edf None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:15.838863 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2629a398-d525-49e6-8ece-4432f9450edf None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:15.840411 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 525/1054] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:31:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:31:15.846289 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccd754a-ac19-4e19-bf0d-ef5c100bb473 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:15.846760 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccd754a-ac19-4e19-bf0d-ef5c100bb473 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:15.846844 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccd754a-ac19-4e19-bf0d-ef5c100bb473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:15.864006 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-0ccd754a-ac19-4e19-bf0d-ef5c100bb473 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:31:15.865189 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-0ccd754a-ac19-4e19-bf0d-ef5c100bb473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:31:15.937470 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 530/1055] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:31:15 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 14:31:15.960240 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2629a398-d525-49e6-8ece-4432f9450edf None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:16.021785 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:16.064057 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2629a398-d525-49e6-8ece-4432f9450edf None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:16.099657 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a5dade-d828-4c15-993c-af3ed6012b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:16.100363 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a5dade-d828-4c15-993c-af3ed6012b25 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:16.100650 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a5dade-d828-4c15-993c-af3ed6012b25 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:16.100928 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a5dade-d828-4c15-993c-af3ed6012b25 None admin] PATH_INFO: `/v3/services/image` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:16.101580 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a5dade-d828-4c15-993c-af3ed6012b25 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:16.102991 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a5dade-d828-4c15-993c-af3ed6012b25 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:16.114930 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-a8a5dade-d828-4c15-993c-af3ed6012b25 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 31 14:31:16.114930 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:31:16.114930 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 31 14:31:16.114930 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 31 14:31:16.114930 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 31 14:31:16.114930 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 31 14:31:16.114930 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 31 14:31:16.114930 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 14:31:16.114930 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 31 14:31:16.114930 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:31:16.114930 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 31 14:31:16.114930 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:31:16.114930 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:31:16.114930 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:31:16.114930 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:31:16.114930 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:31:16.114930 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:31:16.115956 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:31:16.115956 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:31:16.115956 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:31:16.115956 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:31:16.115956 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:31:16.115956 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:31:16.115956 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 31 14:31:16.115956 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_service(service_id) May 31 14:31:16.115956 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 31 14:31:16.115956 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 31 14:31:16.115956 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:31:16.115956 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:31:16.115956 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:31:16.115956 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:31:16.115956 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:31:16.115956 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:31:16.121821 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:31:16.121821 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:31:16.121821 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:31:16.121821 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:31:16.121821 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:31:16.121821 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:31:16.121821 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:31:16.121821 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:31:16.121821 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:31:16.121821 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:31:16.121821 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 31 14:31:16.121821 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 14:31:16.121821 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 31 14:31:16.121821 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:31:16.121821 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 526/1056] 10.222.0.15 () {56 vars in 1105 bytes} [Tue May 31 14:31:15 2022] GET /identity/v3/services/image => generated 86 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:31:16.122672 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccd754a-ac19-4e19-bf0d-ef5c100bb473 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:16.138095 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:16.226863 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccd754a-ac19-4e19-bf0d-ef5c100bb473 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:16.260757 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1428fc08-c0ae-4c84-9bae-2c41100080d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:16.261426 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1428fc08-c0ae-4c84-9bae-2c41100080d2 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:16.261712 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1428fc08-c0ae-4c84-9bae-2c41100080d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:16.261991 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1428fc08-c0ae-4c84-9bae-2c41100080d2 None admin] PATH_INFO: `/v3/services` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:16.262816 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1428fc08-c0ae-4c84-9bae-2c41100080d2 None admin] RBAC: Adding query filter params (name=image) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:31:16.263128 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1428fc08-c0ae-4c84-9bae-2c41100080d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:16.264490 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1428fc08-c0ae-4c84-9bae-2c41100080d2 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:16.274449 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 531/1057] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:31:16 2022] GET /identity/v3/services?name=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:31:16.275838 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a5dade-d828-4c15-993c-af3ed6012b25 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:16.382751 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a5dade-d828-4c15-993c-af3ed6012b25 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:16.405522 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:16.417526 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e171fa3-ce77-4167-8201-97e5ce36be2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:16.420055 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e171fa3-ce77-4167-8201-97e5ce36be2f None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:16.420055 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e171fa3-ce77-4167-8201-97e5ce36be2f None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:16.420055 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e171fa3-ce77-4167-8201-97e5ce36be2f None admin] PATH_INFO: `/v3/services` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:16.420055 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e171fa3-ce77-4167-8201-97e5ce36be2f None admin] RBAC: Adding query filter params (type=image) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:31:16.420055 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e171fa3-ce77-4167-8201-97e5ce36be2f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:16.421327 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e171fa3-ce77-4167-8201-97e5ce36be2f None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:16.430730 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 527/1058] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:31:16 2022] GET /identity/v3/services?type=image => generated 350 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:31:16.431724 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1428fc08-c0ae-4c84-9bae-2c41100080d2 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:16.512904 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:16.534395 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1428fc08-c0ae-4c84-9bae-2c41100080d2 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:16.568751 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36aa8eb-90ba-4a74-a788-66805ac36687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:16.569476 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36aa8eb-90ba-4a74-a788-66805ac36687 None admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:16.569833 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36aa8eb-90ba-4a74-a788-66805ac36687 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:16.570192 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36aa8eb-90ba-4a74-a788-66805ac36687 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:16.571023 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36aa8eb-90ba-4a74-a788-66805ac36687 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:16.572449 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36aa8eb-90ba-4a74-a788-66805ac36687 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:16.662314 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 532/1059] 10.222.0.15 () {60 vars in 1144 bytes} [Tue May 31 14:31:16 2022] POST /identity/v3/endpoints => generated 327 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 14:31:17.862721 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e630d224-e004-4969-bfcd-c3e49c0f8cf5 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:17.863259 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e630d224-e004-4969-bfcd-c3e49c0f8cf5 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:17.863259 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e630d224-e004-4969-bfcd-c3e49c0f8cf5 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:17.864698 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 528/1060] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:31:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:31:17.870052 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b70d9d-43da-4266-80fb-16f9cc6d6739 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:17.870443 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b70d9d-43da-4266-80fb-16f9cc6d6739 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:17.870652 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b70d9d-43da-4266-80fb-16f9cc6d6739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:17.887435 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-26b70d9d-43da-4266-80fb-16f9cc6d6739 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:31:17.888620 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-26b70d9d-43da-4266-80fb-16f9cc6d6739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:31:17.917191 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329247cf-b0c9-43e0-9c4a-b413ace282c3 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:17.917488 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329247cf-b0c9-43e0-9c4a-b413ace282c3 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:17.917760 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329247cf-b0c9-43e0-9c4a-b413ace282c3 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:17.919189 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 529/1061] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:31:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:31:17.924595 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc27bf63-b4f6-4456-bdd4-b6b49bf9cf8a None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:17.924913 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc27bf63-b4f6-4456-bdd4-b6b49bf9cf8a None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:17.925162 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc27bf63-b4f6-4456-bdd4-b6b49bf9cf8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:17.943767 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-fc27bf63-b4f6-4456-bdd4-b6b49bf9cf8a None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:31:17.945412 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-fc27bf63-b4f6-4456-bdd4-b6b49bf9cf8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:31:17.972016 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 533/1062] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:31:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 14:31:17.995500 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b70d9d-43da-4266-80fb-16f9cc6d6739 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:18.017633 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 530/1063] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:31:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 31 14:31:18.040999 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc27bf63-b4f6-4456-bdd4-b6b49bf9cf8a None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:18.057902 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:18.104353 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b70d9d-43da-4266-80fb-16f9cc6d6739 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:18.143195 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc27bf63-b4f6-4456-bdd4-b6b49bf9cf8a None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:18.145004 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e2ec79-36ef-4909-b586-e2f3989cfcbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:18.145812 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e2ec79-36ef-4909-b586-e2f3989cfcbb None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:18.146100 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e2ec79-36ef-4909-b586-e2f3989cfcbb None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:18.146380 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e2ec79-36ef-4909-b586-e2f3989cfcbb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:18.158862 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e2ec79-36ef-4909-b586-e2f3989cfcbb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 14:31:18.160513 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:18.166946 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-a1e2ec79-36ef-4909-b586-e2f3989cfcbb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 31 14:31:18.166946 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:31:18.166946 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:31:18.166946 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:31:18.166946 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:31:18.166946 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:31:18.166946 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:31:18.166946 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:31:18.166946 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:31:18.166946 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:31:18.166946 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:31:18.166946 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:31:18.166946 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 14:31:18.166946 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 14:31:18.166946 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 14:31:18.166946 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 14:31:18.167988 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 14:31:18.167988 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 14:31:18.167988 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 14:31:18.167988 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 14:31:18.167988 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:31:18.167988 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:31:18.167988 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:31:18.167988 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:31:18.167988 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:31:18.167988 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:31:18.167988 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:31:18.167988 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:31:18.167988 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:31:18.167988 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:31:18.167988 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:31:18.167988 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:31:18.169530 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:31:18.169530 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:31:18.169530 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:31:18.169530 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:31:18.169530 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 14:31:18.169530 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 14:31:18.169530 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 14:31:18.169530 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 14:31:18.169530 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 14:31:18.169530 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 14:31:18.169530 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 31 14:31:18.169530 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:31:18.169530 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 534/1064] 10.222.0.15 () {56 vars in 1096 bytes} [Tue May 31 14:31:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 14:31:18.174249 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e2ec79-36ef-4909-b586-e2f3989cfcbb None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:18.181617 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed28da3-a43c-412b-bd58-fa97b2a06932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:18.182510 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed28da3-a43c-412b-bd58-fa97b2a06932 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:18.182910 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed28da3-a43c-412b-bd58-fa97b2a06932 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:18.183571 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed28da3-a43c-412b-bd58-fa97b2a06932 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:18.194154 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed28da3-a43c-412b-bd58-fa97b2a06932 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 14:31:18.203415 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-eed28da3-a43c-412b-bd58-fa97b2a06932 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 31 14:31:18.203415 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:31:18.203415 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:31:18.203415 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:31:18.203415 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:31:18.203415 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:31:18.203415 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:31:18.203415 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:31:18.203415 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:31:18.203415 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:31:18.203415 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:31:18.203415 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:31:18.203415 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 14:31:18.203415 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 14:31:18.203415 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 14:31:18.203415 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 14:31:18.204844 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 14:31:18.204844 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 14:31:18.204844 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 14:31:18.204844 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 14:31:18.204844 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:31:18.204844 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:31:18.204844 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:31:18.204844 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:31:18.204844 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:31:18.204844 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:31:18.204844 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:31:18.204844 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:31:18.204844 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:31:18.204844 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:31:18.204844 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:31:18.204844 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:31:18.205670 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:31:18.205670 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:31:18.205670 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:31:18.205670 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:31:18.205670 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 14:31:18.205670 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 14:31:18.205670 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 14:31:18.205670 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 14:31:18.205670 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 14:31:18.205670 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 14:31:18.205670 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 31 14:31:18.205670 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:31:18.205670 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 531/1065] 10.222.0.15 () {56 vars in 1120 bytes} [Tue May 31 14:31:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 14:31:18.212457 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed28da3-a43c-412b-bd58-fa97b2a06932 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:18.299176 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e2ec79-36ef-4909-b586-e2f3989cfcbb None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:18.320756 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:18.322683 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed28da3-a43c-412b-bd58-fa97b2a06932 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:18.335175 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67ceca3-e936-4fd1-998d-21c963b837e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:18.338766 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ceca3-e936-4fd1-998d-21c963b837e7 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:18.338766 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ceca3-e936-4fd1-998d-21c963b837e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:18.338766 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67ceca3-e936-4fd1-998d-21c963b837e7 None admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:18.338766 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67ceca3-e936-4fd1-998d-21c963b837e7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:31:18.338766 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67ceca3-e936-4fd1-998d-21c963b837e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:18.338766 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67ceca3-e936-4fd1-998d-21c963b837e7 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:18.349040 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 535/1066] 10.222.0.15 () {56 vars in 1099 bytes} [Tue May 31 14:31:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 14:31:18.354810 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67ceca3-e936-4fd1-998d-21c963b837e7 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:18.367053 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6fda30-217c-4542-8d12-eaf79c609d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:18.368578 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6fda30-217c-4542-8d12-eaf79c609d2a None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:18.369030 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6fda30-217c-4542-8d12-eaf79c609d2a None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:18.369463 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6fda30-217c-4542-8d12-eaf79c609d2a None admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:18.370516 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6fda30-217c-4542-8d12-eaf79c609d2a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:31:18.371018 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6fda30-217c-4542-8d12-eaf79c609d2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:18.372522 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6fda30-217c-4542-8d12-eaf79c609d2a None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:18.381925 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 532/1067] 10.222.0.15 () {56 vars in 1115 bytes} [Tue May 31 14:31:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 14:31:18.387607 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6fda30-217c-4542-8d12-eaf79c609d2a None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:18.431737 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:18.461938 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67ceca3-e936-4fd1-998d-21c963b837e7 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:18.495874 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6fda30-217c-4542-8d12-eaf79c609d2a None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:18.497318 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4240b597-389d-4f70-9d61-6290ba8a23c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:18.498141 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4240b597-389d-4f70-9d61-6290ba8a23c3 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:18.498430 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4240b597-389d-4f70-9d61-6290ba8a23c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:18.498735 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4240b597-389d-4f70-9d61-6290ba8a23c3 None admin] PATH_INFO: `/v3/users/25a3dd4ed3cc4e80bbad7c7094c9d1c6` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:18.499939 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4240b597-389d-4f70-9d61-6290ba8a23c3 None admin] RBAC: Authorizing `identity:get_user(user_id=25a3dd4ed3cc4e80bbad7c7094c9d1c6)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:18.501895 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4240b597-389d-4f70-9d61-6290ba8a23c3 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:18.503549 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 536/1068] 10.222.0.15 () {56 vars in 1177 bytes} [Tue May 31 14:31:18 2022] GET /identity/v3/users/25a3dd4ed3cc4e80bbad7c7094c9d1c6 => generated 285 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 14:31:18.509034 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4240b597-389d-4f70-9d61-6290ba8a23c3 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:18.538622 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76e4a70-82a6-4381-b9d5-29c692ba9d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:18.539526 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76e4a70-82a6-4381-b9d5-29c692ba9d1b None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:18.539919 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76e4a70-82a6-4381-b9d5-29c692ba9d1b None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:18.540194 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76e4a70-82a6-4381-b9d5-29c692ba9d1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:18.550902 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76e4a70-82a6-4381-b9d5-29c692ba9d1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:18.552351 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76e4a70-82a6-4381-b9d5-29c692ba9d1b None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:18.559192 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:18.572173 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-d76e4a70-82a6-4381-b9d5-29c692ba9d1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:31:18.572173 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:31:18.572173 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:31:18.572173 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:31:18.572173 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:31:18.572173 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:31:18.572173 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:31:18.572173 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:31:18.572173 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:31:18.572173 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:31:18.572173 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:31:18.572173 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:31:18.572173 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 14:31:18.572173 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 14:31:18.572173 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 14:31:18.578413 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 14:31:18.578413 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:31:18.578413 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:31:18.578413 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:31:18.578413 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:31:18.578413 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:31:18.578413 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:31:18.578413 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:31:18.578413 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:31:18.578413 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:31:18.578413 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:31:18.578413 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:31:18.578413 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:31:18.578413 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:31:18.578413 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:31:18.578413 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:31:18.578413 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:31:18.579930 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 14:31:18.579930 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 14:31:18.579930 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:31:18.579930 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:31:18.579930 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 533/1069] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:31:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 14:31:18.579930 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76e4a70-82a6-4381-b9d5-29c692ba9d1b None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:18.621364 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4240b597-389d-4f70-9d61-6290ba8a23c3 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:18.659018 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189862c6-1977-45a1-8163-29e437329ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:18.659879 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189862c6-1977-45a1-8163-29e437329ab1 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:18.660162 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189862c6-1977-45a1-8163-29e437329ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:18.660440 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189862c6-1977-45a1-8163-29e437329ab1 None admin] PATH_INFO: `/v3/projects/d58a91e5d27b4171bad2aecfefada8cb` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:18.661620 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189862c6-1977-45a1-8163-29e437329ab1 None admin] RBAC: Authorizing `identity:get_project(project_id=d58a91e5d27b4171bad2aecfefada8cb)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:18.663080 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189862c6-1977-45a1-8163-29e437329ab1 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:18.664757 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 537/1070] 10.222.0.15 () {56 vars in 1186 bytes} [Tue May 31 14:31:18 2022] GET /identity/v3/projects/d58a91e5d27b4171bad2aecfefada8cb => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 14:31:18.670501 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189862c6-1977-45a1-8163-29e437329ab1 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:18.686161 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:18.696160 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76e4a70-82a6-4381-b9d5-29c692ba9d1b None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:18.730630 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3919f015-e6e5-40b0-819a-5a1ff0f0fefc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:18.731379 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3919f015-e6e5-40b0-819a-5a1ff0f0fefc None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:18.731664 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3919f015-e6e5-40b0-819a-5a1ff0f0fefc None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:18.731942 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3919f015-e6e5-40b0-819a-5a1ff0f0fefc None admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:18.732648 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3919f015-e6e5-40b0-819a-5a1ff0f0fefc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:31:18.732950 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3919f015-e6e5-40b0-819a-5a1ff0f0fefc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:18.734318 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3919f015-e6e5-40b0-819a-5a1ff0f0fefc None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:18.747091 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 534/1071] 10.222.0.15 () {56 vars in 1109 bytes} [Tue May 31 14:31:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 14:31:18.753241 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3919f015-e6e5-40b0-819a-5a1ff0f0fefc None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:18.791676 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189862c6-1977-45a1-8163-29e437329ab1 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:18.810058 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:18.827174 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1a72a1-688b-4941-be4b-92303dc8b5ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:18.828061 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a72a1-688b-4941-be4b-92303dc8b5ad None admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:18.828344 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a72a1-688b-4941-be4b-92303dc8b5ad None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:18.828649 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a72a1-688b-4941-be4b-92303dc8b5ad None admin] PATH_INFO: `/v3/projects/d58a91e5d27b4171bad2aecfefada8cb/users/25a3dd4ed3cc4e80bbad7c7094c9d1c6/roles/76c53e2c353644f885028a0226c06146` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:18.830707 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1a72a1-688b-4941-be4b-92303dc8b5ad None admin] RBAC: Authorizing `identity:create_grant(project_id=d58a91e5d27b4171bad2aecfefada8cb, user_id=25a3dd4ed3cc4e80bbad7c7094c9d1c6, role_id=76c53e2c353644f885028a0226c06146)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:18.832205 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1a72a1-688b-4941-be4b-92303dc8b5ad None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:18.862308 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3919f015-e6e5-40b0-819a-5a1ff0f0fefc None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:18.895865 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c9e572-16dd-44f4-a424-fdf0832baafb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:18.896656 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c9e572-16dd-44f4-a424-fdf0832baafb None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:18.896950 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c9e572-16dd-44f4-a424-fdf0832baafb None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:18.897237 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c9e572-16dd-44f4-a424-fdf0832baafb None admin] PATH_INFO: `/v3/users/nova` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:18.904278 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c9e572-16dd-44f4-a424-fdf0832baafb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:18.906052 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c9e572-16dd-44f4-a424-fdf0832baafb None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:18.920394 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-23c9e572-16dd-44f4-a424-fdf0832baafb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 31 14:31:18.920394 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:31:18.920394 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:31:18.920394 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:31:18.920394 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:31:18.920394 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:31:18.920394 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:31:18.920394 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:31:18.920394 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:31:18.920394 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:31:18.920394 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:31:18.920394 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:31:18.920394 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 14:31:18.920394 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 14:31:18.920394 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 14:31:18.920394 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 14:31:18.923794 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:31:18.923794 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:31:18.923794 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 14:31:18.923794 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 14:31:18.923794 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 14:31:18.923794 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 14:31:18.923794 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:31:18.923794 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:31:18.923794 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:31:18.923794 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:31:18.923794 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:31:18.923794 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:31:18.923794 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:31:18.923794 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:31:18.923794 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:31:18.923794 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:31:18.923794 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:31:18.923794 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:31:18.924759 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:31:18.924759 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:31:18.924759 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 14:31:18.924759 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 14:31:18.924759 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 14:31:18.924759 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 14:31:18.924759 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 14:31:18.924759 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 14:31:18.924759 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 31 14:31:18.924759 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:31:18.924759 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 535/1072] 10.222.0.15 () {56 vars in 1093 bytes} [Tue May 31 14:31:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 14:31:18.927702 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c9e572-16dd-44f4-a424-fdf0832baafb None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:18.940101 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:18.950196 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 538/1073] 10.222.0.15 () {58 vars in 1439 bytes} [Tue May 31 14:31:18 2022] PUT /identity/v3/projects/d58a91e5d27b4171bad2aecfefada8cb/users/25a3dd4ed3cc4e80bbad7c7094c9d1c6/roles/76c53e2c353644f885028a0226c06146 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 14:31:18.953581 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8992d30a-328e-4441-a791-46c08db01927 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:18.953581 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8992d30a-328e-4441-a791-46c08db01927 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:18.953581 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8992d30a-328e-4441-a791-46c08db01927 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:18.954466 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 539/1074] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:31:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:31:18.960641 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d36a9-764a-4a17-8f6a-5617f630e7f5 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:18.960951 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d36a9-764a-4a17-8f6a-5617f630e7f5 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:18.961211 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d36a9-764a-4a17-8f6a-5617f630e7f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:18.978897 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-2c1d36a9-764a-4a17-8f6a-5617f630e7f5 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:31:18.980139 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-2c1d36a9-764a-4a17-8f6a-5617f630e7f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:31:19.043817 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c9e572-16dd-44f4-a424-fdf0832baafb None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:19.053162 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 540/1075] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:31:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 14:31:19.078330 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1d36a9-764a-4a17-8f6a-5617f630e7f5 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:19.086054 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eac377-e51d-4e83-86d3-83123053388a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:19.086947 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eac377-e51d-4e83-86d3-83123053388a None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:19.087235 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eac377-e51d-4e83-86d3-83123053388a None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:19.087512 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eac377-e51d-4e83-86d3-83123053388a None admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:19.088399 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eac377-e51d-4e83-86d3-83123053388a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:31:19.088829 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eac377-e51d-4e83-86d3-83123053388a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:19.090444 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eac377-e51d-4e83-86d3-83123053388a None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:19.116123 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 536/1076] 10.222.0.15 () {56 vars in 1133 bytes} [Tue May 31 14:31:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 14:31:19.116952 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eac377-e51d-4e83-86d3-83123053388a None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:19.191374 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:19.195458 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1d36a9-764a-4a17-8f6a-5617f630e7f5 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:19.205382 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:19.225762 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eac377-e51d-4e83-86d3-83123053388a None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:19.231046 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a374592f-1610-4b32-b450-fcba79b5a11c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:19.231705 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a374592f-1610-4b32-b450-fcba79b5a11c None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:19.231989 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a374592f-1610-4b32-b450-fcba79b5a11c None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:19.232268 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a374592f-1610-4b32-b450-fcba79b5a11c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:19.262424 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d134ae-aad3-49fe-a518-5b537b08f552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:19.263564 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d134ae-aad3-49fe-a518-5b537b08f552 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:19.263844 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d134ae-aad3-49fe-a518-5b537b08f552 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:19.264145 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d134ae-aad3-49fe-a518-5b537b08f552 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:19.274422 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d134ae-aad3-49fe-a518-5b537b08f552 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:19.275895 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d134ae-aad3-49fe-a518-5b537b08f552 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:19.294217 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-b2d134ae-aad3-49fe-a518-5b537b08f552 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:31:19.294217 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:31:19.294217 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:31:19.294217 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:31:19.294217 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:31:19.294217 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:31:19.294217 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:31:19.294217 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:31:19.294217 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:31:19.294217 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:31:19.294217 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:31:19.294217 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:31:19.294217 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 14:31:19.294217 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 14:31:19.294217 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 14:31:19.295437 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 14:31:19.295437 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:31:19.295437 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:31:19.295437 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:31:19.295437 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:31:19.295437 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:31:19.295437 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:31:19.295437 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:31:19.295437 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:31:19.295437 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:31:19.295437 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:31:19.295437 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:31:19.295437 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:31:19.295437 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:31:19.295437 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:31:19.295437 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:31:19.295437 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:31:19.296539 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 14:31:19.296539 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 14:31:19.296539 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:31:19.296539 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:31:19.300797 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 537/1077] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:31:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:31:19.301705 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d134ae-aad3-49fe-a518-5b537b08f552 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:19.309820 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a374592f-1610-4b32-b450-fcba79b5a11c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:19.311347 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a374592f-1610-4b32-b450-fcba79b5a11c None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:19.409342 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d134ae-aad3-49fe-a518-5b537b08f552 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:19.430187 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:19.435933 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 541/1078] 10.222.0.15 () {58 vars in 1282 bytes} [Tue May 31 14:31:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 31 14:31:19.441803 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a374592f-1610-4b32-b450-fcba79b5a11c None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:19.444050 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31107822-22e3-4d50-ae82-b58750ed6352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:19.444755 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31107822-22e3-4d50-ae82-b58750ed6352 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:19.445035 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31107822-22e3-4d50-ae82-b58750ed6352 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:19.445308 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31107822-22e3-4d50-ae82-b58750ed6352 None admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:19.446023 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31107822-22e3-4d50-ae82-b58750ed6352 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:31:19.446328 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31107822-22e3-4d50-ae82-b58750ed6352 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:19.447743 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31107822-22e3-4d50-ae82-b58750ed6352 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:19.451945 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:19.460328 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 538/1079] 10.222.0.15 () {56 vars in 1109 bytes} [Tue May 31 14:31:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:31:19.465668 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31107822-22e3-4d50-ae82-b58750ed6352 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:19.546433 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a374592f-1610-4b32-b450-fcba79b5a11c None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:19.574876 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31107822-22e3-4d50-ae82-b58750ed6352 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:19.583078 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c96c69c-3730-4379-84e2-139d63a6e4b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:19.583872 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c96c69c-3730-4379-84e2-139d63a6e4b4 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:19.584156 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c96c69c-3730-4379-84e2-139d63a6e4b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:19.584437 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c96c69c-3730-4379-84e2-139d63a6e4b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:19.595330 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c96c69c-3730-4379-84e2-139d63a6e4b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:19.596791 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c96c69c-3730-4379-84e2-139d63a6e4b4 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:19.610700 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06df2ad-b01f-4afe-b320-f89dc1cc1d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:19.611491 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06df2ad-b01f-4afe-b320-f89dc1cc1d13 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:19.611770 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06df2ad-b01f-4afe-b320-f89dc1cc1d13 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:19.612043 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06df2ad-b01f-4afe-b320-f89dc1cc1d13 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:19.614853 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-3c96c69c-3730-4379-84e2-139d63a6e4b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:31:19.614853 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:31:19.614853 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:31:19.614853 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:31:19.614853 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:31:19.614853 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:31:19.614853 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:31:19.614853 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:31:19.614853 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:31:19.614853 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:31:19.614853 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:31:19.614853 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:31:19.614853 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 14:31:19.614853 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 14:31:19.614853 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 14:31:19.615732 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 14:31:19.615732 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:31:19.615732 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:31:19.615732 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:31:19.615732 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:31:19.615732 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:31:19.615732 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:31:19.615732 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:31:19.615732 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:31:19.615732 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:31:19.615732 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:31:19.615732 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:31:19.615732 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:31:19.615732 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:31:19.615732 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:31:19.615732 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:31:19.615732 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:31:19.616627 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 14:31:19.616627 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 14:31:19.616627 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:31:19.616627 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:31:19.618786 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06df2ad-b01f-4afe-b320-f89dc1cc1d13 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:19.620221 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06df2ad-b01f-4afe-b320-f89dc1cc1d13 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:19.621181 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 542/1080] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:31:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 14:31:19.622051 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c96c69c-3730-4379-84e2-139d63a6e4b4 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:19.635076 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-a06df2ad-b01f-4afe-b320-f89dc1cc1d13 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 14:31:19.635076 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:31:19.635076 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:31:19.635076 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:31:19.635076 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:31:19.635076 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:31:19.635076 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:31:19.635076 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:31:19.635076 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:31:19.635076 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:31:19.635076 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:31:19.635076 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:31:19.635076 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 14:31:19.635076 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 14:31:19.635076 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 14:31:19.636016 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 14:31:19.636016 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:31:19.636016 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:31:19.636016 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:31:19.636016 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:31:19.636016 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:31:19.636016 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:31:19.636016 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:31:19.636016 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:31:19.636016 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:31:19.636016 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:31:19.636016 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:31:19.636016 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:31:19.636016 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:31:19.636016 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:31:19.636016 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:31:19.636016 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:31:19.636922 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 14:31:19.636922 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 14:31:19.636922 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 14:31:19.636922 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 14:31:19.636922 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 14:31:19.636922 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 14:31:19.636922 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 14:31:19.636922 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:31:19.636922 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 539/1081] 10.222.0.15 () {56 vars in 1111 bytes} [Tue May 31 14:31:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 14:31:19.642414 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06df2ad-b01f-4afe-b320-f89dc1cc1d13 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:19.687924 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:19.691452 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:19.730985 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c96c69c-3730-4379-84e2-139d63a6e4b4 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:19.756567 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06df2ad-b01f-4afe-b320-f89dc1cc1d13 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:19.766519 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6002fe29-0634-4bd8-871f-11c179ecec19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:19.767280 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6002fe29-0634-4bd8-871f-11c179ecec19 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:19.767569 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6002fe29-0634-4bd8-871f-11c179ecec19 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:19.767836 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6002fe29-0634-4bd8-871f-11c179ecec19 None admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:19.768554 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6002fe29-0634-4bd8-871f-11c179ecec19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:31:19.768859 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6002fe29-0634-4bd8-871f-11c179ecec19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:19.770257 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6002fe29-0634-4bd8-871f-11c179ecec19 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:19.783211 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 543/1082] 10.222.0.15 () {56 vars in 1109 bytes} [Tue May 31 14:31:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:31:19.807514 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b53e9ec-3d39-485b-a5f2-14bf8029f791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:19.808204 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b53e9ec-3d39-485b-a5f2-14bf8029f791 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:19.808497 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b53e9ec-3d39-485b-a5f2-14bf8029f791 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:19.808779 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b53e9ec-3d39-485b-a5f2-14bf8029f791 None admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:19.809589 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b53e9ec-3d39-485b-a5f2-14bf8029f791 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:31:19.809902 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b53e9ec-3d39-485b-a5f2-14bf8029f791 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:19.811429 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b53e9ec-3d39-485b-a5f2-14bf8029f791 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:19.830170 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 540/1083] 10.222.0.15 () {56 vars in 1148 bytes} [Tue May 31 14:31:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 14:31:19.831265 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6002fe29-0634-4bd8-871f-11c179ecec19 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:19.939722 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6002fe29-0634-4bd8-871f-11c179ecec19 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:19.964548 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:19.980115 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f229df98-a27b-40c8-945b-2abd34cfdd35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:19.981141 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f229df98-a27b-40c8-945b-2abd34cfdd35 None admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:19.981391 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f229df98-a27b-40c8-945b-2abd34cfdd35 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:19.981674 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f229df98-a27b-40c8-945b-2abd34cfdd35 None admin] PATH_INFO: `/v3/projects/ffff4334538649fdba1beb80cad207fa/users/b57768d448e345ad8879bf29f21b48ea/roles/c71617921821419bba278e390d70ac77` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:19.984340 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f229df98-a27b-40c8-945b-2abd34cfdd35 None admin] RBAC: Authorizing `identity:create_grant(project_id=ffff4334538649fdba1beb80cad207fa, user_id=b57768d448e345ad8879bf29f21b48ea, role_id=c71617921821419bba278e390d70ac77)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:19.985853 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f229df98-a27b-40c8-945b-2abd34cfdd35 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:20.058271 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 544/1084] 10.222.0.15 () {58 vars in 1439 bytes} [Tue May 31 14:31:19 2022] PUT /identity/v3/projects/ffff4334538649fdba1beb80cad207fa/users/b57768d448e345ad8879bf29f21b48ea/roles/c71617921821419bba278e390d70ac77 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:31:21.232639 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fcf1bd-317f-4782-8b10-00aeb51ef311 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:21.233165 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fcf1bd-317f-4782-8b10-00aeb51ef311 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:21.233165 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fcf1bd-317f-4782-8b10-00aeb51ef311 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:21.235065 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 541/1085] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:31:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:31:21.240526 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f040079-b8f0-4491-9327-eab4cddd2dac None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:21.240968 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f040079-b8f0-4491-9327-eab4cddd2dac None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:21.241086 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f040079-b8f0-4491-9327-eab4cddd2dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:21.258239 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-5f040079-b8f0-4491-9327-eab4cddd2dac None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:31:21.259438 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-5f040079-b8f0-4491-9327-eab4cddd2dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:31:21.327038 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 545/1086] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:31:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 14:31:21.350704 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fcf1bd-317f-4782-8b10-00aeb51ef311 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:21.451138 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:21.455671 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fcf1bd-317f-4782-8b10-00aeb51ef311 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:21.488500 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351b3f49-7cb3-4d35-98b0-523b9ec8a06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:21.489221 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b3f49-7cb3-4d35-98b0-523b9ec8a06b None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:21.489500 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b3f49-7cb3-4d35-98b0-523b9ec8a06b None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:21.489778 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b3f49-7cb3-4d35-98b0-523b9ec8a06b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:21.499477 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351b3f49-7cb3-4d35-98b0-523b9ec8a06b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 14:31:21.507642 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-351b3f49-7cb3-4d35-98b0-523b9ec8a06b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 31 14:31:21.507642 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:31:21.507642 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:31:21.507642 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:31:21.507642 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:31:21.507642 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:31:21.507642 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:31:21.507642 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:31:21.507642 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:31:21.507642 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:31:21.507642 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:31:21.507642 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:31:21.507642 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 14:31:21.507642 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 14:31:21.507642 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 14:31:21.507642 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 14:31:21.508629 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 14:31:21.508629 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 14:31:21.508629 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 14:31:21.508629 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 14:31:21.508629 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:31:21.508629 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:31:21.508629 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:31:21.508629 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:31:21.508629 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:31:21.508629 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:31:21.508629 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:31:21.508629 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:31:21.508629 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:31:21.508629 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:31:21.508629 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:31:21.508629 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:31:21.509470 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:31:21.509470 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:31:21.509470 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:31:21.509470 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:31:21.509470 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 14:31:21.509470 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 14:31:21.509470 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 14:31:21.509470 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 14:31:21.509470 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 14:31:21.509470 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 14:31:21.509470 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 31 14:31:21.509470 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:31:21.509470 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 542/1087] 10.222.0.15 () {56 vars in 1096 bytes} [Tue May 31 14:31:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:31:21.514761 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f040079-b8f0-4491-9327-eab4cddd2dac None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:21.608692 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f040079-b8f0-4491-9327-eab4cddd2dac None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:21.618835 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:21.641791 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefa7dcd-b669-483f-a704-2f937261ccf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:21.642444 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefa7dcd-b669-483f-a704-2f937261ccf3 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:21.642751 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefa7dcd-b669-483f-a704-2f937261ccf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:21.643028 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefa7dcd-b669-483f-a704-2f937261ccf3 None admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:21.643754 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefa7dcd-b669-483f-a704-2f937261ccf3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:31:21.644058 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefa7dcd-b669-483f-a704-2f937261ccf3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:21.645464 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefa7dcd-b669-483f-a704-2f937261ccf3 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:21.653900 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 546/1088] 10.222.0.15 () {56 vars in 1099 bytes} [Tue May 31 14:31:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:31:21.659915 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351b3f49-7cb3-4d35-98b0-523b9ec8a06b None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:21.755171 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351b3f49-7cb3-4d35-98b0-523b9ec8a06b None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:21.787265 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecdb91b-8244-48cc-953d-6d6cc53394ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:21.788120 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecdb91b-8244-48cc-953d-6d6cc53394ce None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:21.788405 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecdb91b-8244-48cc-953d-6d6cc53394ce None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:21.788676 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecdb91b-8244-48cc-953d-6d6cc53394ce None admin] PATH_INFO: `/v3/users/25a3dd4ed3cc4e80bbad7c7094c9d1c6` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:21.789835 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecdb91b-8244-48cc-953d-6d6cc53394ce None admin] RBAC: Authorizing `identity:get_user(user_id=25a3dd4ed3cc4e80bbad7c7094c9d1c6)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:21.791301 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecdb91b-8244-48cc-953d-6d6cc53394ce None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:21.792942 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 543/1089] 10.222.0.15 () {56 vars in 1177 bytes} [Tue May 31 14:31:21 2022] GET /identity/v3/users/25a3dd4ed3cc4e80bbad7c7094c9d1c6 => generated 285 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:31:21.799491 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefa7dcd-b669-483f-a704-2f937261ccf3 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:21.895656 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefa7dcd-b669-483f-a704-2f937261ccf3 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:21.927954 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc75954b-48f1-4b72-9b24-56a7e3b22e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:21.928592 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc75954b-48f1-4b72-9b24-56a7e3b22e66 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:21.928874 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc75954b-48f1-4b72-9b24-56a7e3b22e66 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:21.929150 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc75954b-48f1-4b72-9b24-56a7e3b22e66 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:21.971352 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:22.001489 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc75954b-48f1-4b72-9b24-56a7e3b22e66 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:22.002981 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc75954b-48f1-4b72-9b24-56a7e3b22e66 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:22.096622 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 547/1090] 10.222.0.15 () {58 vars in 1282 bytes} [Tue May 31 14:31:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 31 14:31:22.102524 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecdb91b-8244-48cc-953d-6d6cc53394ce None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:22.130508 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:22.199862 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecdb91b-8244-48cc-953d-6d6cc53394ce None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:22.231679 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa6c65b-3499-428a-9331-72673c0aa1b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:22.232531 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa6c65b-3499-428a-9331-72673c0aa1b9 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:22.232813 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa6c65b-3499-428a-9331-72673c0aa1b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:22.233343 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa6c65b-3499-428a-9331-72673c0aa1b9 None admin] PATH_INFO: `/v3/projects/d58a91e5d27b4171bad2aecfefada8cb` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:22.234235 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa6c65b-3499-428a-9331-72673c0aa1b9 None admin] RBAC: Authorizing `identity:get_project(project_id=d58a91e5d27b4171bad2aecfefada8cb)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:22.236268 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa6c65b-3499-428a-9331-72673c0aa1b9 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:22.237941 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 544/1091] 10.222.0.15 () {56 vars in 1186 bytes} [Tue May 31 14:31:22 2022] GET /identity/v3/projects/d58a91e5d27b4171bad2aecfefada8cb => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:31:22.243951 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc75954b-48f1-4b72-9b24-56a7e3b22e66 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:22.308761 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3d5c10-6ec6-4525-99c7-d41b0eed26aa None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:22.309130 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3d5c10-6ec6-4525-99c7-d41b0eed26aa None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:22.309489 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3d5c10-6ec6-4525-99c7-d41b0eed26aa None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:22.310964 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 545/1092] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:31:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 31 14:31:22.314418 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:22.315994 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266cce23-cab6-42c9-b845-3f058cb69be2 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:22.316287 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266cce23-cab6-42c9-b845-3f058cb69be2 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:22.316571 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266cce23-cab6-42c9-b845-3f058cb69be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:22.332905 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-266cce23-cab6-42c9-b845-3f058cb69be2 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:31:22.334098 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-266cce23-cab6-42c9-b845-3f058cb69be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:31:22.343454 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc75954b-48f1-4b72-9b24-56a7e3b22e66 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:22.377137 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835eb293-847a-4a19-beb8-f98e5fa91c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:22.377717 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835eb293-847a-4a19-beb8-f98e5fa91c10 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:22.378003 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835eb293-847a-4a19-beb8-f98e5fa91c10 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:22.378281 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835eb293-847a-4a19-beb8-f98e5fa91c10 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:22.379128 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835eb293-847a-4a19-beb8-f98e5fa91c10 None admin] RBAC: Adding query filter params (role.id=76c53e2c353644f885028a0226c06146, scope.project.id=d58a91e5d27b4171bad2aecfefada8cb, user.id=25a3dd4ed3cc4e80bbad7c7094c9d1c6) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:31:22.379442 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835eb293-847a-4a19-beb8-f98e5fa91c10 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:22.380858 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835eb293-847a-4a19-beb8-f98e5fa91c10 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:22.386543 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 548/1093] 10.222.0.15 () {56 vars in 1374 bytes} [Tue May 31 14:31:22 2022] GET /identity/v3/role_assignments?user.id=25a3dd4ed3cc4e80bbad7c7094c9d1c6&scope.project.id=d58a91e5d27b4171bad2aecfefada8cb&role.id=76c53e2c353644f885028a0226c06146 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:31:22.401397 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 546/1094] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:31:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 31 14:31:22.427480 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835eb293-847a-4a19-beb8-f98e5fa91c10 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:22.535445 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835eb293-847a-4a19-beb8-f98e5fa91c10 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:22.569103 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70688f89-9b0f-4c6f-8e5a-f3ce443a56a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:22.569981 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70688f89-9b0f-4c6f-8e5a-f3ce443a56a2 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:22.570268 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70688f89-9b0f-4c6f-8e5a-f3ce443a56a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:22.570578 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70688f89-9b0f-4c6f-8e5a-f3ce443a56a2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:22.573323 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:22.582434 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70688f89-9b0f-4c6f-8e5a-f3ce443a56a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 14:31:22.590536 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-70688f89-9b0f-4c6f-8e5a-f3ce443a56a2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 31 14:31:22.590536 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:31:22.590536 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:31:22.590536 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:31:22.590536 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:31:22.590536 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:31:22.590536 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:31:22.590536 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:31:22.590536 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:31:22.590536 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:31:22.590536 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:31:22.590536 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:31:22.590536 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 14:31:22.590536 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 14:31:22.590536 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 14:31:22.590536 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 14:31:22.591560 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 14:31:22.591560 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 14:31:22.591560 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 14:31:22.591560 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 14:31:22.591560 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:31:22.591560 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:31:22.591560 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:31:22.591560 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:31:22.591560 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:31:22.591560 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:31:22.591560 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:31:22.591560 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:31:22.591560 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:31:22.591560 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:31:22.591560 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:31:22.591560 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:31:22.592430 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:31:22.592430 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:31:22.592430 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:31:22.592430 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:31:22.592430 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 14:31:22.592430 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 14:31:22.592430 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 14:31:22.592430 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 14:31:22.592430 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 14:31:22.592430 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 14:31:22.592430 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 31 14:31:22.592430 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:31:22.592430 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 549/1095] 10.222.0.15 () {56 vars in 1120 bytes} [Tue May 31 14:31:22 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:31:22.598466 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266cce23-cab6-42c9-b845-3f058cb69be2 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:22.624788 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:22.695941 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266cce23-cab6-42c9-b845-3f058cb69be2 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:22.728683 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb18145d-5efe-417a-8d15-f8be117842ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:22.729345 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb18145d-5efe-417a-8d15-f8be117842ba None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:22.729623 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb18145d-5efe-417a-8d15-f8be117842ba None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:22.729893 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb18145d-5efe-417a-8d15-f8be117842ba None admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:22.730650 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb18145d-5efe-417a-8d15-f8be117842ba None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:31:22.730959 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb18145d-5efe-417a-8d15-f8be117842ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:22.732306 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb18145d-5efe-417a-8d15-f8be117842ba None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:22.740085 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 547/1096] 10.222.0.15 () {56 vars in 1115 bytes} [Tue May 31 14:31:22 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 14:31:22.745854 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70688f89-9b0f-4c6f-8e5a-f3ce443a56a2 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:22.842543 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70688f89-9b0f-4c6f-8e5a-f3ce443a56a2 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:22.874848 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc9b45d-6b99-429b-a73a-f10afb7c4782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:22.876177 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc9b45d-6b99-429b-a73a-f10afb7c4782 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:22.876458 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc9b45d-6b99-429b-a73a-f10afb7c4782 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:22.876729 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc9b45d-6b99-429b-a73a-f10afb7c4782 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:22.886418 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc9b45d-6b99-429b-a73a-f10afb7c4782 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:22.887875 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc9b45d-6b99-429b-a73a-f10afb7c4782 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:22.904651 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-8dc9b45d-6b99-429b-a73a-f10afb7c4782 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:31:22.904651 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:31:22.904651 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:31:22.904651 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:31:22.904651 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:31:22.904651 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:31:22.904651 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:31:22.904651 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:31:22.904651 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:31:22.904651 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:31:22.904651 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:31:22.904651 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:31:22.904651 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 14:31:22.904651 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 14:31:22.904651 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 14:31:22.905802 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 14:31:22.905802 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:31:22.905802 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:31:22.905802 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:31:22.905802 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:31:22.905802 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:31:22.905802 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:31:22.905802 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:31:22.905802 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:31:22.905802 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:31:22.905802 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:31:22.905802 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:31:22.905802 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:31:22.905802 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:31:22.905802 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:31:22.905802 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:31:22.905802 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:31:22.907647 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 14:31:22.907647 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 14:31:22.907647 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:31:22.907647 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:31:22.907647 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 550/1097] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:31:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:31:22.912235 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb18145d-5efe-417a-8d15-f8be117842ba None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:22.997427 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:23.008606 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb18145d-5efe-417a-8d15-f8be117842ba None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:23.040572 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4824f4bd-406a-4530-9441-b0452f4e96fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:23.041222 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4824f4bd-406a-4530-9441-b0452f4e96fb None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:23.041502 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4824f4bd-406a-4530-9441-b0452f4e96fb None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:23.041773 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4824f4bd-406a-4530-9441-b0452f4e96fb None admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:23.042474 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4824f4bd-406a-4530-9441-b0452f4e96fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:31:23.042802 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4824f4bd-406a-4530-9441-b0452f4e96fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:23.044151 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4824f4bd-406a-4530-9441-b0452f4e96fb None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:23.056129 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 548/1098] 10.222.0.15 () {56 vars in 1109 bytes} [Tue May 31 14:31:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:31:23.061593 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc9b45d-6b99-429b-a73a-f10afb7c4782 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:23.108802 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:23.158453 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc9b45d-6b99-429b-a73a-f10afb7c4782 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:23.190936 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7adcb02-29fc-4682-9574-9054577ea50c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:23.191714 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7adcb02-29fc-4682-9574-9054577ea50c None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:23.192000 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7adcb02-29fc-4682-9574-9054577ea50c None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:23.192273 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7adcb02-29fc-4682-9574-9054577ea50c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:23.199570 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7adcb02-29fc-4682-9574-9054577ea50c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:23.200992 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7adcb02-29fc-4682-9574-9054577ea50c None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:23.214502 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-b7adcb02-29fc-4682-9574-9054577ea50c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 31 14:31:23.214502 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:31:23.214502 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:31:23.214502 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:31:23.214502 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:31:23.214502 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:31:23.214502 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:31:23.214502 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:31:23.214502 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:31:23.214502 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:31:23.214502 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:31:23.214502 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:31:23.214502 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 14:31:23.214502 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 14:31:23.214502 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 14:31:23.214502 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 14:31:23.215502 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:31:23.215502 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:31:23.215502 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 14:31:23.215502 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 14:31:23.215502 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 14:31:23.215502 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 14:31:23.215502 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:31:23.215502 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:31:23.215502 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:31:23.215502 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:31:23.215502 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:31:23.215502 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:31:23.215502 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:31:23.215502 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:31:23.215502 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:31:23.215502 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:31:23.215502 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:31:23.215502 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:31:23.216465 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:31:23.216465 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:31:23.216465 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 14:31:23.216465 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 14:31:23.216465 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 14:31:23.216465 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 14:31:23.216465 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 14:31:23.216465 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 14:31:23.216465 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 31 14:31:23.216465 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:31:23.216465 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 551/1099] 10.222.0.15 () {56 vars in 1093 bytes} [Tue May 31 14:31:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:31:23.221800 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4824f4bd-406a-4530-9441-b0452f4e96fb None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:23.322416 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4824f4bd-406a-4530-9441-b0452f4e96fb None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:23.354851 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c5c40f-afa9-48c9-99fb-e8335c611241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:23.355508 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c5c40f-afa9-48c9-99fb-e8335c611241 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:23.355992 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c5c40f-afa9-48c9-99fb-e8335c611241 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:23.356282 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c5c40f-afa9-48c9-99fb-e8335c611241 None admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:23.357101 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c5c40f-afa9-48c9-99fb-e8335c611241 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:31:23.357407 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c5c40f-afa9-48c9-99fb-e8335c611241 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:23.358835 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c5c40f-afa9-48c9-99fb-e8335c611241 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:23.375261 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 549/1100] 10.222.0.15 () {56 vars in 1133 bytes} [Tue May 31 14:31:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:31:23.380733 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7adcb02-29fc-4682-9574-9054577ea50c None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:23.478767 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7adcb02-29fc-4682-9574-9054577ea50c None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:23.487688 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:23.513753 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b8f437-73c2-4e10-b0c5-8e86c4d21540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:23.514742 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b8f437-73c2-4e10-b0c5-8e86c4d21540 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:23.515221 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b8f437-73c2-4e10-b0c5-8e86c4d21540 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:23.516241 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b8f437-73c2-4e10-b0c5-8e86c4d21540 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:23.585171 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b8f437-73c2-4e10-b0c5-8e86c4d21540 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:23.586576 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b8f437-73c2-4e10-b0c5-8e86c4d21540 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:23.680406 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 552/1101] 10.222.0.15 () {58 vars in 1282 bytes} [Tue May 31 14:31:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 31 14:31:23.686283 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c5c40f-afa9-48c9-99fb-e8335c611241 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:23.695374 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:23.787380 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c5c40f-afa9-48c9-99fb-e8335c611241 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:23.819791 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1085c610-08f7-46ac-a096-f37e1a35ee6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:23.820579 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1085c610-08f7-46ac-a096-f37e1a35ee6d None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:23.820861 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1085c610-08f7-46ac-a096-f37e1a35ee6d None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:23.821134 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1085c610-08f7-46ac-a096-f37e1a35ee6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:23.831255 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1085c610-08f7-46ac-a096-f37e1a35ee6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:23.832683 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1085c610-08f7-46ac-a096-f37e1a35ee6d None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:23.849581 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-1085c610-08f7-46ac-a096-f37e1a35ee6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:31:23.849581 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:31:23.849581 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:31:23.849581 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:31:23.849581 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:31:23.849581 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:31:23.849581 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:31:23.849581 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:31:23.849581 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:31:23.849581 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:31:23.849581 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:31:23.849581 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:31:23.849581 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 14:31:23.849581 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 14:31:23.849581 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 14:31:23.850637 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 14:31:23.850637 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:31:23.850637 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:31:23.850637 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:31:23.850637 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:31:23.850637 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:31:23.850637 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:31:23.850637 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:31:23.850637 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:31:23.850637 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:31:23.850637 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:31:23.850637 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:31:23.850637 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:31:23.850637 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:31:23.850637 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:31:23.850637 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:31:23.850637 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:31:23.851554 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 14:31:23.851554 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 14:31:23.851554 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:31:23.851554 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:31:23.851554 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 550/1102] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:31:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 14:31:23.856312 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b8f437-73c2-4e10-b0c5-8e86c4d21540 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:23.866171 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:23.951047 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b8f437-73c2-4e10-b0c5-8e86c4d21540 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:23.983429 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91facccf-2bfe-4444-921a-ec1d3abc7a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:23.984111 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91facccf-2bfe-4444-921a-ec1d3abc7a09 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:23.984947 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91facccf-2bfe-4444-921a-ec1d3abc7a09 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:23.985320 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91facccf-2bfe-4444-921a-ec1d3abc7a09 None admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:23.986631 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91facccf-2bfe-4444-921a-ec1d3abc7a09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:31:23.987123 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91facccf-2bfe-4444-921a-ec1d3abc7a09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:23.988955 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91facccf-2bfe-4444-921a-ec1d3abc7a09 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:24.002478 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 553/1103] 10.222.0.15 () {56 vars in 1109 bytes} [Tue May 31 14:31:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:31:24.008392 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1085c610-08f7-46ac-a096-f37e1a35ee6d None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:24.066179 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:24.106680 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1085c610-08f7-46ac-a096-f37e1a35ee6d None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:24.140089 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed3bb82-10ac-4040-95da-43844d3796d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:24.140876 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed3bb82-10ac-4040-95da-43844d3796d3 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:24.141155 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed3bb82-10ac-4040-95da-43844d3796d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:24.141428 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed3bb82-10ac-4040-95da-43844d3796d3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:24.147848 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed3bb82-10ac-4040-95da-43844d3796d3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:24.149377 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed3bb82-10ac-4040-95da-43844d3796d3 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:24.162916 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-eed3bb82-10ac-4040-95da-43844d3796d3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 14:31:24.162916 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:31:24.162916 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:31:24.162916 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:31:24.162916 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:31:24.162916 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:31:24.162916 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:31:24.162916 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:31:24.162916 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:31:24.162916 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:31:24.162916 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:31:24.162916 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:31:24.162916 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 14:31:24.162916 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 14:31:24.162916 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 14:31:24.163944 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 14:31:24.163944 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:31:24.163944 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:31:24.163944 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:31:24.163944 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:31:24.163944 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:31:24.163944 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:31:24.163944 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:31:24.163944 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:31:24.163944 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:31:24.163944 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:31:24.163944 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:31:24.163944 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:31:24.163944 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:31:24.163944 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:31:24.163944 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:31:24.163944 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:31:24.165058 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 14:31:24.165058 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 14:31:24.165058 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 14:31:24.165058 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 14:31:24.165058 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 14:31:24.165058 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 14:31:24.165058 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 14:31:24.165058 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:31:24.166707 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 551/1104] 10.222.0.15 () {56 vars in 1111 bytes} [Tue May 31 14:31:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 31 14:31:24.169715 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91facccf-2bfe-4444-921a-ec1d3abc7a09 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:24.234150 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:24.267792 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91facccf-2bfe-4444-921a-ec1d3abc7a09 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:24.304750 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65be57f-e2b9-4192-a52c-d63a1b987e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:24.305406 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65be57f-e2b9-4192-a52c-d63a1b987e8e None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:24.305688 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65be57f-e2b9-4192-a52c-d63a1b987e8e None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:24.305963 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65be57f-e2b9-4192-a52c-d63a1b987e8e None admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:24.306765 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65be57f-e2b9-4192-a52c-d63a1b987e8e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:31:24.307072 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65be57f-e2b9-4192-a52c-d63a1b987e8e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:24.308491 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65be57f-e2b9-4192-a52c-d63a1b987e8e None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:24.320838 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 554/1105] 10.222.0.15 () {56 vars in 1148 bytes} [Tue May 31 14:31:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:31:24.326733 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed3bb82-10ac-4040-95da-43844d3796d3 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:24.455296 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed3bb82-10ac-4040-95da-43844d3796d3 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:24.471842 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:24.490092 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae8c43d-caef-40e7-8b2a-293abf6aa667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:24.490785 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8c43d-caef-40e7-8b2a-293abf6aa667 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:24.491066 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8c43d-caef-40e7-8b2a-293abf6aa667 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:24.491361 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8c43d-caef-40e7-8b2a-293abf6aa667 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:24.492191 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae8c43d-caef-40e7-8b2a-293abf6aa667 None admin] RBAC: Adding query filter params (role.id=c71617921821419bba278e390d70ac77, scope.project.id=ffff4334538649fdba1beb80cad207fa, user.id=b57768d448e345ad8879bf29f21b48ea) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:31:24.492501 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae8c43d-caef-40e7-8b2a-293abf6aa667 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:24.493930 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae8c43d-caef-40e7-8b2a-293abf6aa667 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:24.499988 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 552/1106] 10.222.0.15 () {56 vars in 1374 bytes} [Tue May 31 14:31:24 2022] GET /identity/v3/role_assignments?user.id=b57768d448e345ad8879bf29f21b48ea&scope.project.id=ffff4334538649fdba1beb80cad207fa&role.id=c71617921821419bba278e390d70ac77 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 14:31:24.684892 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd236e-bb93-47ea-a03a-002ed516adf9 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:24.685409 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd236e-bb93-47ea-a03a-002ed516adf9 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:24.685528 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd236e-bb93-47ea-a03a-002ed516adf9 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:24.686812 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 555/1107] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:31:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:31:24.692291 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2c444d-95c8-4d53-be3e-368f263bd69f None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:24.692581 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2c444d-95c8-4d53-be3e-368f263bd69f None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:24.692859 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2c444d-95c8-4d53-be3e-368f263bd69f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:24.710156 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-ae2c444d-95c8-4d53-be3e-368f263bd69f None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:31:24.711292 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-ae2c444d-95c8-4d53-be3e-368f263bd69f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:31:24.776636 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 553/1108] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:31:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 14:31:24.801522 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd236e-bb93-47ea-a03a-002ed516adf9 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:24.904571 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd236e-bb93-47ea-a03a-002ed516adf9 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:24.931787 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:24.939391 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6442a65d-23a6-4327-8084-4d1055e4a2aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:24.940176 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6442a65d-23a6-4327-8084-4d1055e4a2aa None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:24.940456 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6442a65d-23a6-4327-8084-4d1055e4a2aa None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:24.940733 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6442a65d-23a6-4327-8084-4d1055e4a2aa None admin] PATH_INFO: `/v3/domains/default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:24.941995 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6442a65d-23a6-4327-8084-4d1055e4a2aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:24.943490 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6442a65d-23a6-4327-8084-4d1055e4a2aa None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:24.945215 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 556/1109] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:31:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:31:24.951300 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2c444d-95c8-4d53-be3e-368f263bd69f None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:25.050408 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2c444d-95c8-4d53-be3e-368f263bd69f None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:25.063525 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:25.085221 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3c12ae-8293-418a-8bc0-2b53b2927094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:25.085907 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3c12ae-8293-418a-8bc0-2b53b2927094 None admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:25.086216 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3c12ae-8293-418a-8bc0-2b53b2927094 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:25.086499 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3c12ae-8293-418a-8bc0-2b53b2927094 None admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:25.087361 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3c12ae-8293-418a-8bc0-2b53b2927094 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:25.088734 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3c12ae-8293-418a-8bc0-2b53b2927094 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:25.175807 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 554/1110] 10.222.0.15 () {60 vars in 1132 bytes} [Tue May 31 14:31:24 2022] POST /identity/v3/users => generated 286 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:31:27.480830 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6597e88b-1c6f-4321-986e-5eddbd0ade90 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:27.481379 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6597e88b-1c6f-4321-986e-5eddbd0ade90 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:27.481379 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6597e88b-1c6f-4321-986e-5eddbd0ade90 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:27.482766 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 557/1111] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:31:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:31:27.488799 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3940b8-922b-40ef-b8d9-612dd9bc9ff1 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:27.489206 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3940b8-922b-40ef-b8d9-612dd9bc9ff1 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:27.489368 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3940b8-922b-40ef-b8d9-612dd9bc9ff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:27.505979 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-0d3940b8-922b-40ef-b8d9-612dd9bc9ff1 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:31:27.507208 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-0d3940b8-922b-40ef-b8d9-612dd9bc9ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:31:27.571508 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 555/1112] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:31:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 14:31:27.595768 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6597e88b-1c6f-4321-986e-5eddbd0ade90 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:27.693038 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6597e88b-1c6f-4321-986e-5eddbd0ade90 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:27.726302 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b5706e-3d4c-4ac1-a7a4-a5594b830a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:27.727780 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b5706e-3d4c-4ac1-a7a4-a5594b830a73 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:27.728299 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b5706e-3d4c-4ac1-a7a4-a5594b830a73 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:27.728820 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b5706e-3d4c-4ac1-a7a4-a5594b830a73 None admin] PATH_INFO: `/v3/roles/86e29729720b4d53b2a375a337765a2d` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:27.731587 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b5706e-3d4c-4ac1-a7a4-a5594b830a73 None admin] RBAC: Authorizing `identity:get_role(role_id=86e29729720b4d53b2a375a337765a2d)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:27.733000 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b5706e-3d4c-4ac1-a7a4-a5594b830a73 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:27.735220 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 558/1113] 10.222.0.15 () {56 vars in 1177 bytes} [Tue May 31 14:31:27 2022] GET /identity/v3/roles/86e29729720b4d53b2a375a337765a2d => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:31:27.741227 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3940b8-922b-40ef-b8d9-612dd9bc9ff1 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:27.839918 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:27.844255 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3940b8-922b-40ef-b8d9-612dd9bc9ff1 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:27.876740 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fca8e8-094d-4831-b37f-cf6e6f9f0ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:27.877610 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fca8e8-094d-4831-b37f-cf6e6f9f0ff8 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:27.877911 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fca8e8-094d-4831-b37f-cf6e6f9f0ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:27.878200 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fca8e8-094d-4831-b37f-cf6e6f9f0ff8 None admin] PATH_INFO: `/v3/users/c03c0bf01bad45ebbda595e848901b85` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:27.891757 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fca8e8-094d-4831-b37f-cf6e6f9f0ff8 None admin] RBAC: Authorizing `identity:get_user(user_id=c03c0bf01bad45ebbda595e848901b85)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:27.893202 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fca8e8-094d-4831-b37f-cf6e6f9f0ff8 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:27.894967 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 556/1114] 10.222.0.15 () {56 vars in 1177 bytes} [Tue May 31 14:31:27 2022] GET /identity/v3/users/c03c0bf01bad45ebbda595e848901b85 => generated 286 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:31:27.900715 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b5706e-3d4c-4ac1-a7a4-a5594b830a73 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:27.960404 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:27.995918 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b5706e-3d4c-4ac1-a7a4-a5594b830a73 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:28.027469 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e098a2-64c3-460b-912d-c48c94892d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:28.028098 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e098a2-64c3-460b-912d-c48c94892d02 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:28.028376 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e098a2-64c3-460b-912d-c48c94892d02 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:28.028650 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e098a2-64c3-460b-912d-c48c94892d02 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:28.098870 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e098a2-64c3-460b-912d-c48c94892d02 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:28.100246 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e098a2-64c3-460b-912d-c48c94892d02 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:28.157089 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:28.193186 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 559/1115] 10.222.0.15 () {58 vars in 1282 bytes} [Tue May 31 14:31:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 31 14:31:28.199111 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fca8e8-094d-4831-b37f-cf6e6f9f0ff8 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:28.293837 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fca8e8-094d-4831-b37f-cf6e6f9f0ff8 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:28.327042 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aca822-9a9b-4254-ae0e-8e410fdf2f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:28.328618 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aca822-9a9b-4254-ae0e-8e410fdf2f00 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:28.328909 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aca822-9a9b-4254-ae0e-8e410fdf2f00 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:28.329227 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aca822-9a9b-4254-ae0e-8e410fdf2f00 None admin] PATH_INFO: `/v3/projects/d58a91e5d27b4171bad2aecfefada8cb` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:28.330402 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aca822-9a9b-4254-ae0e-8e410fdf2f00 None admin] RBAC: Authorizing `identity:get_project(project_id=d58a91e5d27b4171bad2aecfefada8cb)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:28.331893 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aca822-9a9b-4254-ae0e-8e410fdf2f00 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:28.333554 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 557/1116] 10.222.0.15 () {56 vars in 1186 bytes} [Tue May 31 14:31:28 2022] GET /identity/v3/projects/d58a91e5d27b4171bad2aecfefada8cb => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:31:28.339695 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e098a2-64c3-460b-912d-c48c94892d02 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:28.433680 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e098a2-64c3-460b-912d-c48c94892d02 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:28.466275 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a0fa66-768b-4044-972d-e2a63c7031a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:28.466944 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a0fa66-768b-4044-972d-e2a63c7031a6 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:28.467231 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a0fa66-768b-4044-972d-e2a63c7031a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:28.467510 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a0fa66-768b-4044-972d-e2a63c7031a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:28.468325 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a0fa66-768b-4044-972d-e2a63c7031a6 None admin] RBAC: Adding query filter params (role.id=86e29729720b4d53b2a375a337765a2d, scope.project.id=d58a91e5d27b4171bad2aecfefada8cb, user.id=c03c0bf01bad45ebbda595e848901b85) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:31:28.468636 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a0fa66-768b-4044-972d-e2a63c7031a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:28.470045 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a0fa66-768b-4044-972d-e2a63c7031a6 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:28.475321 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 560/1117] 10.222.0.15 () {56 vars in 1374 bytes} [Tue May 31 14:31:28 2022] GET /identity/v3/role_assignments?user.id=c03c0bf01bad45ebbda595e848901b85&scope.project.id=d58a91e5d27b4171bad2aecfefada8cb&role.id=86e29729720b4d53b2a375a337765a2d => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:31:30.658504 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ade2145-d91e-448b-b4ae-63d6952f7aaf None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:30.659066 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ade2145-d91e-448b-b4ae-63d6952f7aaf None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:30.659066 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ade2145-d91e-448b-b4ae-63d6952f7aaf None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:30.660354 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 558/1118] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:31:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:31:30.665443 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57d98d1-4261-4f54-8dac-a6c49d0fddb3 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:30.665827 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57d98d1-4261-4f54-8dac-a6c49d0fddb3 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:30.666003 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57d98d1-4261-4f54-8dac-a6c49d0fddb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:30.682910 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-a57d98d1-4261-4f54-8dac-a6c49d0fddb3 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:31:30.684081 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-a57d98d1-4261-4f54-8dac-a6c49d0fddb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:31:30.705649 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:30.748028 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 561/1119] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:31:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 14:31:30.771387 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ade2145-d91e-448b-b4ae-63d6952f7aaf None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:30.797601 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:30.877154 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ade2145-d91e-448b-b4ae-63d6952f7aaf None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:30.909755 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718cc341-9409-4aa8-abf8-b70adccb64c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:30.910544 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718cc341-9409-4aa8-abf8-b70adccb64c2 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:30.910857 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718cc341-9409-4aa8-abf8-b70adccb64c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:30.911131 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718cc341-9409-4aa8-abf8-b70adccb64c2 None admin] PATH_INFO: `/v3/roles/86e29729720b4d53b2a375a337765a2d` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:30.912570 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718cc341-9409-4aa8-abf8-b70adccb64c2 None admin] RBAC: Authorizing `identity:get_role(role_id=86e29729720b4d53b2a375a337765a2d)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:30.913923 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718cc341-9409-4aa8-abf8-b70adccb64c2 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:30.915297 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 559/1120] 10.222.0.15 () {56 vars in 1177 bytes} [Tue May 31 14:31:30 2022] GET /identity/v3/roles/86e29729720b4d53b2a375a337765a2d => generated 223 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:31:30.921101 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57d98d1-4261-4f54-8dac-a6c49d0fddb3 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:31.015672 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57d98d1-4261-4f54-8dac-a6c49d0fddb3 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:31.048430 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5275c4c0-f2d4-4cba-bf96-8ac841d32c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:31.049275 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5275c4c0-f2d4-4cba-bf96-8ac841d32c9a None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:31.049557 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5275c4c0-f2d4-4cba-bf96-8ac841d32c9a None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:31.049832 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5275c4c0-f2d4-4cba-bf96-8ac841d32c9a None admin] PATH_INFO: `/v3/users/c03c0bf01bad45ebbda595e848901b85` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:31.051014 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5275c4c0-f2d4-4cba-bf96-8ac841d32c9a None admin] RBAC: Authorizing `identity:get_user(user_id=c03c0bf01bad45ebbda595e848901b85)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:31.052426 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5275c4c0-f2d4-4cba-bf96-8ac841d32c9a None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:31.054002 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 562/1121] 10.222.0.15 () {56 vars in 1177 bytes} [Tue May 31 14:31:30 2022] GET /identity/v3/users/c03c0bf01bad45ebbda595e848901b85 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:31:31.059609 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718cc341-9409-4aa8-abf8-b70adccb64c2 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:31.145987 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:31.154110 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718cc341-9409-4aa8-abf8-b70adccb64c2 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:31.185972 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e98328-1bc5-40ee-aff9-125455bfd2db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:31.187441 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e98328-1bc5-40ee-aff9-125455bfd2db None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:31.188067 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e98328-1bc5-40ee-aff9-125455bfd2db None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:31.188340 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e98328-1bc5-40ee-aff9-125455bfd2db None admin] PATH_INFO: `/v3/projects/d58a91e5d27b4171bad2aecfefada8cb` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:31.189596 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e98328-1bc5-40ee-aff9-125455bfd2db None admin] RBAC: Authorizing `identity:get_project(project_id=d58a91e5d27b4171bad2aecfefada8cb)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:31.191062 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e98328-1bc5-40ee-aff9-125455bfd2db None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:31.192757 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 560/1122] 10.222.0.15 () {56 vars in 1186 bytes} [Tue May 31 14:31:31 2022] GET /identity/v3/projects/d58a91e5d27b4171bad2aecfefada8cb => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:31:31.198624 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5275c4c0-f2d4-4cba-bf96-8ac841d32c9a None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:31.225337 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:31.299740 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5275c4c0-f2d4-4cba-bf96-8ac841d32c9a None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:31.333664 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c248aa34-bebd-4032-8568-a79c0b3216b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:31.334530 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c248aa34-bebd-4032-8568-a79c0b3216b4 None admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:31.334839 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c248aa34-bebd-4032-8568-a79c0b3216b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:31.335111 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c248aa34-bebd-4032-8568-a79c0b3216b4 None admin] PATH_INFO: `/v3/projects/d58a91e5d27b4171bad2aecfefada8cb/users/c03c0bf01bad45ebbda595e848901b85/roles/86e29729720b4d53b2a375a337765a2d` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:31.337255 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c248aa34-bebd-4032-8568-a79c0b3216b4 None admin] RBAC: Authorizing `identity:create_grant(project_id=d58a91e5d27b4171bad2aecfefada8cb, user_id=c03c0bf01bad45ebbda595e848901b85, role_id=86e29729720b4d53b2a375a337765a2d)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:31.338711 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c248aa34-bebd-4032-8568-a79c0b3216b4 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:31.414256 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 563/1123] 10.222.0.15 () {58 vars in 1439 bytes} [Tue May 31 14:31:31 2022] PUT /identity/v3/projects/d58a91e5d27b4171bad2aecfefada8cb/users/c03c0bf01bad45ebbda595e848901b85/roles/86e29729720b4d53b2a375a337765a2d => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:31:33.607996 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc290140-3f53-49fc-8f8b-898e3ed44ca4 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:33.608490 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc290140-3f53-49fc-8f8b-898e3ed44ca4 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:33.608490 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc290140-3f53-49fc-8f8b-898e3ed44ca4 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:33.610432 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 561/1124] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:31:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:31:33.615664 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36cdc31-7436-4912-8027-33630fba8023 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:33.616105 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36cdc31-7436-4912-8027-33630fba8023 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:33.616200 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36cdc31-7436-4912-8027-33630fba8023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:33.632453 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-b36cdc31-7436-4912-8027-33630fba8023 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:31:33.633615 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-b36cdc31-7436-4912-8027-33630fba8023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:31:33.696669 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 564/1125] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:31:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 14:31:33.721037 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc290140-3f53-49fc-8f8b-898e3ed44ca4 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:33.818440 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc290140-3f53-49fc-8f8b-898e3ed44ca4 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:33.851535 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56888191-3825-4a42-9dcd-123fe7faa7f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:33.852378 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56888191-3825-4a42-9dcd-123fe7faa7f7 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:33.852665 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56888191-3825-4a42-9dcd-123fe7faa7f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:33.852943 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56888191-3825-4a42-9dcd-123fe7faa7f7 None admin] PATH_INFO: `/v3/roles/86e29729720b4d53b2a375a337765a2d` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:33.854400 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56888191-3825-4a42-9dcd-123fe7faa7f7 None admin] RBAC: Authorizing `identity:get_role(role_id=86e29729720b4d53b2a375a337765a2d)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:33.855896 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56888191-3825-4a42-9dcd-123fe7faa7f7 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:33.857238 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 562/1126] 10.222.0.15 () {56 vars in 1177 bytes} [Tue May 31 14:31:33 2022] GET /identity/v3/roles/86e29729720b4d53b2a375a337765a2d => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:31:33.862857 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36cdc31-7436-4912-8027-33630fba8023 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:33.879276 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:33.962267 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36cdc31-7436-4912-8027-33630fba8023 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:33.994957 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8248e2c-97de-40ca-9666-4a17cff5cb8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:33.995822 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8248e2c-97de-40ca-9666-4a17cff5cb8c None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:33.996103 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8248e2c-97de-40ca-9666-4a17cff5cb8c None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:33.996377 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8248e2c-97de-40ca-9666-4a17cff5cb8c None admin] PATH_INFO: `/v3/users/c03c0bf01bad45ebbda595e848901b85` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:33.997554 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8248e2c-97de-40ca-9666-4a17cff5cb8c None admin] RBAC: Authorizing `identity:get_user(user_id=c03c0bf01bad45ebbda595e848901b85)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:33.999058 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8248e2c-97de-40ca-9666-4a17cff5cb8c None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:34.000704 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 565/1127] 10.222.0.15 () {56 vars in 1177 bytes} [Tue May 31 14:31:33 2022] GET /identity/v3/users/c03c0bf01bad45ebbda595e848901b85 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:31:34.006317 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56888191-3825-4a42-9dcd-123fe7faa7f7 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:34.034518 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:34.105508 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56888191-3825-4a42-9dcd-123fe7faa7f7 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:34.138249 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf5dcc4-027b-4ae3-951a-8bb25da08262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:34.138861 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf5dcc4-027b-4ae3-951a-8bb25da08262 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:34.139147 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf5dcc4-027b-4ae3-951a-8bb25da08262 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:34.139425 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf5dcc4-027b-4ae3-951a-8bb25da08262 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:34.204068 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf5dcc4-027b-4ae3-951a-8bb25da08262 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:34.205533 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf5dcc4-027b-4ae3-951a-8bb25da08262 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:34.231331 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:34.299938 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 563/1128] 10.222.0.15 () {58 vars in 1282 bytes} [Tue May 31 14:31:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 31 14:31:34.305705 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8248e2c-97de-40ca-9666-4a17cff5cb8c None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:34.386009 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:34.401551 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8248e2c-97de-40ca-9666-4a17cff5cb8c None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:34.433641 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8eeef6-7886-4846-a347-6a6a8f0d5319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:34.434479 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8eeef6-7886-4846-a347-6a6a8f0d5319 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:34.434788 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8eeef6-7886-4846-a347-6a6a8f0d5319 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:34.435062 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8eeef6-7886-4846-a347-6a6a8f0d5319 None admin] PATH_INFO: `/v3/projects/d58a91e5d27b4171bad2aecfefada8cb` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:34.436222 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8eeef6-7886-4846-a347-6a6a8f0d5319 None admin] RBAC: Authorizing `identity:get_project(project_id=d58a91e5d27b4171bad2aecfefada8cb)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:34.438222 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8eeef6-7886-4846-a347-6a6a8f0d5319 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:34.439964 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 566/1129] 10.222.0.15 () {56 vars in 1186 bytes} [Tue May 31 14:31:34 2022] GET /identity/v3/projects/d58a91e5d27b4171bad2aecfefada8cb => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:31:34.446001 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf5dcc4-027b-4ae3-951a-8bb25da08262 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:34.541377 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf5dcc4-027b-4ae3-951a-8bb25da08262 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:34.567062 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:34.574372 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7698ee-9991-4171-8b3a-ce59aea5c0b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:34.575050 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7698ee-9991-4171-8b3a-ce59aea5c0b5 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:34.575333 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7698ee-9991-4171-8b3a-ce59aea5c0b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:34.575608 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7698ee-9991-4171-8b3a-ce59aea5c0b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:34.576429 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7698ee-9991-4171-8b3a-ce59aea5c0b5 None admin] RBAC: Adding query filter params (role.id=86e29729720b4d53b2a375a337765a2d, scope.project.id=d58a91e5d27b4171bad2aecfefada8cb, user.id=c03c0bf01bad45ebbda595e848901b85) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:31:34.576739 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7698ee-9991-4171-8b3a-ce59aea5c0b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:34.578168 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7698ee-9991-4171-8b3a-ce59aea5c0b5 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:34.583792 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 564/1130] 10.222.0.15 () {56 vars in 1374 bytes} [Tue May 31 14:31:34 2022] GET /identity/v3/role_assignments?user.id=c03c0bf01bad45ebbda595e848901b85&scope.project.id=d58a91e5d27b4171bad2aecfefada8cb&role.id=86e29729720b4d53b2a375a337765a2d => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:31:36.809790 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4457104-f9bb-487b-93ec-cf3e42e0a382 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:36.810345 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4457104-f9bb-487b-93ec-cf3e42e0a382 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:36.810345 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4457104-f9bb-487b-93ec-cf3e42e0a382 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:36.811765 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 567/1131] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:31:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:31:36.817020 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b284d16-ce96-4a7d-b0b4-8565a4326b21 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:36.817420 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b284d16-ce96-4a7d-b0b4-8565a4326b21 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:36.817587 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b284d16-ce96-4a7d-b0b4-8565a4326b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:36.834351 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-6b284d16-ce96-4a7d-b0b4-8565a4326b21 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:31:36.835553 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-6b284d16-ce96-4a7d-b0b4-8565a4326b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:31:36.897979 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 565/1132] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:31:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 14:31:36.922665 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4457104-f9bb-487b-93ec-cf3e42e0a382 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:37.020479 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4457104-f9bb-487b-93ec-cf3e42e0a382 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:37.053301 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64b31e0-53ef-4e6f-a75f-59666dde1e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:37.054083 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64b31e0-53ef-4e6f-a75f-59666dde1e57 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:37.054363 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64b31e0-53ef-4e6f-a75f-59666dde1e57 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:37.054671 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64b31e0-53ef-4e6f-a75f-59666dde1e57 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:37.055849 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64b31e0-53ef-4e6f-a75f-59666dde1e57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:37.057272 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64b31e0-53ef-4e6f-a75f-59666dde1e57 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:37.058957 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 568/1133] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:31:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:31:37.064663 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b284d16-ce96-4a7d-b0b4-8565a4326b21 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:37.160026 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b284d16-ce96-4a7d-b0b4-8565a4326b21 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:37.181183 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:37.192795 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc17583-81c2-4632-a3c5-684cfaa9fdb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:37.198584 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc17583-81c2-4632-a3c5-684cfaa9fdb5 None admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:37.198584 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc17583-81c2-4632-a3c5-684cfaa9fdb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:37.198584 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc17583-81c2-4632-a3c5-684cfaa9fdb5 None admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:37.198584 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc17583-81c2-4632-a3c5-684cfaa9fdb5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:37.198584 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc17583-81c2-4632-a3c5-684cfaa9fdb5 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:37.277998 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 566/1134] 10.222.0.15 () {60 vars in 1141 bytes} [Tue May 31 14:31:37 2022] POST /identity/v3/projects => generated 311 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:31:39.527978 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dd6647-f549-4a17-b08c-a4d836ff163f None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:39.528502 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dd6647-f549-4a17-b08c-a4d836ff163f None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:39.528619 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dd6647-f549-4a17-b08c-a4d836ff163f None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:39.530151 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 569/1135] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:31:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:31:39.535391 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11d1529-66bc-480c-bfcf-415a4bd96b28 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:39.535797 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11d1529-66bc-480c-bfcf-415a4bd96b28 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:39.535958 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11d1529-66bc-480c-bfcf-415a4bd96b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:39.552242 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-b11d1529-66bc-480c-bfcf-415a4bd96b28 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:31:39.553356 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-b11d1529-66bc-480c-bfcf-415a4bd96b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:31:39.616725 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 567/1136] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:31:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 14:31:39.641735 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dd6647-f549-4a17-b08c-a4d836ff163f None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:39.662601 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:39.740065 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dd6647-f549-4a17-b08c-a4d836ff163f None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:39.772326 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909486aa-0f53-41b1-97f5-7fd3ff278218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:39.773105 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909486aa-0f53-41b1-97f5-7fd3ff278218 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:39.773390 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909486aa-0f53-41b1-97f5-7fd3ff278218 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:39.773668 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909486aa-0f53-41b1-97f5-7fd3ff278218 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:39.774861 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909486aa-0f53-41b1-97f5-7fd3ff278218 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:39.776315 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909486aa-0f53-41b1-97f5-7fd3ff278218 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:39.777903 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 570/1137] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:31:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:31:39.784015 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11d1529-66bc-480c-bfcf-415a4bd96b28 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:39.877061 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11d1529-66bc-480c-bfcf-415a4bd96b28 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:39.879218 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:39.909759 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c5bf09-206c-43e7-89ed-8d6cf70d6ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:39.910419 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c5bf09-206c-43e7-89ed-8d6cf70d6ceb None admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:39.910741 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c5bf09-206c-43e7-89ed-8d6cf70d6ceb None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:39.911019 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c5bf09-206c-43e7-89ed-8d6cf70d6ceb None admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:39.911718 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c5bf09-206c-43e7-89ed-8d6cf70d6ceb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:39.913154 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c5bf09-206c-43e7-89ed-8d6cf70d6ceb None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:39.998612 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 568/1138] 10.222.0.15 () {60 vars in 1132 bytes} [Tue May 31 14:31:39 2022] POST /identity/v3/users => generated 286 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:31:42.242633 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a59e008-0fab-4c17-a947-af6d72f0f3cc None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:42.243174 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a59e008-0fab-4c17-a947-af6d72f0f3cc None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:42.243174 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a59e008-0fab-4c17-a947-af6d72f0f3cc None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:42.244532 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 571/1139] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:31:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:31:42.250312 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70593601-0ae3-4bfe-8400-18a3eb77fa11 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:42.250771 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70593601-0ae3-4bfe-8400-18a3eb77fa11 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:42.250903 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70593601-0ae3-4bfe-8400-18a3eb77fa11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:42.267790 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-70593601-0ae3-4bfe-8400-18a3eb77fa11 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:31:42.268966 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-70593601-0ae3-4bfe-8400-18a3eb77fa11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:31:42.333831 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 569/1140] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:31:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 14:31:42.356917 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a59e008-0fab-4c17-a947-af6d72f0f3cc None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:42.443917 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:42.456338 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a59e008-0fab-4c17-a947-af6d72f0f3cc None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:42.491367 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7261aa23-e34f-4652-b810-0789e89b74b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:42.492148 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7261aa23-e34f-4652-b810-0789e89b74b6 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:42.492433 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7261aa23-e34f-4652-b810-0789e89b74b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:42.492761 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7261aa23-e34f-4652-b810-0789e89b74b6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:42.502579 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7261aa23-e34f-4652-b810-0789e89b74b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 14:31:42.510112 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-7261aa23-e34f-4652-b810-0789e89b74b6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 31 14:31:42.510112 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:31:42.510112 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:31:42.510112 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:31:42.510112 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:31:42.510112 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:31:42.510112 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:31:42.510112 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:31:42.510112 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:31:42.510112 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:31:42.510112 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:31:42.510112 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:31:42.510112 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 14:31:42.510112 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 14:31:42.510112 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 14:31:42.510112 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 14:31:42.511218 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 14:31:42.511218 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 14:31:42.511218 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 14:31:42.511218 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 14:31:42.511218 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:31:42.511218 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:31:42.511218 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:31:42.511218 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:31:42.511218 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:31:42.511218 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:31:42.511218 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:31:42.511218 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:31:42.511218 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:31:42.511218 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:31:42.511218 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:31:42.511218 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:31:42.512110 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:31:42.512110 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:31:42.512110 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:31:42.512110 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:31:42.512110 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 14:31:42.512110 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 14:31:42.512110 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 14:31:42.512110 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 14:31:42.512110 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 14:31:42.512110 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 14:31:42.512110 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 31 14:31:42.512110 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:31:42.512110 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 572/1141] 10.222.0.15 () {56 vars in 1096 bytes} [Tue May 31 14:31:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:31:42.517341 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70593601-0ae3-4bfe-8400-18a3eb77fa11 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:42.601388 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:42.611256 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70593601-0ae3-4bfe-8400-18a3eb77fa11 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:42.643378 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3568c9d1-680a-4251-8de1-60abab872c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:42.644075 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3568c9d1-680a-4251-8de1-60abab872c0f None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:42.644356 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3568c9d1-680a-4251-8de1-60abab872c0f None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:42.644632 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3568c9d1-680a-4251-8de1-60abab872c0f None admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:42.645366 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3568c9d1-680a-4251-8de1-60abab872c0f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:31:42.645668 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3568c9d1-680a-4251-8de1-60abab872c0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:42.647062 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3568c9d1-680a-4251-8de1-60abab872c0f None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:42.655656 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 570/1142] 10.222.0.15 () {56 vars in 1099 bytes} [Tue May 31 14:31:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:31:42.661249 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7261aa23-e34f-4652-b810-0789e89b74b6 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:42.756213 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7261aa23-e34f-4652-b810-0789e89b74b6 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:42.788809 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac512d37-4fed-4656-836c-d3098bbba50e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:42.789686 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac512d37-4fed-4656-836c-d3098bbba50e None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:42.789966 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac512d37-4fed-4656-836c-d3098bbba50e None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:42.790237 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac512d37-4fed-4656-836c-d3098bbba50e None admin] PATH_INFO: `/v3/users/5f036b4ff1e1487795e32d8181ce3288` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:42.802746 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac512d37-4fed-4656-836c-d3098bbba50e None admin] RBAC: Authorizing `identity:get_user(user_id=5f036b4ff1e1487795e32d8181ce3288)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:42.804208 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac512d37-4fed-4656-836c-d3098bbba50e None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:42.805809 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 573/1143] 10.222.0.15 () {56 vars in 1177 bytes} [Tue May 31 14:31:42 2022] GET /identity/v3/users/5f036b4ff1e1487795e32d8181ce3288 => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:31:42.811596 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3568c9d1-680a-4251-8de1-60abab872c0f None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:42.913425 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3568c9d1-680a-4251-8de1-60abab872c0f None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:42.944542 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a85139a-948d-4378-b88a-c8bfb51686a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:42.945173 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a85139a-948d-4378-b88a-c8bfb51686a0 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:42.945456 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a85139a-948d-4378-b88a-c8bfb51686a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:42.945733 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a85139a-948d-4378-b88a-c8bfb51686a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:42.967084 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:43.011075 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a85139a-948d-4378-b88a-c8bfb51686a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:43.012444 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a85139a-948d-4378-b88a-c8bfb51686a0 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:43.106773 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 571/1144] 10.222.0.15 () {58 vars in 1282 bytes} [Tue May 31 14:31:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 31 14:31:43.112609 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac512d37-4fed-4656-836c-d3098bbba50e None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:43.121171 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:43.211987 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac512d37-4fed-4656-836c-d3098bbba50e None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:43.243694 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85de831-e411-434d-98a3-de11d01d51b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:43.244552 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85de831-e411-434d-98a3-de11d01d51b6 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:43.244835 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85de831-e411-434d-98a3-de11d01d51b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:43.245111 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85de831-e411-434d-98a3-de11d01d51b6 None admin] PATH_INFO: `/v3/projects/46cf0c1e5731407cbffbba5373c2f3ad` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:43.246283 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85de831-e411-434d-98a3-de11d01d51b6 None admin] RBAC: Authorizing `identity:get_project(project_id=46cf0c1e5731407cbffbba5373c2f3ad)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:43.247740 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85de831-e411-434d-98a3-de11d01d51b6 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:43.249975 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 574/1145] 10.222.0.15 () {56 vars in 1186 bytes} [Tue May 31 14:31:43 2022] GET /identity/v3/projects/46cf0c1e5731407cbffbba5373c2f3ad => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:31:43.256182 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a85139a-948d-4378-b88a-c8bfb51686a0 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:43.307026 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:43.352364 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a85139a-948d-4378-b88a-c8bfb51686a0 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:43.384726 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24248073-2a1e-4a8a-b486-1d06828c2439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:43.385457 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24248073-2a1e-4a8a-b486-1d06828c2439 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:43.385753 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24248073-2a1e-4a8a-b486-1d06828c2439 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:43.386037 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24248073-2a1e-4a8a-b486-1d06828c2439 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:43.386901 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24248073-2a1e-4a8a-b486-1d06828c2439 None admin] RBAC: Adding query filter params (role.id=76c53e2c353644f885028a0226c06146, scope.project.id=46cf0c1e5731407cbffbba5373c2f3ad, user.id=5f036b4ff1e1487795e32d8181ce3288) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:31:43.387219 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24248073-2a1e-4a8a-b486-1d06828c2439 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:43.388666 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24248073-2a1e-4a8a-b486-1d06828c2439 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:43.394535 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 572/1146] 10.222.0.15 () {56 vars in 1374 bytes} [Tue May 31 14:31:43 2022] GET /identity/v3/role_assignments?user.id=5f036b4ff1e1487795e32d8181ce3288&scope.project.id=46cf0c1e5731407cbffbba5373c2f3ad&role.id=76c53e2c353644f885028a0226c06146 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:31:45.578045 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2b7b1e-3bc7-4ea2-85fc-e1b75ddb250b None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:45.578581 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2b7b1e-3bc7-4ea2-85fc-e1b75ddb250b None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:45.578581 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2b7b1e-3bc7-4ea2-85fc-e1b75ddb250b None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:45.579879 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 575/1147] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:31:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:31:45.584998 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603606d6-3922-47d4-96ce-f2b50408e012 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:45.585419 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603606d6-3922-47d4-96ce-f2b50408e012 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:45.585558 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603606d6-3922-47d4-96ce-f2b50408e012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:45.602264 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-603606d6-3922-47d4-96ce-f2b50408e012 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:31:45.603466 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-603606d6-3922-47d4-96ce-f2b50408e012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:31:45.667751 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 573/1148] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:31:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 14:31:45.690333 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2b7b1e-3bc7-4ea2-85fc-e1b75ddb250b None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:45.766439 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:45.794661 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2b7b1e-3bc7-4ea2-85fc-e1b75ddb250b None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:45.829434 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2929a39-3aa4-4ffe-9381-057f0dd4c50d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:45.830159 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2929a39-3aa4-4ffe-9381-057f0dd4c50d None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:45.830446 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2929a39-3aa4-4ffe-9381-057f0dd4c50d None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:45.830753 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2929a39-3aa4-4ffe-9381-057f0dd4c50d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:45.840657 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2929a39-3aa4-4ffe-9381-057f0dd4c50d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 14:31:45.848893 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-e2929a39-3aa4-4ffe-9381-057f0dd4c50d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 31 14:31:45.848893 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:31:45.848893 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:31:45.848893 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:31:45.848893 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:31:45.848893 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:31:45.848893 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:31:45.848893 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:31:45.848893 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:31:45.848893 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:31:45.848893 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:31:45.848893 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:31:45.848893 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 14:31:45.848893 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 14:31:45.848893 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 14:31:45.848893 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 14:31:45.850051 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 14:31:45.850051 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 14:31:45.850051 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 14:31:45.850051 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 14:31:45.850051 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:31:45.850051 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:31:45.850051 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:31:45.850051 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:31:45.850051 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:31:45.850051 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:31:45.850051 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:31:45.850051 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:31:45.850051 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:31:45.850051 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:31:45.850051 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:31:45.850051 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:31:45.851038 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:31:45.851038 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:31:45.851038 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:31:45.851038 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:31:45.851038 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 14:31:45.851038 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 14:31:45.851038 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 14:31:45.851038 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 14:31:45.851038 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 14:31:45.851038 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 14:31:45.851038 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 31 14:31:45.851038 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:31:45.851038 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 576/1149] 10.222.0.15 () {56 vars in 1096 bytes} [Tue May 31 14:31:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:31:45.856106 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603606d6-3922-47d4-96ce-f2b50408e012 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:45.903710 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:45.954047 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603606d6-3922-47d4-96ce-f2b50408e012 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:45.986108 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c1ddb8-177b-4ca1-814b-269ac3cc85b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:45.986789 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c1ddb8-177b-4ca1-814b-269ac3cc85b4 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:45.987070 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c1ddb8-177b-4ca1-814b-269ac3cc85b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:45.987342 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c1ddb8-177b-4ca1-814b-269ac3cc85b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:45.988068 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c1ddb8-177b-4ca1-814b-269ac3cc85b4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:31:45.988368 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c1ddb8-177b-4ca1-814b-269ac3cc85b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:45.989737 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c1ddb8-177b-4ca1-814b-269ac3cc85b4 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:45.997326 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 574/1150] 10.222.0.15 () {56 vars in 1099 bytes} [Tue May 31 14:31:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:31:46.003290 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2929a39-3aa4-4ffe-9381-057f0dd4c50d None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:46.098612 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2929a39-3aa4-4ffe-9381-057f0dd4c50d None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:46.129952 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba27741-3f39-4e41-b1a1-aa7ccc189c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:46.130815 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba27741-3f39-4e41-b1a1-aa7ccc189c51 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:46.131097 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba27741-3f39-4e41-b1a1-aa7ccc189c51 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:46.131373 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba27741-3f39-4e41-b1a1-aa7ccc189c51 None admin] PATH_INFO: `/v3/users/5f036b4ff1e1487795e32d8181ce3288` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:46.132535 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba27741-3f39-4e41-b1a1-aa7ccc189c51 None admin] RBAC: Authorizing `identity:get_user(user_id=5f036b4ff1e1487795e32d8181ce3288)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:46.133949 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba27741-3f39-4e41-b1a1-aa7ccc189c51 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:46.135549 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 577/1151] 10.222.0.15 () {56 vars in 1177 bytes} [Tue May 31 14:31:46 2022] GET /identity/v3/users/5f036b4ff1e1487795e32d8181ce3288 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:31:46.141854 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c1ddb8-177b-4ca1-814b-269ac3cc85b4 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:46.242574 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c1ddb8-177b-4ca1-814b-269ac3cc85b4 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:46.251422 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:46.274829 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a21206-f2eb-4bad-94aa-d03a88740107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:46.275687 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a21206-f2eb-4bad-94aa-d03a88740107 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:46.275973 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a21206-f2eb-4bad-94aa-d03a88740107 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:46.276245 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a21206-f2eb-4bad-94aa-d03a88740107 None admin] PATH_INFO: `/v3/projects/46cf0c1e5731407cbffbba5373c2f3ad` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:46.277405 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a21206-f2eb-4bad-94aa-d03a88740107 None admin] RBAC: Authorizing `identity:get_project(project_id=46cf0c1e5731407cbffbba5373c2f3ad)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:46.278861 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a21206-f2eb-4bad-94aa-d03a88740107 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:46.280855 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 575/1152] 10.222.0.15 () {56 vars in 1186 bytes} [Tue May 31 14:31:46 2022] GET /identity/v3/projects/46cf0c1e5731407cbffbba5373c2f3ad => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:31:46.286983 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba27741-3f39-4e41-b1a1-aa7ccc189c51 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:46.289932 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:46.384904 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba27741-3f39-4e41-b1a1-aa7ccc189c51 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:46.417668 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a99272c-d461-4c89-8c03-0077208cdf28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:46.418541 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a99272c-d461-4c89-8c03-0077208cdf28 None admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:46.418859 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a99272c-d461-4c89-8c03-0077208cdf28 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:46.419148 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a99272c-d461-4c89-8c03-0077208cdf28 None admin] PATH_INFO: `/v3/projects/46cf0c1e5731407cbffbba5373c2f3ad/users/5f036b4ff1e1487795e32d8181ce3288/roles/76c53e2c353644f885028a0226c06146` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:46.421228 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a99272c-d461-4c89-8c03-0077208cdf28 None admin] RBAC: Authorizing `identity:create_grant(project_id=46cf0c1e5731407cbffbba5373c2f3ad, user_id=5f036b4ff1e1487795e32d8181ce3288, role_id=76c53e2c353644f885028a0226c06146)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:46.422692 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a99272c-d461-4c89-8c03-0077208cdf28 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:46.507583 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 578/1153] 10.222.0.15 () {58 vars in 1439 bytes} [Tue May 31 14:31:46 2022] PUT /identity/v3/projects/46cf0c1e5731407cbffbba5373c2f3ad/users/5f036b4ff1e1487795e32d8181ce3288/roles/76c53e2c353644f885028a0226c06146 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:31:48.705721 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed88db1-cd53-475c-9cd0-934ac87a122e None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:48.706250 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed88db1-cd53-475c-9cd0-934ac87a122e None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:48.706250 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed88db1-cd53-475c-9cd0-934ac87a122e None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:48.707604 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 576/1154] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:31:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:31:48.712917 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f166ceb8-6034-4dfa-990e-6eb7b96aef07 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:48.713331 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f166ceb8-6034-4dfa-990e-6eb7b96aef07 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:48.713483 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f166ceb8-6034-4dfa-990e-6eb7b96aef07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:48.730047 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-f166ceb8-6034-4dfa-990e-6eb7b96aef07 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:31:48.731264 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-f166ceb8-6034-4dfa-990e-6eb7b96aef07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:31:48.785135 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:48.794832 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 579/1155] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:31:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 14:31:48.818034 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed88db1-cd53-475c-9cd0-934ac87a122e None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:48.916785 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed88db1-cd53-475c-9cd0-934ac87a122e None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:48.948182 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6d4467-57e1-499a-ba23-f77e3472b82d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:48.948964 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d4467-57e1-499a-ba23-f77e3472b82d None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:48.949250 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d4467-57e1-499a-ba23-f77e3472b82d None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:48.949528 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d4467-57e1-499a-ba23-f77e3472b82d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:48.960146 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6d4467-57e1-499a-ba23-f77e3472b82d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 14:31:48.968364 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-ce6d4467-57e1-499a-ba23-f77e3472b82d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 31 14:31:48.968364 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:31:48.968364 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:31:48.968364 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:31:48.968364 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:31:48.968364 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:31:48.968364 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:31:48.968364 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:31:48.968364 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:31:48.968364 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:31:48.968364 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:31:48.968364 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:31:48.968364 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 14:31:48.968364 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 14:31:48.968364 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 14:31:48.968364 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 14:31:48.969498 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 14:31:48.969498 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 14:31:48.969498 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 14:31:48.969498 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 14:31:48.969498 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:31:48.969498 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:31:48.969498 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:31:48.969498 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:31:48.969498 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:31:48.969498 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:31:48.969498 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:31:48.969498 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:31:48.969498 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:31:48.969498 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:31:48.969498 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:31:48.969498 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:31:48.970494 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:31:48.970494 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:31:48.970494 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:31:48.970494 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:31:48.970494 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 14:31:48.970494 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 14:31:48.970494 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 14:31:48.970494 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 14:31:48.970494 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 14:31:48.970494 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 14:31:48.970494 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 31 14:31:48.970494 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:31:48.970494 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 577/1156] 10.222.0.15 () {56 vars in 1096 bytes} [Tue May 31 14:31:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:31:48.975614 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f166ceb8-6034-4dfa-990e-6eb7b96aef07 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:49.069303 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f166ceb8-6034-4dfa-990e-6eb7b96aef07 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:49.102101 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d156bac-df6f-4970-b3f0-4ecf71ad196a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:49.102777 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d156bac-df6f-4970-b3f0-4ecf71ad196a None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:49.103064 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d156bac-df6f-4970-b3f0-4ecf71ad196a None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:49.103347 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d156bac-df6f-4970-b3f0-4ecf71ad196a None admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:49.104084 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d156bac-df6f-4970-b3f0-4ecf71ad196a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:31:49.104387 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d156bac-df6f-4970-b3f0-4ecf71ad196a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:49.105743 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d156bac-df6f-4970-b3f0-4ecf71ad196a None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:49.113484 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 580/1157] 10.222.0.15 () {56 vars in 1099 bytes} [Tue May 31 14:31:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 14:31:49.119178 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6d4467-57e1-499a-ba23-f77e3472b82d None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:49.153431 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:49.214599 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6d4467-57e1-499a-ba23-f77e3472b82d None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:49.247567 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5243f540-dbb7-40ed-beb4-0f501db30f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:49.248451 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5243f540-dbb7-40ed-beb4-0f501db30f5a None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:49.248745 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5243f540-dbb7-40ed-beb4-0f501db30f5a None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:49.249022 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5243f540-dbb7-40ed-beb4-0f501db30f5a None admin] PATH_INFO: `/v3/users/5f036b4ff1e1487795e32d8181ce3288` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:49.250179 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5243f540-dbb7-40ed-beb4-0f501db30f5a None admin] RBAC: Authorizing `identity:get_user(user_id=5f036b4ff1e1487795e32d8181ce3288)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:49.251631 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5243f540-dbb7-40ed-beb4-0f501db30f5a None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:49.253229 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 578/1158] 10.222.0.15 () {56 vars in 1177 bytes} [Tue May 31 14:31:49 2022] GET /identity/v3/users/5f036b4ff1e1487795e32d8181ce3288 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:31:49.259009 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d156bac-df6f-4970-b3f0-4ecf71ad196a None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:49.312361 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:49.354698 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d156bac-df6f-4970-b3f0-4ecf71ad196a None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:49.386635 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9748b3d7-9c11-481f-9b92-1909414ba846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:49.387328 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9748b3d7-9c11-481f-9b92-1909414ba846 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:49.387611 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9748b3d7-9c11-481f-9b92-1909414ba846 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:49.387885 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9748b3d7-9c11-481f-9b92-1909414ba846 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:49.452144 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9748b3d7-9c11-481f-9b92-1909414ba846 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:49.453574 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9748b3d7-9c11-481f-9b92-1909414ba846 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:49.503858 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:49.547197 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 581/1159] 10.222.0.15 () {58 vars in 1282 bytes} [Tue May 31 14:31:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 31 14:31:49.553051 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5243f540-dbb7-40ed-beb4-0f501db30f5a None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:49.653689 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5243f540-dbb7-40ed-beb4-0f501db30f5a None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:49.656800 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:49.686104 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a140498a-90c0-41f9-abff-31618f6b6058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:49.686980 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a140498a-90c0-41f9-abff-31618f6b6058 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:49.687264 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a140498a-90c0-41f9-abff-31618f6b6058 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:49.687539 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a140498a-90c0-41f9-abff-31618f6b6058 None admin] PATH_INFO: `/v3/projects/46cf0c1e5731407cbffbba5373c2f3ad` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:49.688695 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a140498a-90c0-41f9-abff-31618f6b6058 None admin] RBAC: Authorizing `identity:get_project(project_id=46cf0c1e5731407cbffbba5373c2f3ad)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:49.690112 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a140498a-90c0-41f9-abff-31618f6b6058 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:49.691804 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 579/1160] 10.222.0.15 () {56 vars in 1186 bytes} [Tue May 31 14:31:49 2022] GET /identity/v3/projects/46cf0c1e5731407cbffbba5373c2f3ad => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:31:49.697932 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9748b3d7-9c11-481f-9b92-1909414ba846 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:49.793515 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9748b3d7-9c11-481f-9b92-1909414ba846 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:49.825453 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3051c1-113b-4724-85c6-77f7130c5b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:49.826093 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3051c1-113b-4724-85c6-77f7130c5b9c None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:49.826924 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3051c1-113b-4724-85c6-77f7130c5b9c None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:49.827201 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3051c1-113b-4724-85c6-77f7130c5b9c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:49.828012 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3051c1-113b-4724-85c6-77f7130c5b9c None admin] RBAC: Adding query filter params (role.id=76c53e2c353644f885028a0226c06146, scope.project.id=46cf0c1e5731407cbffbba5373c2f3ad, user.id=5f036b4ff1e1487795e32d8181ce3288) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:31:49.828321 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3051c1-113b-4724-85c6-77f7130c5b9c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:49.829754 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3051c1-113b-4724-85c6-77f7130c5b9c None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:49.835388 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 582/1161] 10.222.0.15 () {56 vars in 1374 bytes} [Tue May 31 14:31:49 2022] GET /identity/v3/role_assignments?user.id=5f036b4ff1e1487795e32d8181ce3288&scope.project.id=46cf0c1e5731407cbffbba5373c2f3ad&role.id=76c53e2c353644f885028a0226c06146 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:31:52.066641 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186c277c-f7df-4527-85af-e03c3ec00678 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:52.067173 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186c277c-f7df-4527-85af-e03c3ec00678 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:52.067173 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186c277c-f7df-4527-85af-e03c3ec00678 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:52.068534 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 580/1162] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:31:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:31:52.073657 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad959ed-8618-4b72-a3e7-87f0407d5c45 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:52.074076 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad959ed-8618-4b72-a3e7-87f0407d5c45 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:52.074216 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad959ed-8618-4b72-a3e7-87f0407d5c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:52.092300 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-2ad959ed-8618-4b72-a3e7-87f0407d5c45 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:31:52.093477 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-2ad959ed-8618-4b72-a3e7-87f0407d5c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:31:52.105973 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:52.157832 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 583/1163] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:31:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 14:31:52.179887 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186c277c-f7df-4527-85af-e03c3ec00678 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:52.281153 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186c277c-f7df-4527-85af-e03c3ec00678 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:52.313816 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d997af-0cf3-4519-afef-f0dd68179bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:52.314459 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d997af-0cf3-4519-afef-f0dd68179bcd None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:52.314768 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d997af-0cf3-4519-afef-f0dd68179bcd None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:52.315040 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d997af-0cf3-4519-afef-f0dd68179bcd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:52.352961 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:52.377799 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d997af-0cf3-4519-afef-f0dd68179bcd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:52.379297 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d997af-0cf3-4519-afef-f0dd68179bcd None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:52.471179 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 581/1164] 10.222.0.15 () {58 vars in 1282 bytes} [Tue May 31 14:31:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 31 14:31:52.477122 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad959ed-8618-4b72-a3e7-87f0407d5c45 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:52.570745 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad959ed-8618-4b72-a3e7-87f0407d5c45 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:52.603834 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9964eab5-cfca-4e16-a710-7c239455ef4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:52.604564 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9964eab5-cfca-4e16-a710-7c239455ef4e None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:52.604851 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9964eab5-cfca-4e16-a710-7c239455ef4e None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:52.605128 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9964eab5-cfca-4e16-a710-7c239455ef4e None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:52.611759 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9964eab5-cfca-4e16-a710-7c239455ef4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:52.613204 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9964eab5-cfca-4e16-a710-7c239455ef4e None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:52.627077 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-9964eab5-cfca-4e16-a710-7c239455ef4e None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 31 14:31:52.627077 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:31:52.627077 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 31 14:31:52.627077 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 31 14:31:52.627077 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 14:31:52.627077 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 14:31:52.627077 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 14:31:52.627077 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 14:31:52.627077 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 31 14:31:52.627077 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:31:52.627077 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 31 14:31:52.627077 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:31:52.627077 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:31:52.627077 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:31:52.627077 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:31:52.627077 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:31:52.627077 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:31:52.628286 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:31:52.628286 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:31:52.628286 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:31:52.628286 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:31:52.628286 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:31:52.628286 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:31:52.628286 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 14:31:52.628286 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 14:31:52.628286 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 14:31:52.628286 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 14:31:52.628286 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:31:52.628286 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:31:52.628286 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:31:52.628286 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:31:52.628286 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:31:52.628286 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:31:52.629339 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:31:52.629339 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:31:52.629339 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:31:52.629339 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:31:52.629339 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:31:52.629339 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:31:52.629339 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:31:52.629339 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:31:52.629339 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:31:52.629339 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:31:52.629339 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 31 14:31:52.629339 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 14:31:52.629339 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 31 14:31:52.629339 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:31:52.629339 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 584/1165] 10.222.0.15 () {56 vars in 1117 bytes} [Tue May 31 14:31:52 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:31:52.634010 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d997af-0cf3-4519-afef-f0dd68179bcd None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:52.699650 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:52.728403 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d997af-0cf3-4519-afef-f0dd68179bcd None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:52.760237 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2fad2d-663a-42aa-9863-3aa1b07c0c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:52.760880 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2fad2d-663a-42aa-9863-3aa1b07c0c06 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:52.761160 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2fad2d-663a-42aa-9863-3aa1b07c0c06 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:52.761433 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2fad2d-663a-42aa-9863-3aa1b07c0c06 None admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:52.762133 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2fad2d-663a-42aa-9863-3aa1b07c0c06 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:31:52.762432 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2fad2d-663a-42aa-9863-3aa1b07c0c06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:52.764321 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2fad2d-663a-42aa-9863-3aa1b07c0c06 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:52.771115 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 582/1166] 10.222.0.15 () {56 vars in 1115 bytes} [Tue May 31 14:31:52 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:31:54.963291 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba79cf-68b5-4d48-8884-fdc6f3da5b0c None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:54.963877 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba79cf-68b5-4d48-8884-fdc6f3da5b0c None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:54.963877 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba79cf-68b5-4d48-8884-fdc6f3da5b0c None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:54.965199 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 585/1167] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:31:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:31:54.970467 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3ac69e-72bb-4220-a68c-8c1d3cafe1fe None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:54.970854 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3ac69e-72bb-4220-a68c-8c1d3cafe1fe None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:54.971063 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3ac69e-72bb-4220-a68c-8c1d3cafe1fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:54.987666 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-fe3ac69e-72bb-4220-a68c-8c1d3cafe1fe None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:31:54.988835 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-fe3ac69e-72bb-4220-a68c-8c1d3cafe1fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:31:55.051286 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 583/1168] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:31:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 14:31:55.074358 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ba79cf-68b5-4d48-8884-fdc6f3da5b0c None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:55.085617 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:55.173792 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ba79cf-68b5-4d48-8884-fdc6f3da5b0c None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:55.205960 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefa1c40-b5dd-40c1-8c02-28beb46b091c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:55.206774 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefa1c40-b5dd-40c1-8c02-28beb46b091c None admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:55.207068 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefa1c40-b5dd-40c1-8c02-28beb46b091c None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:55.207348 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefa1c40-b5dd-40c1-8c02-28beb46b091c None admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:55.208086 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefa1c40-b5dd-40c1-8c02-28beb46b091c None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:55.209448 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefa1c40-b5dd-40c1-8c02-28beb46b091c None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:55.276775 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 586/1169] 10.222.0.15 () {60 vars in 1138 bytes} [Tue May 31 14:31:55 2022] POST /identity/v3/domains => generated 267 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:31:57.510277 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4495120f-8d7d-4e41-a14f-57181f67f4d4 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:57.510871 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4495120f-8d7d-4e41-a14f-57181f67f4d4 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:57.510871 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4495120f-8d7d-4e41-a14f-57181f67f4d4 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:57.512240 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 584/1170] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:31:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:31:57.518221 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9630d68e-3f73-4eb8-9a51-7cd9d3d83065 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:57.518630 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9630d68e-3f73-4eb8-9a51-7cd9d3d83065 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:57.518814 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9630d68e-3f73-4eb8-9a51-7cd9d3d83065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:57.535297 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-9630d68e-3f73-4eb8-9a51-7cd9d3d83065 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:31:57.536460 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-9630d68e-3f73-4eb8-9a51-7cd9d3d83065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:31:57.594738 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:57.599807 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 587/1171] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:31:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 14:31:57.623325 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4495120f-8d7d-4e41-a14f-57181f67f4d4 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:57.687405 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:31:57.721167 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4495120f-8d7d-4e41-a14f-57181f67f4d4 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:57.753695 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0b840c-82bb-4344-86ef-e533264a85bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:57.754533 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0b840c-82bb-4344-86ef-e533264a85bc None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:57.754848 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0b840c-82bb-4344-86ef-e533264a85bc None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:57.755126 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0b840c-82bb-4344-86ef-e533264a85bc None admin] PATH_INFO: `/v3/domains/49b51b51a38243e9bbe40f11f1f4faff` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:57.765058 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0b840c-82bb-4344-86ef-e533264a85bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=49b51b51a38243e9bbe40f11f1f4faff)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:57.766501 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0b840c-82bb-4344-86ef-e533264a85bc None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:57.768129 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 585/1172] 10.222.0.15 () {56 vars in 1183 bytes} [Tue May 31 14:31:57 2022] GET /identity/v3/domains/49b51b51a38243e9bbe40f11f1f4faff => generated 267 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:31:57.773821 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9630d68e-3f73-4eb8-9a51-7cd9d3d83065 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:31:57.868640 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9630d68e-3f73-4eb8-9a51-7cd9d3d83065 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:31:57.901516 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae9342c-0604-46d4-9f6a-68403289047f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:31:57.902170 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae9342c-0604-46d4-9f6a-68403289047f None admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:31:57.902454 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae9342c-0604-46d4-9f6a-68403289047f None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:31:57.902771 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae9342c-0604-46d4-9f6a-68403289047f None admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:31:57.903471 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae9342c-0604-46d4-9f6a-68403289047f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:31:57.905170 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae9342c-0604-46d4-9f6a-68403289047f None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:31:57.987987 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 588/1173] 10.222.0.15 () {60 vars in 1141 bytes} [Tue May 31 14:31:57 2022] POST /identity/v3/projects => generated 361 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:32:00.248373 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c78f350-da69-43ec-9ceb-b699923b611b None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:32:00.248904 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c78f350-da69-43ec-9ceb-b699923b611b None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:32:00.248904 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c78f350-da69-43ec-9ceb-b699923b611b None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:32:00.250328 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 586/1174] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:32:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:32:00.255743 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee5ec67-a3c3-44f0-872f-dc5b9e86beca None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:32:00.256161 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee5ec67-a3c3-44f0-872f-dc5b9e86beca None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:32:00.256291 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee5ec67-a3c3-44f0-872f-dc5b9e86beca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:32:00.273661 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-2ee5ec67-a3c3-44f0-872f-dc5b9e86beca None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:32:00.274883 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-2ee5ec67-a3c3-44f0-872f-dc5b9e86beca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:32:00.320742 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:32:00.341097 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 589/1175] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:32:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 31 14:32:00.366537 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c78f350-da69-43ec-9ceb-b699923b611b None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:32:00.465032 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c78f350-da69-43ec-9ceb-b699923b611b None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:32:00.488846 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:32:00.497057 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534c2c35-47da-4035-93f0-20cbe0bf96e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:32:00.503244 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534c2c35-47da-4035-93f0-20cbe0bf96e0 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:32:00.503244 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534c2c35-47da-4035-93f0-20cbe0bf96e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:32:00.503244 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534c2c35-47da-4035-93f0-20cbe0bf96e0 None admin] PATH_INFO: `/v3/domains/49b51b51a38243e9bbe40f11f1f4faff` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:32:00.503244 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534c2c35-47da-4035-93f0-20cbe0bf96e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=49b51b51a38243e9bbe40f11f1f4faff)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:32:00.503244 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534c2c35-47da-4035-93f0-20cbe0bf96e0 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:32:00.503840 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 587/1176] 10.222.0.15 () {56 vars in 1183 bytes} [Tue May 31 14:32:00 2022] GET /identity/v3/domains/49b51b51a38243e9bbe40f11f1f4faff => generated 267 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:32:00.509180 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee5ec67-a3c3-44f0-872f-dc5b9e86beca None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:32:00.602313 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee5ec67-a3c3-44f0-872f-dc5b9e86beca None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:32:00.634288 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4444247d-a2ee-4485-8da9-d7a0ffc804a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:32:00.634973 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444247d-a2ee-4485-8da9-d7a0ffc804a7 None admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:32:00.635256 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444247d-a2ee-4485-8da9-d7a0ffc804a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:32:00.635530 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444247d-a2ee-4485-8da9-d7a0ffc804a7 None admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:32:00.636235 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4444247d-a2ee-4485-8da9-d7a0ffc804a7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:32:00.637665 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4444247d-a2ee-4485-8da9-d7a0ffc804a7 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:32:00.721491 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 590/1177] 10.222.0.15 () {60 vars in 1132 bytes} [Tue May 31 14:32:00 2022] POST /identity/v3/users => generated 311 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 14:32:02.979290 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61181347-d53c-4bb9-aada-7044dee36f98 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:32:02.979820 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61181347-d53c-4bb9-aada-7044dee36f98 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:32:02.979820 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61181347-d53c-4bb9-aada-7044dee36f98 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:32:02.981210 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 588/1178] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:32:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:32:02.986948 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdb0c29-449e-45d5-82d9-5f45164e15a7 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:32:02.987372 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdb0c29-449e-45d5-82d9-5f45164e15a7 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:32:02.987520 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdb0c29-449e-45d5-82d9-5f45164e15a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:32:03.003870 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-bcdb0c29-449e-45d5-82d9-5f45164e15a7 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:32:03.005052 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-bcdb0c29-449e-45d5-82d9-5f45164e15a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:32:03.033844 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:32:03.070183 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 591/1179] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:32:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 14:32:03.095360 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61181347-d53c-4bb9-aada-7044dee36f98 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:32:03.199386 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61181347-d53c-4bb9-aada-7044dee36f98 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:32:03.231670 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe1676c-51ed-4d5b-9307-a9608c1ad5cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:32:03.232393 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe1676c-51ed-4d5b-9307-a9608c1ad5cc None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:32:03.232677 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe1676c-51ed-4d5b-9307-a9608c1ad5cc None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:32:03.232954 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe1676c-51ed-4d5b-9307-a9608c1ad5cc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:32:03.243100 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe1676c-51ed-4d5b-9307-a9608c1ad5cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 14:32:03.250740 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-ffe1676c-51ed-4d5b-9307-a9608c1ad5cc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 31 14:32:03.250740 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:32:03.250740 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:32:03.250740 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:32:03.250740 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:32:03.250740 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:32:03.250740 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:32:03.250740 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:32:03.250740 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:32:03.250740 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:32:03.250740 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:32:03.250740 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:32:03.250740 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 14:32:03.250740 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 14:32:03.250740 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 14:32:03.250740 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 14:32:03.251816 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 14:32:03.251816 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 14:32:03.251816 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 14:32:03.251816 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 14:32:03.251816 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:32:03.251816 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:32:03.251816 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:32:03.251816 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:32:03.251816 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:32:03.251816 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:32:03.251816 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:32:03.251816 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:32:03.251816 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:32:03.251816 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:32:03.251816 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:32:03.251816 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:32:03.252865 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:32:03.252865 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:32:03.252865 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:32:03.252865 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:32:03.252865 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 14:32:03.252865 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 14:32:03.252865 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 14:32:03.252865 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 14:32:03.252865 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 14:32:03.252865 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 14:32:03.252865 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 31 14:32:03.252865 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:32:03.252865 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 589/1180] 10.222.0.15 () {56 vars in 1096 bytes} [Tue May 31 14:32:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:32:03.257959 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdb0c29-449e-45d5-82d9-5f45164e15a7 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:32:03.352604 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdb0c29-449e-45d5-82d9-5f45164e15a7 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:32:03.385097 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba93135f-092d-4566-9af2-a5e627f691bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:32:03.385747 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba93135f-092d-4566-9af2-a5e627f691bd None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:32:03.386028 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba93135f-092d-4566-9af2-a5e627f691bd None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:32:03.386304 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba93135f-092d-4566-9af2-a5e627f691bd None admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:32:03.387070 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba93135f-092d-4566-9af2-a5e627f691bd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:32:03.387375 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba93135f-092d-4566-9af2-a5e627f691bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:32:03.389494 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba93135f-092d-4566-9af2-a5e627f691bd None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:32:03.397247 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 592/1181] 10.222.0.15 () {56 vars in 1099 bytes} [Tue May 31 14:32:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:32:03.402966 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe1676c-51ed-4d5b-9307-a9608c1ad5cc None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:32:03.456720 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:32:03.498625 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe1676c-51ed-4d5b-9307-a9608c1ad5cc None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:32:03.532122 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5073bda-f916-4222-9f1f-db527ac7e32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:32:03.532980 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5073bda-f916-4222-9f1f-db527ac7e32a None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:32:03.533275 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5073bda-f916-4222-9f1f-db527ac7e32a None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:32:03.533561 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5073bda-f916-4222-9f1f-db527ac7e32a None admin] PATH_INFO: `/v3/users/ddf29271ba0b4d47ac46f52170ed5fbc` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:32:03.546070 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5073bda-f916-4222-9f1f-db527ac7e32a None admin] RBAC: Authorizing `identity:get_user(user_id=ddf29271ba0b4d47ac46f52170ed5fbc)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:32:03.547531 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5073bda-f916-4222-9f1f-db527ac7e32a None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:32:03.549141 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 590/1182] 10.222.0.15 () {56 vars in 1177 bytes} [Tue May 31 14:32:03 2022] GET /identity/v3/users/ddf29271ba0b4d47ac46f52170ed5fbc => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:32:03.554935 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba93135f-092d-4566-9af2-a5e627f691bd None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:32:03.583957 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:32:03.650838 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba93135f-092d-4566-9af2-a5e627f691bd None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:32:03.687997 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a49ce2-d638-476d-a280-d100d582a279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:32:03.688638 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a49ce2-d638-476d-a280-d100d582a279 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:32:03.688919 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a49ce2-d638-476d-a280-d100d582a279 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:32:03.689250 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a49ce2-d638-476d-a280-d100d582a279 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:32:03.755016 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a49ce2-d638-476d-a280-d100d582a279 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:32:03.756390 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a49ce2-d638-476d-a280-d100d582a279 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:32:03.781293 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:32:03.849626 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 593/1183] 10.222.0.15 () {58 vars in 1282 bytes} [Tue May 31 14:32:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 31 14:32:03.855461 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5073bda-f916-4222-9f1f-db527ac7e32a None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:32:03.949683 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5073bda-f916-4222-9f1f-db527ac7e32a None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:32:03.962024 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:32:03.982388 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc9bf9-99bb-478e-a140-41d40719376d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:32:03.983305 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc9bf9-99bb-478e-a140-41d40719376d None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:32:03.983586 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc9bf9-99bb-478e-a140-41d40719376d None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:32:03.983866 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc9bf9-99bb-478e-a140-41d40719376d None admin] PATH_INFO: `/v3/projects/186359fc03f04249aeedea836e3a6567` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:32:03.985031 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cc9bf9-99bb-478e-a140-41d40719376d None admin] RBAC: Authorizing `identity:get_project(project_id=186359fc03f04249aeedea836e3a6567)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:32:03.986491 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cc9bf9-99bb-478e-a140-41d40719376d None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:32:03.988233 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 591/1184] 10.222.0.15 () {56 vars in 1186 bytes} [Tue May 31 14:32:03 2022] GET /identity/v3/projects/186359fc03f04249aeedea836e3a6567 => generated 361 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:32:03.994474 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a49ce2-d638-476d-a280-d100d582a279 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:32:04.091023 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a49ce2-d638-476d-a280-d100d582a279 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:32:04.116408 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:32:04.124620 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c5feac-bd9c-45e6-9261-f24ada64b390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:32:04.125268 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c5feac-bd9c-45e6-9261-f24ada64b390 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:32:04.125552 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c5feac-bd9c-45e6-9261-f24ada64b390 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:32:04.125830 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c5feac-bd9c-45e6-9261-f24ada64b390 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:32:04.126668 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c5feac-bd9c-45e6-9261-f24ada64b390 None admin] RBAC: Adding query filter params (role.id=76c53e2c353644f885028a0226c06146, scope.project.id=186359fc03f04249aeedea836e3a6567, user.id=ddf29271ba0b4d47ac46f52170ed5fbc) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:32:04.126980 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c5feac-bd9c-45e6-9261-f24ada64b390 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:32:04.131366 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c5feac-bd9c-45e6-9261-f24ada64b390 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:32:04.134052 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 594/1185] 10.222.0.15 () {56 vars in 1374 bytes} [Tue May 31 14:32:03 2022] GET /identity/v3/role_assignments?user.id=ddf29271ba0b4d47ac46f52170ed5fbc&scope.project.id=186359fc03f04249aeedea836e3a6567&role.id=76c53e2c353644f885028a0226c06146 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:32:06.324111 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee23888-4d26-4014-ba91-6123d7d30c00 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:32:06.324556 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee23888-4d26-4014-ba91-6123d7d30c00 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:32:06.324654 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee23888-4d26-4014-ba91-6123d7d30c00 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:32:06.326498 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 592/1186] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:32:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:32:06.331590 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b05ef6-ea57-44e8-a6ca-482e25902904 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:32:06.332011 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b05ef6-ea57-44e8-a6ca-482e25902904 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:32:06.332151 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b05ef6-ea57-44e8-a6ca-482e25902904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:32:06.349138 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-e2b05ef6-ea57-44e8-a6ca-482e25902904 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:32:06.350308 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-e2b05ef6-ea57-44e8-a6ca-482e25902904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:32:06.417028 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 595/1187] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:32:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 14:32:06.440068 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee23888-4d26-4014-ba91-6123d7d30c00 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:32:06.535282 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee23888-4d26-4014-ba91-6123d7d30c00 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:32:06.566969 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6842f04d-c614-4074-910e-658ac272c267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:32:06.567684 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6842f04d-c614-4074-910e-658ac272c267 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:32:06.567964 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6842f04d-c614-4074-910e-658ac272c267 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:32:06.568236 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6842f04d-c614-4074-910e-658ac272c267 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:32:06.578321 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6842f04d-c614-4074-910e-658ac272c267 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 14:32:06.585907 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-6842f04d-c614-4074-910e-658ac272c267 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 31 14:32:06.585907 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:32:06.585907 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:32:06.585907 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:32:06.585907 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:32:06.585907 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:32:06.585907 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:32:06.585907 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:32:06.585907 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:32:06.585907 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:32:06.585907 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:32:06.585907 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:32:06.585907 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 14:32:06.585907 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 14:32:06.585907 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 14:32:06.585907 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 14:32:06.587118 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 14:32:06.587118 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 14:32:06.587118 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 14:32:06.587118 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 14:32:06.587118 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:32:06.587118 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:32:06.587118 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:32:06.587118 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:32:06.587118 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:32:06.587118 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:32:06.587118 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:32:06.587118 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:32:06.587118 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:32:06.587118 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:32:06.587118 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:32:06.587118 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:32:06.588347 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:32:06.588347 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:32:06.588347 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:32:06.588347 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:32:06.588347 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 14:32:06.588347 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 14:32:06.588347 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 14:32:06.588347 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 14:32:06.588347 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 14:32:06.588347 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 14:32:06.588347 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 31 14:32:06.588347 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:32:06.588347 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 593/1188] 10.222.0.15 () {56 vars in 1096 bytes} [Tue May 31 14:32:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:32:06.592939 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b05ef6-ea57-44e8-a6ca-482e25902904 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:32:06.689940 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b05ef6-ea57-44e8-a6ca-482e25902904 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:32:06.711696 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:32:06.722690 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd5c035-759e-4c94-aba6-97294650fe14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:32:06.726209 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd5c035-759e-4c94-aba6-97294650fe14 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:32:06.726209 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd5c035-759e-4c94-aba6-97294650fe14 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:32:06.726209 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd5c035-759e-4c94-aba6-97294650fe14 None admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:32:06.726209 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd5c035-759e-4c94-aba6-97294650fe14 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:32:06.726209 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd5c035-759e-4c94-aba6-97294650fe14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:32:06.726762 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd5c035-759e-4c94-aba6-97294650fe14 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:32:06.734655 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 596/1189] 10.222.0.15 () {56 vars in 1099 bytes} [Tue May 31 14:32:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:32:06.740785 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6842f04d-c614-4074-910e-658ac272c267 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:32:06.781264 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:32:06.837871 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6842f04d-c614-4074-910e-658ac272c267 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:32:06.869497 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d555ddb-e444-4f84-88c5-5971a2e889c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:32:06.870353 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d555ddb-e444-4f84-88c5-5971a2e889c5 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:32:06.870661 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d555ddb-e444-4f84-88c5-5971a2e889c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:32:06.870936 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d555ddb-e444-4f84-88c5-5971a2e889c5 None admin] PATH_INFO: `/v3/users/ddf29271ba0b4d47ac46f52170ed5fbc` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:32:06.872097 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d555ddb-e444-4f84-88c5-5971a2e889c5 None admin] RBAC: Authorizing `identity:get_user(user_id=ddf29271ba0b4d47ac46f52170ed5fbc)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:32:06.874096 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d555ddb-e444-4f84-88c5-5971a2e889c5 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:32:06.875718 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 594/1190] 10.222.0.15 () {56 vars in 1177 bytes} [Tue May 31 14:32:06 2022] GET /identity/v3/users/ddf29271ba0b4d47ac46f52170ed5fbc => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:32:06.881422 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd5c035-759e-4c94-aba6-97294650fe14 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:32:06.975382 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd5c035-759e-4c94-aba6-97294650fe14 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:32:07.007968 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07496205-5dd7-4fe6-8910-f92a2abcc895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:32:07.008806 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07496205-5dd7-4fe6-8910-f92a2abcc895 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:32:07.009084 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07496205-5dd7-4fe6-8910-f92a2abcc895 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:32:07.009361 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07496205-5dd7-4fe6-8910-f92a2abcc895 None admin] PATH_INFO: `/v3/projects/186359fc03f04249aeedea836e3a6567` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:32:07.010513 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07496205-5dd7-4fe6-8910-f92a2abcc895 None admin] RBAC: Authorizing `identity:get_project(project_id=186359fc03f04249aeedea836e3a6567)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:32:07.011952 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07496205-5dd7-4fe6-8910-f92a2abcc895 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:32:07.013607 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 597/1191] 10.222.0.15 () {56 vars in 1186 bytes} [Tue May 31 14:32:06 2022] GET /identity/v3/projects/186359fc03f04249aeedea836e3a6567 => generated 361 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:32:07.019483 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d555ddb-e444-4f84-88c5-5971a2e889c5 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:32:07.115474 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d555ddb-e444-4f84-88c5-5971a2e889c5 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:32:07.124625 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:32:07.150299 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2d93b1-2ca9-4971-b921-174823dbeb87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:32:07.151211 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2d93b1-2ca9-4971-b921-174823dbeb87 None admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:32:07.151517 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2d93b1-2ca9-4971-b921-174823dbeb87 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:32:07.151829 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2d93b1-2ca9-4971-b921-174823dbeb87 None admin] PATH_INFO: `/v3/projects/186359fc03f04249aeedea836e3a6567/users/ddf29271ba0b4d47ac46f52170ed5fbc/roles/76c53e2c353644f885028a0226c06146` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:32:07.154530 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2d93b1-2ca9-4971-b921-174823dbeb87 None admin] RBAC: Authorizing `identity:create_grant(project_id=186359fc03f04249aeedea836e3a6567, user_id=ddf29271ba0b4d47ac46f52170ed5fbc, role_id=76c53e2c353644f885028a0226c06146)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:32:07.156468 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2d93b1-2ca9-4971-b921-174823dbeb87 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:32:07.225812 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 595/1192] 10.222.0.15 () {58 vars in 1439 bytes} [Tue May 31 14:32:07 2022] PUT /identity/v3/projects/186359fc03f04249aeedea836e3a6567/users/ddf29271ba0b4d47ac46f52170ed5fbc/roles/76c53e2c353644f885028a0226c06146 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:32:09.418281 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ecc798-e397-456c-9929-54b25f5fb2d1 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:32:09.418841 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ecc798-e397-456c-9929-54b25f5fb2d1 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:32:09.418975 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ecc798-e397-456c-9929-54b25f5fb2d1 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:32:09.420323 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 598/1193] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:32:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:32:09.425439 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fff83b9-97f1-4281-82bc-f871f9bffce4 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:32:09.425875 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fff83b9-97f1-4281-82bc-f871f9bffce4 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:32:09.426006 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fff83b9-97f1-4281-82bc-f871f9bffce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:32:09.442813 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-6fff83b9-97f1-4281-82bc-f871f9bffce4 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:32:09.443987 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-6fff83b9-97f1-4281-82bc-f871f9bffce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:32:09.507768 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 596/1194] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:32:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 14:32:09.531947 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ecc798-e397-456c-9929-54b25f5fb2d1 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:32:09.584010 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:32:09.630417 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ecc798-e397-456c-9929-54b25f5fb2d1 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:32:09.663435 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d8eeae-e3e8-4ef1-85e3-207ab5b54f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:32:09.664211 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d8eeae-e3e8-4ef1-85e3-207ab5b54f82 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:32:09.664495 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d8eeae-e3e8-4ef1-85e3-207ab5b54f82 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:32:09.664771 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d8eeae-e3e8-4ef1-85e3-207ab5b54f82 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:32:09.674699 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d8eeae-e3e8-4ef1-85e3-207ab5b54f82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 14:32:09.682194 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-79d8eeae-e3e8-4ef1-85e3-207ab5b54f82 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 31 14:32:09.682194 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:32:09.682194 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:32:09.682194 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:32:09.682194 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:32:09.682194 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:32:09.682194 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:32:09.682194 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:32:09.682194 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:32:09.682194 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:32:09.682194 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:32:09.682194 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:32:09.682194 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 14:32:09.682194 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 14:32:09.682194 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 14:32:09.682194 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 14:32:09.683332 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 14:32:09.683332 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 14:32:09.683332 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 14:32:09.683332 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 14:32:09.683332 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:32:09.683332 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:32:09.683332 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:32:09.683332 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:32:09.683332 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:32:09.683332 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:32:09.683332 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:32:09.683332 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:32:09.683332 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:32:09.683332 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:32:09.683332 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:32:09.683332 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:32:09.684379 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:32:09.684379 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:32:09.684379 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:32:09.684379 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:32:09.684379 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 14:32:09.684379 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 14:32:09.684379 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 14:32:09.684379 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 14:32:09.684379 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 14:32:09.684379 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 14:32:09.684379 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 31 14:32:09.684379 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:32:09.686697 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 599/1195] 10.222.0.15 () {56 vars in 1096 bytes} [Tue May 31 14:32:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:32:09.689926 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fff83b9-97f1-4281-82bc-f871f9bffce4 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:32:09.780094 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:32:09.783681 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fff83b9-97f1-4281-82bc-f871f9bffce4 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:32:09.816814 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b25617-2cf4-4b64-814f-976ff613cc8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:32:09.817471 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b25617-2cf4-4b64-814f-976ff613cc8f None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:32:09.817754 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b25617-2cf4-4b64-814f-976ff613cc8f None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:32:09.818030 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b25617-2cf4-4b64-814f-976ff613cc8f None admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:32:09.818800 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b25617-2cf4-4b64-814f-976ff613cc8f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:32:09.819107 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b25617-2cf4-4b64-814f-976ff613cc8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:32:09.821062 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b25617-2cf4-4b64-814f-976ff613cc8f None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:32:09.828144 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 597/1196] 10.222.0.15 () {56 vars in 1099 bytes} [Tue May 31 14:32:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:32:09.833934 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d8eeae-e3e8-4ef1-85e3-207ab5b54f82 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:32:09.929229 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d8eeae-e3e8-4ef1-85e3-207ab5b54f82 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:32:09.941641 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:32:09.961493 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82edacf6-1d7e-4b1c-a110-ce85af16092a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:32:09.962338 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82edacf6-1d7e-4b1c-a110-ce85af16092a None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:32:09.962653 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82edacf6-1d7e-4b1c-a110-ce85af16092a None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:32:09.962929 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82edacf6-1d7e-4b1c-a110-ce85af16092a None admin] PATH_INFO: `/v3/users/ddf29271ba0b4d47ac46f52170ed5fbc` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:32:09.964080 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82edacf6-1d7e-4b1c-a110-ce85af16092a None admin] RBAC: Authorizing `identity:get_user(user_id=ddf29271ba0b4d47ac46f52170ed5fbc)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:32:09.965495 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82edacf6-1d7e-4b1c-a110-ce85af16092a None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:32:09.967176 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 600/1197] 10.222.0.15 () {56 vars in 1177 bytes} [Tue May 31 14:32:09 2022] GET /identity/v3/users/ddf29271ba0b4d47ac46f52170ed5fbc => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:32:09.972741 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b25617-2cf4-4b64-814f-976ff613cc8f None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:32:10.072837 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b25617-2cf4-4b64-814f-976ff613cc8f None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:32:10.104153 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dd7fdb-a114-44b3-9528-26151e7c0640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:32:10.104784 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd7fdb-a114-44b3-9528-26151e7c0640 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:32:10.105063 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd7fdb-a114-44b3-9528-26151e7c0640 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:32:10.105336 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dd7fdb-a114-44b3-9528-26151e7c0640 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:32:10.132178 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:32:10.169821 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dd7fdb-a114-44b3-9528-26151e7c0640 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:32:10.171277 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dd7fdb-a114-44b3-9528-26151e7c0640 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:32:10.265466 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 598/1198] 10.222.0.15 () {58 vars in 1282 bytes} [Tue May 31 14:32:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 31 14:32:10.271263 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82edacf6-1d7e-4b1c-a110-ce85af16092a None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:32:10.369909 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82edacf6-1d7e-4b1c-a110-ce85af16092a None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:32:10.401159 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef18f38-a49c-4759-8097-d0d5b3239804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:32:10.402000 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef18f38-a49c-4759-8097-d0d5b3239804 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:32:10.402281 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef18f38-a49c-4759-8097-d0d5b3239804 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:32:10.402581 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef18f38-a49c-4759-8097-d0d5b3239804 None admin] PATH_INFO: `/v3/projects/186359fc03f04249aeedea836e3a6567` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:32:10.408758 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef18f38-a49c-4759-8097-d0d5b3239804 None admin] RBAC: Authorizing `identity:get_project(project_id=186359fc03f04249aeedea836e3a6567)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:32:10.410484 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef18f38-a49c-4759-8097-d0d5b3239804 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:32:10.412398 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 601/1199] 10.222.0.15 () {56 vars in 1186 bytes} [Tue May 31 14:32:10 2022] GET /identity/v3/projects/186359fc03f04249aeedea836e3a6567 => generated 361 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:32:10.418492 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dd7fdb-a114-44b3-9528-26151e7c0640 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:32:10.477638 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:32:10.516412 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dd7fdb-a114-44b3-9528-26151e7c0640 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:32:10.548762 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119f2514-e7a5-41d6-b2d8-cc0bee454410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:32:10.549402 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119f2514-e7a5-41d6-b2d8-cc0bee454410 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:32:10.549712 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119f2514-e7a5-41d6-b2d8-cc0bee454410 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:32:10.549989 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119f2514-e7a5-41d6-b2d8-cc0bee454410 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:32:10.550833 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119f2514-e7a5-41d6-b2d8-cc0bee454410 None admin] RBAC: Adding query filter params (role.id=76c53e2c353644f885028a0226c06146, scope.project.id=186359fc03f04249aeedea836e3a6567, user.id=ddf29271ba0b4d47ac46f52170ed5fbc) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:32:10.551148 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119f2514-e7a5-41d6-b2d8-cc0bee454410 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:32:10.552570 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119f2514-e7a5-41d6-b2d8-cc0bee454410 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:32:10.558148 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 599/1200] 10.222.0.15 () {56 vars in 1374 bytes} [Tue May 31 14:32:10 2022] GET /identity/v3/role_assignments?user.id=ddf29271ba0b4d47ac46f52170ed5fbc&scope.project.id=186359fc03f04249aeedea836e3a6567&role.id=76c53e2c353644f885028a0226c06146 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:32:20.397138 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=76 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:32:20.555681 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=38 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:33:28.201512 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c186fd4-866c-4d82-b363-213fa8666aff None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:33:28.202122 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c186fd4-866c-4d82-b363-213fa8666aff None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:33:28.202122 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c186fd4-866c-4d82-b363-213fa8666aff None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:33:28.203504 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 602/1201] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:33:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:33:28.209358 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f6cb8-ed4f-4c04-a830-cfffd0042a33 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:33:28.209788 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f6cb8-ed4f-4c04-a830-cfffd0042a33 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:33:28.209939 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f6cb8-ed4f-4c04-a830-cfffd0042a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:33:28.226873 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-334f6cb8-ed4f-4c04-a830-cfffd0042a33 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:33:28.228042 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-334f6cb8-ed4f-4c04-a830-cfffd0042a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:33:28.292037 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 600/1202] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:33:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 14:33:28.316758 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c186fd4-866c-4d82-b363-213fa8666aff None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:33:28.419665 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c186fd4-866c-4d82-b363-213fa8666aff None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:33:28.458651 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd4a618-5a47-48e1-849e-a014847a12b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:33:28.458651 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd4a618-5a47-48e1-849e-a014847a12b5 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:33:28.458651 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd4a618-5a47-48e1-849e-a014847a12b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:33:28.458651 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd4a618-5a47-48e1-849e-a014847a12b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:33:28.464597 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd4a618-5a47-48e1-849e-a014847a12b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:33:28.466055 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd4a618-5a47-48e1-849e-a014847a12b5 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:33:28.482879 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-ebd4a618-5a47-48e1-849e-a014847a12b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:33:28.482879 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:33:28.482879 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:33:28.482879 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:33:28.482879 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:33:28.482879 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:33:28.482879 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:33:28.482879 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:33:28.482879 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:33:28.482879 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:33:28.482879 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:33:28.482879 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:33:28.482879 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 14:33:28.482879 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 14:33:28.482879 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 14:33:28.490055 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 14:33:28.490055 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:33:28.490055 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:33:28.490055 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:33:28.490055 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:33:28.490055 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:33:28.490055 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:33:28.490055 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:33:28.490055 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:33:28.490055 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:33:28.490055 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:33:28.490055 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:33:28.490055 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:33:28.490055 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:33:28.490055 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:33:28.490055 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:33:28.490055 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:33:28.491309 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 14:33:28.491309 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 14:33:28.491309 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:33:28.491309 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:33:28.491309 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 603/1203] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:33:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:33:28.491699 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334f6cb8-ed4f-4c04-a830-cfffd0042a33 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:33:28.586225 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334f6cb8-ed4f-4c04-a830-cfffd0042a33 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:33:28.612928 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:33:28.618597 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f3eba6-d3f9-455b-8e47-caf0fb67ee13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:33:28.620764 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f3eba6-d3f9-455b-8e47-caf0fb67ee13 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:33:28.620764 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f3eba6-d3f9-455b-8e47-caf0fb67ee13 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:33:28.620764 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f3eba6-d3f9-455b-8e47-caf0fb67ee13 None admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:33:28.620764 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f3eba6-d3f9-455b-8e47-caf0fb67ee13 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:33:28.621190 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f3eba6-d3f9-455b-8e47-caf0fb67ee13 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:33:28.622240 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f3eba6-d3f9-455b-8e47-caf0fb67ee13 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:33:28.633410 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 601/1204] 10.222.0.15 () {56 vars in 1109 bytes} [Tue May 31 14:33:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:33:28.639158 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd4a618-5a47-48e1-849e-a014847a12b5 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:33:28.691814 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:33:28.737599 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd4a618-5a47-48e1-849e-a014847a12b5 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:33:28.771436 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ce9aca-5fea-46b1-b728-52a03354dd1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:33:28.772094 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ce9aca-5fea-46b1-b728-52a03354dd1a None admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:33:28.772380 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ce9aca-5fea-46b1-b728-52a03354dd1a None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:33:28.772663 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ce9aca-5fea-46b1-b728-52a03354dd1a None admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:33:28.773396 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ce9aca-5fea-46b1-b728-52a03354dd1a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:33:28.774846 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ce9aca-5fea-46b1-b728-52a03354dd1a None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:33:28.906359 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 604/1205] 10.222.0.15 () {60 vars in 1132 bytes} [Tue May 31 14:33:28 2022] POST /identity/v3/users => generated 251 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:33:31.152529 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4a2c77-e271-4de6-8b8c-54a49afd04bd None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:33:31.153078 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4a2c77-e271-4de6-8b8c-54a49afd04bd None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:33:31.153078 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4a2c77-e271-4de6-8b8c-54a49afd04bd None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:33:31.154448 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 602/1206] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:33:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:33:31.160725 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a290aa08-e8e0-4d6c-891e-883204a46f61 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:33:31.161149 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a290aa08-e8e0-4d6c-891e-883204a46f61 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:33:31.161277 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a290aa08-e8e0-4d6c-891e-883204a46f61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:33:31.178006 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-a290aa08-e8e0-4d6c-891e-883204a46f61 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:33:31.179207 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-a290aa08-e8e0-4d6c-891e-883204a46f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:33:31.248180 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 605/1207] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:33:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 14:33:31.272698 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4a2c77-e271-4de6-8b8c-54a49afd04bd None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:33:31.381582 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4a2c77-e271-4de6-8b8c-54a49afd04bd None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:33:31.414012 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d56730-73fa-4d7c-8c6c-aa0ef9178410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:33:31.414765 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d56730-73fa-4d7c-8c6c-aa0ef9178410 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:33:31.415050 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d56730-73fa-4d7c-8c6c-aa0ef9178410 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:33:31.415323 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d56730-73fa-4d7c-8c6c-aa0ef9178410 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:33:31.426185 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d56730-73fa-4d7c-8c6c-aa0ef9178410 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 14:33:31.433969 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-e4d56730-73fa-4d7c-8c6c-aa0ef9178410 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 31 14:33:31.433969 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:33:31.433969 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:33:31.433969 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:33:31.433969 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:33:31.433969 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:33:31.433969 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:33:31.433969 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:33:31.433969 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:33:31.433969 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:33:31.433969 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:33:31.433969 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:33:31.433969 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 14:33:31.433969 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 14:33:31.433969 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 14:33:31.433969 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 14:33:31.435111 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 14:33:31.435111 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 14:33:31.435111 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 14:33:31.435111 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 14:33:31.435111 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:33:31.435111 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:33:31.435111 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:33:31.435111 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:33:31.435111 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:33:31.435111 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:33:31.435111 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:33:31.435111 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:33:31.435111 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:33:31.435111 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:33:31.435111 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:33:31.435111 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:33:31.436062 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:33:31.436062 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:33:31.436062 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:33:31.436062 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:33:31.436062 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 14:33:31.436062 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 14:33:31.436062 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 14:33:31.436062 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 14:33:31.436062 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 14:33:31.436062 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 14:33:31.436062 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 31 14:33:31.436062 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:33:31.436062 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 603/1208] 10.222.0.15 () {56 vars in 1102 bytes} [Tue May 31 14:33:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:33:31.441471 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a290aa08-e8e0-4d6c-891e-883204a46f61 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:33:31.481038 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:33:31.538365 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a290aa08-e8e0-4d6c-891e-883204a46f61 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:33:31.571973 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562cd977-d388-4846-91c2-b4b5518aa86e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:33:31.572629 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562cd977-d388-4846-91c2-b4b5518aa86e None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:33:31.572907 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562cd977-d388-4846-91c2-b4b5518aa86e None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:33:31.573180 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562cd977-d388-4846-91c2-b4b5518aa86e None admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:33:31.573905 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562cd977-d388-4846-91c2-b4b5518aa86e None admin] RBAC: Adding query filter params (name=service) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:33:31.574207 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562cd977-d388-4846-91c2-b4b5518aa86e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:33:31.575615 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562cd977-d388-4846-91c2-b4b5518aa86e None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:33:31.583109 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 606/1209] 10.222.0.15 () {56 vars in 1103 bytes} [Tue May 31 14:33:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:33:31.588786 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d56730-73fa-4d7c-8c6c-aa0ef9178410 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:33:31.639262 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:33:31.688040 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d56730-73fa-4d7c-8c6c-aa0ef9178410 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:33:31.721324 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeeab59-a38d-4906-b765-a5d01e774b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:33:31.722115 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeeab59-a38d-4906-b765-a5d01e774b25 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:33:31.722402 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeeab59-a38d-4906-b765-a5d01e774b25 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:33:31.723339 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeeab59-a38d-4906-b765-a5d01e774b25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:33:31.733059 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeeab59-a38d-4906-b765-a5d01e774b25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:33:31.734525 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeeab59-a38d-4906-b765-a5d01e774b25 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:33:31.753295 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-dfeeab59-a38d-4906-b765-a5d01e774b25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:33:31.753295 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:33:31.753295 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:33:31.753295 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:33:31.753295 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:33:31.753295 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:33:31.753295 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:33:31.753295 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:33:31.753295 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:33:31.753295 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:33:31.753295 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:33:31.753295 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:33:31.753295 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 14:33:31.753295 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 14:33:31.753295 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 14:33:31.754401 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 14:33:31.754401 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:33:31.754401 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:33:31.754401 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:33:31.754401 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:33:31.754401 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:33:31.754401 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:33:31.754401 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:33:31.754401 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:33:31.754401 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:33:31.754401 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:33:31.754401 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:33:31.754401 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:33:31.754401 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:33:31.754401 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:33:31.754401 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:33:31.754401 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:33:31.755543 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 14:33:31.755543 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 14:33:31.755543 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:33:31.755543 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:33:31.755543 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 604/1210] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:33:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:33:31.760813 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562cd977-d388-4846-91c2-b4b5518aa86e None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:33:31.984274 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:33:31.987145 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562cd977-d388-4846-91c2-b4b5518aa86e None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:33:32.019028 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba5dc5a-5d1b-446b-94e4-a7bfb41cc881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:33:32.020209 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba5dc5a-5d1b-446b-94e4-a7bfb41cc881 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:33:32.020491 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba5dc5a-5d1b-446b-94e4-a7bfb41cc881 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:33:32.020763 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba5dc5a-5d1b-446b-94e4-a7bfb41cc881 None admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:33:32.021481 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba5dc5a-5d1b-446b-94e4-a7bfb41cc881 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:33:32.021779 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba5dc5a-5d1b-446b-94e4-a7bfb41cc881 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:33:32.023161 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba5dc5a-5d1b-446b-94e4-a7bfb41cc881 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:33:32.034279 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 607/1211] 10.222.0.15 () {56 vars in 1109 bytes} [Tue May 31 14:33:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:33:32.040655 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeeab59-a38d-4906-b765-a5d01e774b25 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:33:32.138071 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeeab59-a38d-4906-b765-a5d01e774b25 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:33:32.139579 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:33:32.171395 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c77e62a-bb58-4324-8c00-f89c96830f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:33:32.172180 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c77e62a-bb58-4324-8c00-f89c96830f27 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:33:32.172457 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c77e62a-bb58-4324-8c00-f89c96830f27 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:33:32.172727 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c77e62a-bb58-4324-8c00-f89c96830f27 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:33:32.179946 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c77e62a-bb58-4324-8c00-f89c96830f27 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:33:32.181387 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c77e62a-bb58-4324-8c00-f89c96830f27 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:33:32.195755 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-6c77e62a-bb58-4324-8c00-f89c96830f27 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 31 14:33:32.195755 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:33:32.195755 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:33:32.195755 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:33:32.195755 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:33:32.195755 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:33:32.195755 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:33:32.195755 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:33:32.195755 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:33:32.195755 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:33:32.195755 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:33:32.195755 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:33:32.195755 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 14:33:32.195755 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 14:33:32.195755 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 14:33:32.195755 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 14:33:32.196843 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:33:32.196843 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:33:32.196843 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 14:33:32.196843 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 14:33:32.196843 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 14:33:32.196843 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 14:33:32.196843 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:33:32.196843 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:33:32.196843 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:33:32.196843 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:33:32.196843 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:33:32.196843 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:33:32.196843 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:33:32.196843 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:33:32.196843 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:33:32.196843 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:33:32.196843 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:33:32.196843 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:33:32.198240 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:33:32.198240 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:33:32.198240 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 14:33:32.198240 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 14:33:32.198240 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 14:33:32.198240 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 14:33:32.198240 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 14:33:32.198240 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 14:33:32.198240 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 31 14:33:32.198240 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:33:32.198240 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 605/1212] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:33:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:33:32.202676 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba5dc5a-5d1b-446b-94e4-a7bfb41cc881 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:33:32.301766 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba5dc5a-5d1b-446b-94e4-a7bfb41cc881 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:33:32.334775 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5628f1ef-936c-4b2d-bac7-1f49ca919675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:33:32.335437 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5628f1ef-936c-4b2d-bac7-1f49ca919675 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:33:32.335717 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5628f1ef-936c-4b2d-bac7-1f49ca919675 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:33:32.335991 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5628f1ef-936c-4b2d-bac7-1f49ca919675 None admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:33:32.336808 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5628f1ef-936c-4b2d-bac7-1f49ca919675 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:33:32.337116 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5628f1ef-936c-4b2d-bac7-1f49ca919675 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:33:32.338532 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5628f1ef-936c-4b2d-bac7-1f49ca919675 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:33:32.355533 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 608/1213] 10.222.0.15 () {56 vars in 1143 bytes} [Tue May 31 14:33:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 14:33:32.361241 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c77e62a-bb58-4324-8c00-f89c96830f27 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:33:32.458698 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c77e62a-bb58-4324-8c00-f89c96830f27 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:33:32.492040 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d777fe-ab7b-498d-b633-659fafe0d355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:33:32.492687 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d777fe-ab7b-498d-b633-659fafe0d355 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:33:32.492974 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d777fe-ab7b-498d-b633-659fafe0d355 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:33:32.493256 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d777fe-ab7b-498d-b633-659fafe0d355 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:33:32.522226 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:33:32.558337 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d777fe-ab7b-498d-b633-659fafe0d355 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:33:32.559753 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d777fe-ab7b-498d-b633-659fafe0d355 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:33:32.654186 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 606/1214] 10.222.0.15 () {58 vars in 1282 bytes} [Tue May 31 14:33:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 31 14:33:32.660316 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5628f1ef-936c-4b2d-bac7-1f49ca919675 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:33:32.679327 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:33:32.760743 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5628f1ef-936c-4b2d-bac7-1f49ca919675 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:33:32.793968 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a504a2e3-0184-4688-a91c-594bd000f9a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:33:32.794772 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a504a2e3-0184-4688-a91c-594bd000f9a1 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:33:32.795060 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a504a2e3-0184-4688-a91c-594bd000f9a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:33:32.795339 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a504a2e3-0184-4688-a91c-594bd000f9a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:33:32.805552 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a504a2e3-0184-4688-a91c-594bd000f9a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:33:32.807016 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a504a2e3-0184-4688-a91c-594bd000f9a1 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:33:32.823556 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-a504a2e3-0184-4688-a91c-594bd000f9a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:33:32.823556 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:33:32.823556 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:33:32.823556 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:33:32.823556 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:33:32.823556 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:33:32.823556 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:33:32.823556 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:33:32.823556 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:33:32.823556 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:33:32.823556 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:33:32.823556 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:33:32.823556 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 14:33:32.823556 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 14:33:32.823556 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 14:33:32.824594 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 14:33:32.824594 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:33:32.824594 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:33:32.824594 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:33:32.824594 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:33:32.824594 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:33:32.824594 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:33:32.824594 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:33:32.824594 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:33:32.824594 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:33:32.824594 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:33:32.824594 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:33:32.824594 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:33:32.824594 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:33:32.824594 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:33:32.824594 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:33:32.824594 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:33:32.825612 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 14:33:32.825612 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 14:33:32.825612 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:33:32.825612 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:33:32.825612 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 609/1215] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:33:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:33:32.830529 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d777fe-ab7b-498d-b633-659fafe0d355 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:33:32.890822 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:33:32.927825 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d777fe-ab7b-498d-b633-659fafe0d355 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:33:32.960572 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898af2a0-91c7-4ca8-b7d1-1c33bf32db2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:33:32.961496 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898af2a0-91c7-4ca8-b7d1-1c33bf32db2f None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:33:32.962275 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898af2a0-91c7-4ca8-b7d1-1c33bf32db2f None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:33:32.962580 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898af2a0-91c7-4ca8-b7d1-1c33bf32db2f None admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:33:32.963336 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898af2a0-91c7-4ca8-b7d1-1c33bf32db2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:33:32.963645 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898af2a0-91c7-4ca8-b7d1-1c33bf32db2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:33:32.965082 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898af2a0-91c7-4ca8-b7d1-1c33bf32db2f None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:33:32.976152 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 607/1216] 10.222.0.15 () {56 vars in 1109 bytes} [Tue May 31 14:33:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:33:32.981700 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a504a2e3-0184-4688-a91c-594bd000f9a1 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:33:33.053656 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:33:33.089657 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a504a2e3-0184-4688-a91c-594bd000f9a1 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:33:33.121736 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7083c8cb-0cd0-4c54-85f7-f7f582b7ce84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:33:33.122508 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7083c8cb-0cd0-4c54-85f7-f7f582b7ce84 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:33:33.122825 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7083c8cb-0cd0-4c54-85f7-f7f582b7ce84 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:33:33.123097 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7083c8cb-0cd0-4c54-85f7-f7f582b7ce84 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:33:33.130222 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7083c8cb-0cd0-4c54-85f7-f7f582b7ce84 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:33:33.135260 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7083c8cb-0cd0-4c54-85f7-f7f582b7ce84 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:33:33.146703 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-7083c8cb-0cd0-4c54-85f7-f7f582b7ce84 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 14:33:33.146703 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:33:33.146703 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:33:33.146703 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:33:33.146703 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:33:33.146703 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:33:33.146703 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:33:33.146703 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:33:33.146703 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:33:33.146703 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:33:33.146703 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:33:33.146703 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:33:33.146703 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 14:33:33.146703 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 14:33:33.146703 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 14:33:33.147858 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 14:33:33.147858 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:33:33.147858 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:33:33.147858 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:33:33.147858 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:33:33.147858 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:33:33.147858 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:33:33.147858 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:33:33.147858 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:33:33.147858 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:33:33.147858 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:33:33.147858 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:33:33.147858 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:33:33.147858 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:33:33.147858 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:33:33.147858 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:33:33.147858 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:33:33.149068 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 14:33:33.149068 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 14:33:33.149068 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 14:33:33.149068 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 14:33:33.149068 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 14:33:33.149068 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 14:33:33.149068 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 14:33:33.149068 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:33:33.149068 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 610/1217] 10.222.0.15 () {56 vars in 1111 bytes} [Tue May 31 14:33:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:33:33.153697 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898af2a0-91c7-4ca8-b7d1-1c33bf32db2f None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:33:33.253115 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898af2a0-91c7-4ca8-b7d1-1c33bf32db2f None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:33:33.275197 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:33:33.286953 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42940e11-36eb-45fd-8e36-d1bdfe80126b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:33:33.287615 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42940e11-36eb-45fd-8e36-d1bdfe80126b None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:33:33.287896 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42940e11-36eb-45fd-8e36-d1bdfe80126b None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:33:33.288196 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42940e11-36eb-45fd-8e36-d1bdfe80126b None admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:33:33.288965 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42940e11-36eb-45fd-8e36-d1bdfe80126b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:33:33.289322 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42940e11-36eb-45fd-8e36-d1bdfe80126b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:33:33.290818 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42940e11-36eb-45fd-8e36-d1bdfe80126b None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:33:33.304116 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 608/1218] 10.222.0.15 () {56 vars in 1148 bytes} [Tue May 31 14:33:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:33:33.310137 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7083c8cb-0cd0-4c54-85f7-f7f582b7ce84 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:33:33.408514 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7083c8cb-0cd0-4c54-85f7-f7f582b7ce84 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:33:33.436261 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:33:33.442439 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126fbb35-9a1e-43fc-b618-cae9cb263667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:33:33.443116 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126fbb35-9a1e-43fc-b618-cae9cb263667 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:33:33.443396 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126fbb35-9a1e-43fc-b618-cae9cb263667 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:33:33.443674 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126fbb35-9a1e-43fc-b618-cae9cb263667 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:33:33.444490 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126fbb35-9a1e-43fc-b618-cae9cb263667 None admin] RBAC: Adding query filter params (role.id=4fa2a9add9bc4786a62e7b5cae3cc051, scope.project.id=ffff4334538649fdba1beb80cad207fa, user.id=efc959ca520c4816b5ff7f95655e53e1) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:33:33.444803 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126fbb35-9a1e-43fc-b618-cae9cb263667 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:33:33.446225 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126fbb35-9a1e-43fc-b618-cae9cb263667 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:33:33.451475 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 611/1219] 10.222.0.15 () {56 vars in 1374 bytes} [Tue May 31 14:33:33 2022] GET /identity/v3/role_assignments?user.id=efc959ca520c4816b5ff7f95655e53e1&scope.project.id=ffff4334538649fdba1beb80cad207fa&role.id=4fa2a9add9bc4786a62e7b5cae3cc051 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:33:35.681514 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00181cb6-5820-4286-a51d-73ef8c254772 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:33:35.682017 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00181cb6-5820-4286-a51d-73ef8c254772 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:33:35.682017 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00181cb6-5820-4286-a51d-73ef8c254772 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:33:35.683434 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 609/1220] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:33:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:33:35.688523 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a49c9b4-c3c0-4798-b1fc-02de13b01662 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:33:35.688966 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a49c9b4-c3c0-4798-b1fc-02de13b01662 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:33:35.689077 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a49c9b4-c3c0-4798-b1fc-02de13b01662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:33:35.705890 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-4a49c9b4-c3c0-4798-b1fc-02de13b01662 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:33:35.707449 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-4a49c9b4-c3c0-4798-b1fc-02de13b01662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:33:35.776301 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 612/1221] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:33:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 14:33:35.799319 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00181cb6-5820-4286-a51d-73ef8c254772 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:33:35.897965 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00181cb6-5820-4286-a51d-73ef8c254772 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:33:35.930880 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8305eee4-8192-4a39-af46-95727869326c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:33:35.931708 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8305eee4-8192-4a39-af46-95727869326c None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:33:35.931941 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8305eee4-8192-4a39-af46-95727869326c None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:33:35.932214 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8305eee4-8192-4a39-af46-95727869326c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:33:35.941866 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8305eee4-8192-4a39-af46-95727869326c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 14:33:35.949583 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-8305eee4-8192-4a39-af46-95727869326c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 31 14:33:35.949583 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:33:35.949583 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:33:35.949583 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:33:35.949583 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:33:35.949583 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:33:35.949583 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:33:35.949583 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:33:35.949583 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:33:35.949583 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:33:35.949583 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:33:35.949583 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:33:35.949583 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 14:33:35.949583 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 14:33:35.949583 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 14:33:35.949583 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 14:33:35.950999 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 14:33:35.950999 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 14:33:35.950999 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 14:33:35.950999 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 14:33:35.950999 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:33:35.950999 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:33:35.950999 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:33:35.950999 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:33:35.950999 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:33:35.950999 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:33:35.950999 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:33:35.950999 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:33:35.950999 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:33:35.950999 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:33:35.950999 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:33:35.950999 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:33:35.951869 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:33:35.951869 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:33:35.951869 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:33:35.951869 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:33:35.951869 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 14:33:35.951869 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 14:33:35.951869 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 14:33:35.951869 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 14:33:35.951869 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 14:33:35.951869 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 14:33:35.951869 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 31 14:33:35.951869 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:33:35.951869 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 610/1222] 10.222.0.15 () {56 vars in 1102 bytes} [Tue May 31 14:33:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:33:35.956849 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a49c9b4-c3c0-4798-b1fc-02de13b01662 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:33:36.052430 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a49c9b4-c3c0-4798-b1fc-02de13b01662 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:33:36.074647 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:33:36.085046 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4e6e6f-af2f-406f-8a4e-3eb32ab4a849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:33:36.085719 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e6e6f-af2f-406f-8a4e-3eb32ab4a849 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:33:36.086007 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e6e6f-af2f-406f-8a4e-3eb32ab4a849 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:33:36.086286 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e6e6f-af2f-406f-8a4e-3eb32ab4a849 None admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:33:36.087060 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4e6e6f-af2f-406f-8a4e-3eb32ab4a849 None admin] RBAC: Adding query filter params (name=service) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:33:36.087371 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4e6e6f-af2f-406f-8a4e-3eb32ab4a849 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:33:36.088800 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4e6e6f-af2f-406f-8a4e-3eb32ab4a849 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:33:36.096467 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 613/1223] 10.222.0.15 () {56 vars in 1103 bytes} [Tue May 31 14:33:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:33:36.103102 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8305eee4-8192-4a39-af46-95727869326c None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:33:36.144583 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:33:36.199977 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8305eee4-8192-4a39-af46-95727869326c None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:33:36.232180 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a7c181-c182-43fc-9a86-94dba2b62957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:33:36.232956 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a7c181-c182-43fc-9a86-94dba2b62957 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:33:36.233237 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a7c181-c182-43fc-9a86-94dba2b62957 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:33:36.233534 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a7c181-c182-43fc-9a86-94dba2b62957 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:33:36.243654 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a7c181-c182-43fc-9a86-94dba2b62957 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:33:36.245080 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a7c181-c182-43fc-9a86-94dba2b62957 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:33:36.261637 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-29a7c181-c182-43fc-9a86-94dba2b62957 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:33:36.261637 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:33:36.261637 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:33:36.261637 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:33:36.261637 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:33:36.261637 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:33:36.261637 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:33:36.261637 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:33:36.261637 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:33:36.261637 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:33:36.261637 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:33:36.261637 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:33:36.261637 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 14:33:36.261637 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 14:33:36.261637 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 14:33:36.262730 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 14:33:36.262730 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:33:36.262730 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:33:36.262730 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:33:36.262730 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:33:36.262730 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:33:36.262730 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:33:36.262730 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:33:36.262730 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:33:36.262730 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:33:36.262730 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:33:36.262730 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:33:36.262730 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:33:36.262730 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:33:36.262730 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:33:36.262730 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:33:36.262730 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:33:36.263964 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 14:33:36.263964 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 14:33:36.263964 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:33:36.263964 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:33:36.263964 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 611/1224] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:33:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:33:36.268588 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4e6e6f-af2f-406f-8a4e-3eb32ab4a849 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:33:36.366136 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4e6e6f-af2f-406f-8a4e-3eb32ab4a849 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:33:36.398101 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a18136a-49ac-4576-aff9-6c1d1d754de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:33:36.398770 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a18136a-49ac-4576-aff9-6c1d1d754de8 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:33:36.399051 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a18136a-49ac-4576-aff9-6c1d1d754de8 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:33:36.399326 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a18136a-49ac-4576-aff9-6c1d1d754de8 None admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:33:36.400042 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a18136a-49ac-4576-aff9-6c1d1d754de8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:33:36.400362 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a18136a-49ac-4576-aff9-6c1d1d754de8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:33:36.401686 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a18136a-49ac-4576-aff9-6c1d1d754de8 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:33:36.413637 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 614/1225] 10.222.0.15 () {56 vars in 1109 bytes} [Tue May 31 14:33:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 14:33:36.419317 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a7c181-c182-43fc-9a86-94dba2b62957 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:33:36.510179 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:33:36.516497 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a7c181-c182-43fc-9a86-94dba2b62957 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:33:36.551466 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4955f1-fe98-4d67-b550-c16dcfe3e45f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:33:36.552254 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4955f1-fe98-4d67-b550-c16dcfe3e45f None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:33:36.552541 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4955f1-fe98-4d67-b550-c16dcfe3e45f None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:33:36.552822 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4955f1-fe98-4d67-b550-c16dcfe3e45f None admin] PATH_INFO: `/v3/users/placement` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:33:36.560037 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4955f1-fe98-4d67-b550-c16dcfe3e45f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:33:36.561501 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4955f1-fe98-4d67-b550-c16dcfe3e45f None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:33:36.575399 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-4d4955f1-fe98-4d67-b550-c16dcfe3e45f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 31 14:33:36.575399 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:33:36.575399 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:33:36.575399 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:33:36.575399 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:33:36.575399 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:33:36.575399 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:33:36.575399 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:33:36.575399 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:33:36.575399 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:33:36.575399 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:33:36.575399 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:33:36.575399 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 14:33:36.575399 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 14:33:36.575399 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 14:33:36.575399 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 14:33:36.576372 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:33:36.576372 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:33:36.576372 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 14:33:36.576372 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 14:33:36.576372 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 14:33:36.576372 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 14:33:36.576372 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:33:36.576372 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:33:36.576372 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:33:36.576372 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:33:36.576372 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:33:36.576372 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:33:36.576372 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:33:36.576372 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:33:36.576372 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:33:36.576372 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:33:36.576372 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:33:36.576372 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:33:36.577359 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:33:36.577359 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:33:36.577359 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 14:33:36.577359 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 14:33:36.577359 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 14:33:36.577359 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 14:33:36.577359 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 14:33:36.577359 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 14:33:36.577359 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 31 14:33:36.577359 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:33:36.577359 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 612/1226] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:33:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:33:36.583018 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a18136a-49ac-4576-aff9-6c1d1d754de8 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:33:36.629677 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:33:36.680242 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a18136a-49ac-4576-aff9-6c1d1d754de8 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:33:36.714481 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1a6248-3a32-4e90-8022-897a511f33c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:33:36.715183 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a6248-3a32-4e90-8022-897a511f33c3 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:33:36.715463 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a6248-3a32-4e90-8022-897a511f33c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:33:36.715740 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a6248-3a32-4e90-8022-897a511f33c3 None admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:33:36.716554 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1a6248-3a32-4e90-8022-897a511f33c3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:33:36.716862 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1a6248-3a32-4e90-8022-897a511f33c3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:33:36.718272 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1a6248-3a32-4e90-8022-897a511f33c3 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:33:36.735622 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 615/1227] 10.222.0.15 () {56 vars in 1143 bytes} [Tue May 31 14:33:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:33:36.740598 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4955f1-fe98-4d67-b550-c16dcfe3e45f None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:33:36.839841 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4955f1-fe98-4d67-b550-c16dcfe3e45f None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:33:36.872170 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfa432a-9859-4248-8486-0d4276c6fcd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:33:36.872960 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa432a-9859-4248-8486-0d4276c6fcd5 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:33:36.873272 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa432a-9859-4248-8486-0d4276c6fcd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:33:36.873578 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa432a-9859-4248-8486-0d4276c6fcd5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:33:36.884303 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfa432a-9859-4248-8486-0d4276c6fcd5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:33:36.885819 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfa432a-9859-4248-8486-0d4276c6fcd5 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:33:36.902985 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-8bfa432a-9859-4248-8486-0d4276c6fcd5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:33:36.902985 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:33:36.902985 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:33:36.902985 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:33:36.902985 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:33:36.902985 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:33:36.902985 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:33:36.902985 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:33:36.902985 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:33:36.902985 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:33:36.902985 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:33:36.902985 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:33:36.902985 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 14:33:36.902985 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 14:33:36.902985 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 14:33:36.904053 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 14:33:36.904053 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:33:36.904053 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:33:36.904053 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:33:36.904053 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:33:36.904053 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:33:36.904053 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:33:36.904053 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:33:36.904053 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:33:36.904053 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:33:36.904053 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:33:36.904053 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:33:36.904053 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:33:36.904053 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:33:36.904053 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:33:36.904053 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:33:36.904053 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:33:36.905157 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 14:33:36.905157 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 14:33:36.905157 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:33:36.905157 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:33:36.905157 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 613/1228] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:33:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:33:36.910233 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1a6248-3a32-4e90-8022-897a511f33c3 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:33:37.006090 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1a6248-3a32-4e90-8022-897a511f33c3 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:33:37.008374 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:33:37.038849 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1d4f99-3c29-4c74-9b02-e6392516bed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:33:37.039496 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d4f99-3c29-4c74-9b02-e6392516bed2 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:33:37.039776 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d4f99-3c29-4c74-9b02-e6392516bed2 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:33:37.040075 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d4f99-3c29-4c74-9b02-e6392516bed2 None admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:33:37.040779 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1d4f99-3c29-4c74-9b02-e6392516bed2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:33:37.041154 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1d4f99-3c29-4c74-9b02-e6392516bed2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:33:37.042464 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1d4f99-3c29-4c74-9b02-e6392516bed2 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:33:37.056381 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 616/1229] 10.222.0.15 () {56 vars in 1109 bytes} [Tue May 31 14:33:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:33:37.062264 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfa432a-9859-4248-8486-0d4276c6fcd5 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:33:37.073079 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:33:37.161378 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfa432a-9859-4248-8486-0d4276c6fcd5 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:33:37.194441 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1765fb7-add9-48a8-b1bf-7a6507de247f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:33:37.195261 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1765fb7-add9-48a8-b1bf-7a6507de247f None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:33:37.195549 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1765fb7-add9-48a8-b1bf-7a6507de247f None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:33:37.195877 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1765fb7-add9-48a8-b1bf-7a6507de247f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:33:37.202428 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1765fb7-add9-48a8-b1bf-7a6507de247f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:33:37.203804 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1765fb7-add9-48a8-b1bf-7a6507de247f None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:33:37.217972 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-a1765fb7-add9-48a8-b1bf-7a6507de247f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 14:33:37.217972 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:33:37.217972 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:33:37.217972 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:33:37.217972 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:33:37.217972 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:33:37.217972 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:33:37.217972 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:33:37.217972 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:33:37.217972 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:33:37.217972 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:33:37.217972 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:33:37.217972 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 14:33:37.217972 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 14:33:37.217972 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 14:33:37.219035 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 14:33:37.219035 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:33:37.219035 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:33:37.219035 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:33:37.219035 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:33:37.219035 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:33:37.219035 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:33:37.219035 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:33:37.219035 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:33:37.219035 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:33:37.219035 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:33:37.219035 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:33:37.219035 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:33:37.219035 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:33:37.219035 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:33:37.219035 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:33:37.219035 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:33:37.220036 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 14:33:37.220036 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 14:33:37.220036 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 14:33:37.220036 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 14:33:37.220036 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 14:33:37.220036 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 14:33:37.220036 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 14:33:37.220036 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:33:37.220036 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 614/1230] 10.222.0.15 () {56 vars in 1111 bytes} [Tue May 31 14:33:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:33:37.225042 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1d4f99-3c29-4c74-9b02-e6392516bed2 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:33:37.328654 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1d4f99-3c29-4c74-9b02-e6392516bed2 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:33:37.361256 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c43c7c1-5e5d-4087-8d94-234dd3635a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:33:37.361939 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43c7c1-5e5d-4087-8d94-234dd3635a7e None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:33:37.362223 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43c7c1-5e5d-4087-8d94-234dd3635a7e None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:33:37.362499 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43c7c1-5e5d-4087-8d94-234dd3635a7e None admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:33:37.364036 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c43c7c1-5e5d-4087-8d94-234dd3635a7e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:33:37.364343 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c43c7c1-5e5d-4087-8d94-234dd3635a7e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:33:37.365839 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c43c7c1-5e5d-4087-8d94-234dd3635a7e None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:33:37.377530 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 617/1231] 10.222.0.15 () {56 vars in 1148 bytes} [Tue May 31 14:33:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:33:37.383708 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1765fb7-add9-48a8-b1bf-7a6507de247f None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:33:37.448154 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:33:37.482523 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1765fb7-add9-48a8-b1bf-7a6507de247f None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:33:37.515518 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f137ba-2565-48d1-8033-8e6a5154fd06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:33:37.516422 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f137ba-2565-48d1-8033-8e6a5154fd06 None admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:33:37.516704 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f137ba-2565-48d1-8033-8e6a5154fd06 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:33:37.516977 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f137ba-2565-48d1-8033-8e6a5154fd06 None admin] PATH_INFO: `/v3/projects/ffff4334538649fdba1beb80cad207fa/users/efc959ca520c4816b5ff7f95655e53e1/roles/4fa2a9add9bc4786a62e7b5cae3cc051` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:33:37.531077 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f137ba-2565-48d1-8033-8e6a5154fd06 None admin] RBAC: Authorizing `identity:create_grant(project_id=ffff4334538649fdba1beb80cad207fa, user_id=efc959ca520c4816b5ff7f95655e53e1, role_id=4fa2a9add9bc4786a62e7b5cae3cc051)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:33:37.532506 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f137ba-2565-48d1-8033-8e6a5154fd06 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:33:37.621576 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 615/1232] 10.222.0.15 () {58 vars in 1439 bytes} [Tue May 31 14:33:37 2022] PUT /identity/v3/projects/ffff4334538649fdba1beb80cad207fa/users/efc959ca520c4816b5ff7f95655e53e1/roles/4fa2a9add9bc4786a62e7b5cae3cc051 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:33:39.847432 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb9910d-c7fd-4033-ab73-f9dd60780da9 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:33:39.848554 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb9910d-c7fd-4033-ab73-f9dd60780da9 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:33:39.848839 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb9910d-c7fd-4033-ab73-f9dd60780da9 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:33:39.850178 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 618/1233] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:33:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:33:39.855476 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ab8518-4d25-4c1f-957c-27aa333aa5b2 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:33:39.855912 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ab8518-4d25-4c1f-957c-27aa333aa5b2 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:33:39.856061 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ab8518-4d25-4c1f-957c-27aa333aa5b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:33:39.872406 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-33ab8518-4d25-4c1f-957c-27aa333aa5b2 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:33:39.873578 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-33ab8518-4d25-4c1f-957c-27aa333aa5b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:33:39.939210 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 616/1234] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:33:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 14:33:39.964045 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb9910d-c7fd-4033-ab73-f9dd60780da9 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:33:39.989049 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:33:40.062889 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb9910d-c7fd-4033-ab73-f9dd60780da9 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:33:40.095692 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94ea611-6302-4366-9091-8365d2323192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:33:40.096509 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94ea611-6302-4366-9091-8365d2323192 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:33:40.096818 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94ea611-6302-4366-9091-8365d2323192 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:33:40.097099 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94ea611-6302-4366-9091-8365d2323192 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:33:40.107675 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94ea611-6302-4366-9091-8365d2323192 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 14:33:40.115367 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-c94ea611-6302-4366-9091-8365d2323192 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 31 14:33:40.115367 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:33:40.115367 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:33:40.115367 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:33:40.115367 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:33:40.115367 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:33:40.115367 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:33:40.115367 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:33:40.115367 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:33:40.115367 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:33:40.115367 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:33:40.115367 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:33:40.115367 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 14:33:40.115367 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 14:33:40.115367 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 14:33:40.115367 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 14:33:40.116587 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 14:33:40.116587 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 14:33:40.116587 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 14:33:40.116587 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 14:33:40.116587 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:33:40.116587 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:33:40.116587 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:33:40.116587 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:33:40.116587 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:33:40.116587 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:33:40.116587 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:33:40.116587 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:33:40.116587 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:33:40.116587 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:33:40.116587 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:33:40.116587 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:33:40.117444 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:33:40.117444 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:33:40.117444 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:33:40.117444 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:33:40.117444 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 14:33:40.117444 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 14:33:40.117444 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 14:33:40.117444 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 14:33:40.117444 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 14:33:40.117444 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 14:33:40.117444 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 31 14:33:40.117444 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:33:40.117444 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 619/1235] 10.222.0.15 () {56 vars in 1102 bytes} [Tue May 31 14:33:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:33:40.122665 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ab8518-4d25-4c1f-957c-27aa333aa5b2 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:33:40.169893 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:33:40.221056 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ab8518-4d25-4c1f-957c-27aa333aa5b2 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:33:40.253450 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd8a608-d75e-42e8-a983-4822c157d3d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:33:40.254144 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd8a608-d75e-42e8-a983-4822c157d3d5 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:33:40.254446 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd8a608-d75e-42e8-a983-4822c157d3d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:33:40.254744 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd8a608-d75e-42e8-a983-4822c157d3d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:33:40.255481 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd8a608-d75e-42e8-a983-4822c157d3d5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:33:40.255899 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd8a608-d75e-42e8-a983-4822c157d3d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:33:40.257425 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd8a608-d75e-42e8-a983-4822c157d3d5 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:33:40.265771 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 617/1236] 10.222.0.15 () {56 vars in 1103 bytes} [Tue May 31 14:33:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:33:40.272222 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94ea611-6302-4366-9091-8365d2323192 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:33:40.355617 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:33:40.370421 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94ea611-6302-4366-9091-8365d2323192 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:33:40.404813 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9904e5-4206-40ba-bd26-0ba51b772350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:33:40.405828 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9904e5-4206-40ba-bd26-0ba51b772350 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:33:40.406104 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9904e5-4206-40ba-bd26-0ba51b772350 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:33:40.406377 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9904e5-4206-40ba-bd26-0ba51b772350 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:33:40.416022 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9904e5-4206-40ba-bd26-0ba51b772350 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:33:40.417440 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9904e5-4206-40ba-bd26-0ba51b772350 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:33:40.434360 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-8b9904e5-4206-40ba-bd26-0ba51b772350 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:33:40.434360 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:33:40.434360 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:33:40.434360 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:33:40.434360 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:33:40.434360 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:33:40.434360 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:33:40.434360 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:33:40.434360 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:33:40.434360 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:33:40.434360 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:33:40.434360 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:33:40.434360 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 14:33:40.434360 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 14:33:40.434360 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 14:33:40.439774 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 14:33:40.439774 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:33:40.439774 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:33:40.439774 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:33:40.439774 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:33:40.439774 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:33:40.439774 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:33:40.439774 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:33:40.439774 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:33:40.439774 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:33:40.439774 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:33:40.439774 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:33:40.439774 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:33:40.439774 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:33:40.439774 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:33:40.439774 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:33:40.439774 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:33:40.440907 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 14:33:40.440907 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 14:33:40.440907 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:33:40.440907 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:33:40.440907 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 620/1237] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:33:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:33:40.441911 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd8a608-d75e-42e8-a983-4822c157d3d5 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:33:40.538398 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd8a608-d75e-42e8-a983-4822c157d3d5 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:33:40.547193 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:33:40.570926 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafbc37f-7d0a-49f3-96ea-db26c2578e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:33:40.571576 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafbc37f-7d0a-49f3-96ea-db26c2578e18 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:33:40.571867 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafbc37f-7d0a-49f3-96ea-db26c2578e18 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:33:40.572153 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafbc37f-7d0a-49f3-96ea-db26c2578e18 None admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:33:40.572844 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafbc37f-7d0a-49f3-96ea-db26c2578e18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:33:40.573148 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafbc37f-7d0a-49f3-96ea-db26c2578e18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:33:40.574499 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafbc37f-7d0a-49f3-96ea-db26c2578e18 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:33:40.585866 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 618/1238] 10.222.0.15 () {56 vars in 1109 bytes} [Tue May 31 14:33:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:33:40.591531 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9904e5-4206-40ba-bd26-0ba51b772350 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:33:40.687084 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9904e5-4206-40ba-bd26-0ba51b772350 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:33:40.720015 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f3f2a7-9330-4517-87e8-f8d969efa71f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:33:40.720802 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f3f2a7-9330-4517-87e8-f8d969efa71f None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:33:40.721086 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f3f2a7-9330-4517-87e8-f8d969efa71f None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:33:40.721930 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f3f2a7-9330-4517-87e8-f8d969efa71f None admin] PATH_INFO: `/v3/users/placement` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:33:40.724241 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:33:40.728707 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f3f2a7-9330-4517-87e8-f8d969efa71f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:33:40.730127 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f3f2a7-9330-4517-87e8-f8d969efa71f None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:33:40.744841 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-77f3f2a7-9330-4517-87e8-f8d969efa71f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 31 14:33:40.744841 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:33:40.744841 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:33:40.744841 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:33:40.744841 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:33:40.744841 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:33:40.744841 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:33:40.744841 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:33:40.744841 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:33:40.744841 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:33:40.744841 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:33:40.744841 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:33:40.744841 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 14:33:40.744841 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 14:33:40.744841 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 14:33:40.744841 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 14:33:40.748649 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:33:40.748649 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:33:40.748649 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 14:33:40.748649 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 14:33:40.748649 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 14:33:40.748649 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 14:33:40.748649 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:33:40.748649 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:33:40.748649 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:33:40.748649 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:33:40.748649 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:33:40.748649 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:33:40.748649 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:33:40.748649 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:33:40.748649 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:33:40.748649 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:33:40.748649 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:33:40.748649 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:33:40.749887 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:33:40.749887 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:33:40.749887 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 14:33:40.749887 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 14:33:40.749887 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 14:33:40.749887 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 14:33:40.749887 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 14:33:40.749887 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 14:33:40.749887 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 31 14:33:40.749887 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:33:40.749887 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 621/1239] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:33:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:33:40.751733 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafbc37f-7d0a-49f3-96ea-db26c2578e18 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:33:40.853159 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafbc37f-7d0a-49f3-96ea-db26c2578e18 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:33:40.886917 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108692d1-3a29-4315-9540-644ec3eea23f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:33:40.887580 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108692d1-3a29-4315-9540-644ec3eea23f None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:33:40.887861 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108692d1-3a29-4315-9540-644ec3eea23f None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:33:40.888134 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108692d1-3a29-4315-9540-644ec3eea23f None admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:33:40.888960 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108692d1-3a29-4315-9540-644ec3eea23f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:33:40.889266 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108692d1-3a29-4315-9540-644ec3eea23f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:33:40.890732 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108692d1-3a29-4315-9540-644ec3eea23f None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:33:40.907664 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 619/1240] 10.222.0.15 () {56 vars in 1143 bytes} [Tue May 31 14:33:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:33:40.913465 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f3f2a7-9330-4517-87e8-f8d969efa71f None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:33:41.010734 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f3f2a7-9330-4517-87e8-f8d969efa71f None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:33:41.042943 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6082c78-6a98-4bc5-9563-351665c63119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:33:41.043575 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6082c78-6a98-4bc5-9563-351665c63119 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:33:41.043857 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6082c78-6a98-4bc5-9563-351665c63119 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:33:41.044133 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6082c78-6a98-4bc5-9563-351665c63119 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:33:41.103235 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:33:41.109533 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6082c78-6a98-4bc5-9563-351665c63119 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:33:41.111002 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6082c78-6a98-4bc5-9563-351665c63119 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:33:41.203270 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 622/1241] 10.222.0.15 () {58 vars in 1282 bytes} [Tue May 31 14:33:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 31 14:33:41.209037 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108692d1-3a29-4315-9540-644ec3eea23f None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:33:41.235950 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:33:41.307051 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108692d1-3a29-4315-9540-644ec3eea23f None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:33:41.341233 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9dcd63-4612-403b-bcca-d0f68d1258e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:33:41.342038 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9dcd63-4612-403b-bcca-d0f68d1258e8 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:33:41.342317 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9dcd63-4612-403b-bcca-d0f68d1258e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:33:41.342619 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9dcd63-4612-403b-bcca-d0f68d1258e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:33:41.353049 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9dcd63-4612-403b-bcca-d0f68d1258e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:33:41.354504 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9dcd63-4612-403b-bcca-d0f68d1258e8 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:33:41.372229 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-ad9dcd63-4612-403b-bcca-d0f68d1258e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:33:41.372229 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:33:41.372229 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:33:41.372229 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:33:41.372229 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:33:41.372229 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:33:41.372229 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:33:41.372229 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:33:41.372229 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:33:41.372229 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:33:41.372229 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:33:41.372229 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:33:41.372229 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 14:33:41.372229 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 14:33:41.372229 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 14:33:41.380277 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 14:33:41.380277 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:33:41.380277 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:33:41.380277 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:33:41.380277 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:33:41.380277 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:33:41.380277 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:33:41.380277 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:33:41.380277 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:33:41.380277 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:33:41.380277 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:33:41.380277 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:33:41.380277 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:33:41.380277 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:33:41.380277 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:33:41.380277 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:33:41.380277 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:33:41.381430 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 14:33:41.381430 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 14:33:41.381430 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:33:41.381430 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:33:41.381430 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 620/1242] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:33:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:33:41.381891 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6082c78-6a98-4bc5-9563-351665c63119 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:33:41.469758 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:33:41.475956 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6082c78-6a98-4bc5-9563-351665c63119 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:33:41.508568 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b0aa75-a3e1-47d9-ab0f-4b687d10f05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:33:41.509224 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b0aa75-a3e1-47d9-ab0f-4b687d10f05d None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:33:41.509509 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b0aa75-a3e1-47d9-ab0f-4b687d10f05d None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:33:41.509788 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b0aa75-a3e1-47d9-ab0f-4b687d10f05d None admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:33:41.510570 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b0aa75-a3e1-47d9-ab0f-4b687d10f05d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:33:41.510889 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b0aa75-a3e1-47d9-ab0f-4b687d10f05d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:33:41.512248 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b0aa75-a3e1-47d9-ab0f-4b687d10f05d None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:33:41.524305 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 623/1243] 10.222.0.15 () {56 vars in 1109 bytes} [Tue May 31 14:33:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:33:41.529895 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9dcd63-4612-403b-bcca-d0f68d1258e8 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:33:41.606284 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:33:41.626303 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9dcd63-4612-403b-bcca-d0f68d1258e8 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:33:41.659918 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e7a9d5-e6b7-4d31-817a-f16ef885aa65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:33:41.661245 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e7a9d5-e6b7-4d31-817a-f16ef885aa65 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:33:41.661557 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e7a9d5-e6b7-4d31-817a-f16ef885aa65 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:33:41.661815 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e7a9d5-e6b7-4d31-817a-f16ef885aa65 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:33:41.668357 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e7a9d5-e6b7-4d31-817a-f16ef885aa65 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:33:41.669797 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e7a9d5-e6b7-4d31-817a-f16ef885aa65 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:33:41.683266 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-57e7a9d5-e6b7-4d31-817a-f16ef885aa65 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 14:33:41.683266 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:33:41.683266 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:33:41.683266 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:33:41.683266 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:33:41.683266 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:33:41.683266 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:33:41.683266 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:33:41.683266 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:33:41.683266 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:33:41.683266 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:33:41.683266 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:33:41.683266 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 14:33:41.683266 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 14:33:41.683266 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 14:33:41.684265 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 14:33:41.684265 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:33:41.684265 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:33:41.684265 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:33:41.684265 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:33:41.684265 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:33:41.684265 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:33:41.684265 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:33:41.684265 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:33:41.684265 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:33:41.684265 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:33:41.684265 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:33:41.684265 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:33:41.684265 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:33:41.684265 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:33:41.684265 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:33:41.684265 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:33:41.685161 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 14:33:41.685161 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 14:33:41.685161 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 14:33:41.685161 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 14:33:41.685161 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 14:33:41.685161 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 14:33:41.685161 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 14:33:41.685161 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:33:41.685161 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 621/1244] 10.222.0.15 () {56 vars in 1111 bytes} [Tue May 31 14:33:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:33:41.690270 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b0aa75-a3e1-47d9-ab0f-4b687d10f05d None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:33:41.790245 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b0aa75-a3e1-47d9-ab0f-4b687d10f05d None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:33:41.822084 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6c997a-0520-4317-8e2c-c8a984055df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:33:41.822765 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6c997a-0520-4317-8e2c-c8a984055df5 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:33:41.823054 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6c997a-0520-4317-8e2c-c8a984055df5 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:33:41.823329 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6c997a-0520-4317-8e2c-c8a984055df5 None admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:33:41.824100 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6c997a-0520-4317-8e2c-c8a984055df5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:33:41.824409 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6c997a-0520-4317-8e2c-c8a984055df5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:33:41.825834 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6c997a-0520-4317-8e2c-c8a984055df5 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:33:41.838101 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 624/1245] 10.222.0.15 () {56 vars in 1148 bytes} [Tue May 31 14:33:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:33:41.844109 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e7a9d5-e6b7-4d31-817a-f16ef885aa65 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:33:41.940834 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e7a9d5-e6b7-4d31-817a-f16ef885aa65 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:33:41.973609 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeff36db-5e0c-4362-bdab-b8417792d59d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:33:41.974257 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeff36db-5e0c-4362-bdab-b8417792d59d None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:33:41.974544 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeff36db-5e0c-4362-bdab-b8417792d59d None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:33:41.974852 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeff36db-5e0c-4362-bdab-b8417792d59d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:33:41.975712 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeff36db-5e0c-4362-bdab-b8417792d59d None admin] RBAC: Adding query filter params (role.id=4fa2a9add9bc4786a62e7b5cae3cc051, scope.project.id=ffff4334538649fdba1beb80cad207fa, user.id=efc959ca520c4816b5ff7f95655e53e1) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:33:41.976028 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeff36db-5e0c-4362-bdab-b8417792d59d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:33:41.977461 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeff36db-5e0c-4362-bdab-b8417792d59d None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:33:41.983247 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 622/1246] 10.222.0.15 () {56 vars in 1374 bytes} [Tue May 31 14:33:41 2022] GET /identity/v3/role_assignments?user.id=efc959ca520c4816b5ff7f95655e53e1&scope.project.id=ffff4334538649fdba1beb80cad207fa&role.id=4fa2a9add9bc4786a62e7b5cae3cc051 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:33:44.264811 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82023f0-d698-49ee-881f-281ee829fc7d None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:33:44.265342 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82023f0-d698-49ee-881f-281ee829fc7d None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:33:44.265342 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82023f0-d698-49ee-881f-281ee829fc7d None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:33:44.266742 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 625/1247] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:33:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:33:44.272723 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0553a3c-8a8b-4e5f-ae10-2993c994231e None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:33:44.273128 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0553a3c-8a8b-4e5f-ae10-2993c994231e None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:33:44.273297 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0553a3c-8a8b-4e5f-ae10-2993c994231e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:33:44.278347 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:33:44.290920 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-f0553a3c-8a8b-4e5f-ae10-2993c994231e None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:33:44.292093 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-f0553a3c-8a8b-4e5f-ae10-2993c994231e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:33:44.358000 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 623/1248] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:33:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 14:33:44.381964 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82023f0-d698-49ee-881f-281ee829fc7d None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:33:44.400139 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:33:44.478452 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82023f0-d698-49ee-881f-281ee829fc7d None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:33:44.511851 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9136897a-85f3-4a63-a277-4c9d537bb357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:33:44.512628 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9136897a-85f3-4a63-a277-4c9d537bb357 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:33:44.512909 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9136897a-85f3-4a63-a277-4c9d537bb357 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:33:44.513183 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9136897a-85f3-4a63-a277-4c9d537bb357 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:33:44.523303 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9136897a-85f3-4a63-a277-4c9d537bb357 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 14:33:44.531037 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-9136897a-85f3-4a63-a277-4c9d537bb357 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 31 14:33:44.531037 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:33:44.531037 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:33:44.531037 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:33:44.531037 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:33:44.531037 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:33:44.531037 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:33:44.531037 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:33:44.531037 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:33:44.531037 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:33:44.531037 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:33:44.531037 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:33:44.531037 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 14:33:44.531037 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 14:33:44.531037 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 14:33:44.531037 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 14:33:44.532139 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 14:33:44.532139 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 14:33:44.532139 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 14:33:44.532139 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 14:33:44.532139 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:33:44.532139 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:33:44.532139 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:33:44.532139 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:33:44.532139 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:33:44.532139 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:33:44.532139 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:33:44.532139 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:33:44.532139 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:33:44.532139 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:33:44.532139 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:33:44.532139 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:33:44.533126 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:33:44.533126 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:33:44.533126 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:33:44.533126 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:33:44.533126 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 14:33:44.533126 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 14:33:44.533126 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 14:33:44.533126 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 14:33:44.533126 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 14:33:44.533126 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 14:33:44.533126 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 31 14:33:44.533126 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:33:44.533126 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 626/1249] 10.222.0.15 () {56 vars in 1096 bytes} [Tue May 31 14:33:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:33:44.538160 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0553a3c-8a8b-4e5f-ae10-2993c994231e None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:33:44.636848 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0553a3c-8a8b-4e5f-ae10-2993c994231e None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:33:44.665044 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:33:44.669799 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9973bfaa-de5d-4f03-8916-e52e1fe31579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:33:44.670469 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9973bfaa-de5d-4f03-8916-e52e1fe31579 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:33:44.670793 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9973bfaa-de5d-4f03-8916-e52e1fe31579 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:33:44.671073 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9973bfaa-de5d-4f03-8916-e52e1fe31579 None admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:33:44.671817 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9973bfaa-de5d-4f03-8916-e52e1fe31579 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:33:44.672137 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9973bfaa-de5d-4f03-8916-e52e1fe31579 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:33:44.673500 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9973bfaa-de5d-4f03-8916-e52e1fe31579 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:33:44.681873 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 624/1250] 10.222.0.15 () {56 vars in 1099 bytes} [Tue May 31 14:33:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 14:33:44.687617 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9136897a-85f3-4a63-a277-4c9d537bb357 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:33:44.766187 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:33:44.787552 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9136897a-85f3-4a63-a277-4c9d537bb357 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:33:44.819559 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb427827-5d0f-4ed5-844c-47eb76e02125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:33:44.820374 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb427827-5d0f-4ed5-844c-47eb76e02125 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:33:44.820655 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb427827-5d0f-4ed5-844c-47eb76e02125 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:33:44.820956 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb427827-5d0f-4ed5-844c-47eb76e02125 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:33:44.831803 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb427827-5d0f-4ed5-844c-47eb76e02125 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:33:44.833346 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb427827-5d0f-4ed5-844c-47eb76e02125 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:33:44.850668 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-fb427827-5d0f-4ed5-844c-47eb76e02125 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:33:44.850668 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:33:44.850668 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:33:44.850668 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:33:44.850668 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:33:44.850668 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:33:44.850668 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:33:44.850668 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:33:44.850668 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:33:44.850668 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:33:44.850668 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:33:44.850668 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:33:44.850668 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 14:33:44.850668 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 14:33:44.850668 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 14:33:44.851733 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 14:33:44.851733 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:33:44.851733 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:33:44.851733 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:33:44.851733 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:33:44.851733 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:33:44.851733 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:33:44.851733 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:33:44.851733 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:33:44.851733 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:33:44.851733 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:33:44.851733 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:33:44.851733 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:33:44.851733 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:33:44.851733 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:33:44.851733 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:33:44.851733 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:33:44.852714 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 14:33:44.852714 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 14:33:44.852714 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:33:44.852714 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:33:44.854715 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 627/1251] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:33:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:33:44.857580 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9973bfaa-de5d-4f03-8916-e52e1fe31579 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:33:44.954908 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9973bfaa-de5d-4f03-8916-e52e1fe31579 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:33:44.987606 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9413ced4-7067-4cf3-a019-7d28b1e484f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:33:44.988846 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9413ced4-7067-4cf3-a019-7d28b1e484f0 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:33:44.989116 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9413ced4-7067-4cf3-a019-7d28b1e484f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:33:44.989401 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9413ced4-7067-4cf3-a019-7d28b1e484f0 None admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:33:44.990101 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9413ced4-7067-4cf3-a019-7d28b1e484f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:33:44.990402 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9413ced4-7067-4cf3-a019-7d28b1e484f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:33:44.991888 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9413ced4-7067-4cf3-a019-7d28b1e484f0 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:33:45.003285 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 625/1252] 10.222.0.15 () {56 vars in 1109 bytes} [Tue May 31 14:33:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:33:45.008923 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb427827-5d0f-4ed5-844c-47eb76e02125 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:33:45.104987 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb427827-5d0f-4ed5-844c-47eb76e02125 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:33:45.130840 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:33:45.138518 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d29a5e-f964-471a-b4d9-35ccb50f1a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:33:45.139342 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d29a5e-f964-471a-b4d9-35ccb50f1a73 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:33:45.139630 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d29a5e-f964-471a-b4d9-35ccb50f1a73 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:33:45.139908 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d29a5e-f964-471a-b4d9-35ccb50f1a73 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:33:45.147129 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d29a5e-f964-471a-b4d9-35ccb50f1a73 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:33:45.148608 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d29a5e-f964-471a-b4d9-35ccb50f1a73 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:33:45.163266 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-60d29a5e-f964-471a-b4d9-35ccb50f1a73 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 31 14:33:45.163266 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:33:45.163266 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:33:45.163266 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:33:45.163266 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:33:45.163266 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:33:45.163266 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:33:45.163266 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:33:45.163266 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:33:45.163266 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:33:45.163266 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:33:45.163266 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:33:45.163266 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 14:33:45.163266 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 14:33:45.163266 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 14:33:45.163266 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 14:33:45.165110 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:33:45.165110 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:33:45.165110 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 14:33:45.165110 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 14:33:45.165110 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 14:33:45.165110 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 14:33:45.165110 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:33:45.165110 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:33:45.165110 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:33:45.165110 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:33:45.165110 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:33:45.165110 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:33:45.165110 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:33:45.165110 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:33:45.165110 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:33:45.165110 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:33:45.165110 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:33:45.165110 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:33:45.166297 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:33:45.166297 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:33:45.166297 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 14:33:45.166297 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 14:33:45.166297 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 14:33:45.166297 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 14:33:45.166297 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 14:33:45.166297 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 14:33:45.166297 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 31 14:33:45.166297 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:33:45.166297 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 628/1253] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:33:45 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:33:45.170277 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9413ced4-7067-4cf3-a019-7d28b1e484f0 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:33:45.224789 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:33:45.267076 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9413ced4-7067-4cf3-a019-7d28b1e484f0 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:33:45.301125 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee38ace-2489-4742-9ee2-856e09cc07cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:33:45.301804 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee38ace-2489-4742-9ee2-856e09cc07cb None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:33:45.302089 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee38ace-2489-4742-9ee2-856e09cc07cb None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:33:45.302407 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee38ace-2489-4742-9ee2-856e09cc07cb None admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:33:45.303270 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee38ace-2489-4742-9ee2-856e09cc07cb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:33:45.303582 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee38ace-2489-4742-9ee2-856e09cc07cb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:33:45.305014 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee38ace-2489-4742-9ee2-856e09cc07cb None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:33:45.324533 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 626/1254] 10.222.0.15 () {56 vars in 1143 bytes} [Tue May 31 14:33:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:33:45.330527 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d29a5e-f964-471a-b4d9-35ccb50f1a73 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:33:45.444978 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d29a5e-f964-471a-b4d9-35ccb50f1a73 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:33:45.480011 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490770b6-3651-4df6-9789-0878b5a18425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:33:45.480703 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490770b6-3651-4df6-9789-0878b5a18425 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:33:45.480985 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490770b6-3651-4df6-9789-0878b5a18425 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:33:45.481258 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490770b6-3651-4df6-9789-0878b5a18425 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:33:45.537507 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:33:45.549891 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490770b6-3651-4df6-9789-0878b5a18425 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:33:45.551375 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490770b6-3651-4df6-9789-0878b5a18425 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:33:45.649979 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 629/1255] 10.222.0.15 () {58 vars in 1282 bytes} [Tue May 31 14:33:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 31 14:33:45.656081 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee38ace-2489-4742-9ee2-856e09cc07cb None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:33:45.751907 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee38ace-2489-4742-9ee2-856e09cc07cb None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:33:45.764361 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:33:45.784297 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa313d8-79b3-4462-b1e9-323312054095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:33:45.785606 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa313d8-79b3-4462-b1e9-323312054095 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:33:45.785900 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa313d8-79b3-4462-b1e9-323312054095 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:33:45.786177 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa313d8-79b3-4462-b1e9-323312054095 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:33:45.795749 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa313d8-79b3-4462-b1e9-323312054095 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:33:45.797184 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa313d8-79b3-4462-b1e9-323312054095 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:33:45.814600 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-bfa313d8-79b3-4462-b1e9-323312054095 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:33:45.814600 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:33:45.814600 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:33:45.814600 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:33:45.814600 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:33:45.814600 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:33:45.814600 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:33:45.814600 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:33:45.814600 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:33:45.814600 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:33:45.814600 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:33:45.814600 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:33:45.814600 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 14:33:45.814600 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 14:33:45.814600 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 14:33:45.815584 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 14:33:45.815584 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:33:45.815584 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:33:45.815584 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:33:45.815584 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:33:45.815584 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:33:45.815584 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:33:45.815584 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:33:45.815584 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:33:45.815584 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:33:45.815584 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:33:45.815584 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:33:45.815584 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:33:45.815584 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:33:45.815584 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:33:45.815584 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:33:45.815584 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:33:45.816484 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 14:33:45.816484 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 14:33:45.816484 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:33:45.816484 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:33:45.816484 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 627/1256] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:33:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:33:45.821523 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490770b6-3651-4df6-9789-0878b5a18425 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:33:45.905365 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:33:45.917368 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490770b6-3651-4df6-9789-0878b5a18425 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:33:45.951108 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb0d74e-bf91-4bcd-8d85-90ac23dacef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:33:45.951757 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb0d74e-bf91-4bcd-8d85-90ac23dacef1 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:33:45.952040 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb0d74e-bf91-4bcd-8d85-90ac23dacef1 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:33:45.952317 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb0d74e-bf91-4bcd-8d85-90ac23dacef1 None admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:33:45.953022 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb0d74e-bf91-4bcd-8d85-90ac23dacef1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:33:45.953340 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb0d74e-bf91-4bcd-8d85-90ac23dacef1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:33:45.954712 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb0d74e-bf91-4bcd-8d85-90ac23dacef1 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:33:45.965957 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 630/1257] 10.222.0.15 () {56 vars in 1109 bytes} [Tue May 31 14:33:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:33:45.971532 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa313d8-79b3-4462-b1e9-323312054095 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:33:46.078875 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa313d8-79b3-4462-b1e9-323312054095 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:33:46.112920 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e5bff6-04e2-4a50-8311-64b161cca610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:33:46.113730 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e5bff6-04e2-4a50-8311-64b161cca610 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:33:46.114009 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e5bff6-04e2-4a50-8311-64b161cca610 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:33:46.114282 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e5bff6-04e2-4a50-8311-64b161cca610 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:33:46.121310 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e5bff6-04e2-4a50-8311-64b161cca610 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:33:46.122786 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e5bff6-04e2-4a50-8311-64b161cca610 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:33:46.136252 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-82e5bff6-04e2-4a50-8311-64b161cca610 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 14:33:46.136252 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:33:46.136252 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:33:46.136252 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:33:46.136252 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:33:46.136252 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:33:46.136252 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:33:46.136252 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:33:46.136252 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:33:46.136252 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:33:46.136252 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:33:46.136252 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:33:46.136252 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 14:33:46.136252 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 14:33:46.136252 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 14:33:46.137369 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 14:33:46.137369 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:33:46.137369 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:33:46.137369 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:33:46.137369 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:33:46.137369 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:33:46.137369 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:33:46.137369 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:33:46.137369 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:33:46.137369 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:33:46.137369 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:33:46.137369 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:33:46.137369 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:33:46.137369 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:33:46.137369 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:33:46.137369 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:33:46.137369 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:33:46.138704 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 14:33:46.138704 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 14:33:46.138704 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 14:33:46.138704 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 14:33:46.138704 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 14:33:46.138704 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 14:33:46.138704 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 14:33:46.138704 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:33:46.138704 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 628/1258] 10.222.0.15 () {56 vars in 1111 bytes} [Tue May 31 14:33:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:33:46.143330 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb0d74e-bf91-4bcd-8d85-90ac23dacef1 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:33:46.241174 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb0d74e-bf91-4bcd-8d85-90ac23dacef1 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:33:46.273374 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45dfccc-1ac4-42ec-bd9c-6da9ae066581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:33:46.274018 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45dfccc-1ac4-42ec-bd9c-6da9ae066581 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:33:46.274296 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45dfccc-1ac4-42ec-bd9c-6da9ae066581 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:33:46.274587 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45dfccc-1ac4-42ec-bd9c-6da9ae066581 None admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:33:46.275354 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45dfccc-1ac4-42ec-bd9c-6da9ae066581 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:33:46.275668 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45dfccc-1ac4-42ec-bd9c-6da9ae066581 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:33:46.277127 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45dfccc-1ac4-42ec-bd9c-6da9ae066581 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:33:46.289655 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 631/1259] 10.222.0.15 () {56 vars in 1148 bytes} [Tue May 31 14:33:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:33:46.295676 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e5bff6-04e2-4a50-8311-64b161cca610 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:33:46.321017 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:33:46.394276 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e5bff6-04e2-4a50-8311-64b161cca610 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:33:46.436175 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a7a4ad-ce0a-4423-9125-1b5597645b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:33:46.436932 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a7a4ad-ce0a-4423-9125-1b5597645b65 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:33:46.437198 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a7a4ad-ce0a-4423-9125-1b5597645b65 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:33:46.437472 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a7a4ad-ce0a-4423-9125-1b5597645b65 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:33:46.439344 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a7a4ad-ce0a-4423-9125-1b5597645b65 None admin] RBAC: Adding query filter params (role.id=76c53e2c353644f885028a0226c06146, scope.project.id=ffff4334538649fdba1beb80cad207fa, user.id=efc959ca520c4816b5ff7f95655e53e1) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:33:46.439665 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a7a4ad-ce0a-4423-9125-1b5597645b65 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:33:46.441081 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a7a4ad-ce0a-4423-9125-1b5597645b65 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:33:46.448542 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 629/1260] 10.222.0.15 () {56 vars in 1374 bytes} [Tue May 31 14:33:46 2022] GET /identity/v3/role_assignments?user.id=efc959ca520c4816b5ff7f95655e53e1&scope.project.id=ffff4334538649fdba1beb80cad207fa&role.id=76c53e2c353644f885028a0226c06146 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:33:48.657111 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40964f1b-ddda-4a52-889f-cc375b1cc76a None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:33:48.657111 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40964f1b-ddda-4a52-889f-cc375b1cc76a None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:33:48.657111 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40964f1b-ddda-4a52-889f-cc375b1cc76a None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:33:48.658593 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 632/1261] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:33:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:33:48.664221 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a4be52-3872-43fc-a4d2-16de2ed78fa1 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:33:48.664673 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a4be52-3872-43fc-a4d2-16de2ed78fa1 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:33:48.664828 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a4be52-3872-43fc-a4d2-16de2ed78fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:33:48.682523 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-66a4be52-3872-43fc-a4d2-16de2ed78fa1 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:33:48.687501 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-66a4be52-3872-43fc-a4d2-16de2ed78fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:33:48.750006 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 630/1262] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:33:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 14:33:48.773286 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40964f1b-ddda-4a52-889f-cc375b1cc76a None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:33:48.784524 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:33:48.872545 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40964f1b-ddda-4a52-889f-cc375b1cc76a None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:33:48.909375 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9404fa2b-7e7d-4279-bc93-3ec843c3e308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:33:48.910655 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9404fa2b-7e7d-4279-bc93-3ec843c3e308 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:33:48.910945 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9404fa2b-7e7d-4279-bc93-3ec843c3e308 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:33:48.911268 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9404fa2b-7e7d-4279-bc93-3ec843c3e308 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:33:48.921889 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9404fa2b-7e7d-4279-bc93-3ec843c3e308 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 14:33:48.930185 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-9404fa2b-7e7d-4279-bc93-3ec843c3e308 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 31 14:33:48.930185 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:33:48.930185 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:33:48.930185 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:33:48.930185 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:33:48.930185 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:33:48.930185 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:33:48.930185 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:33:48.930185 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:33:48.930185 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:33:48.930185 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:33:48.930185 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:33:48.930185 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 14:33:48.930185 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 14:33:48.930185 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 14:33:48.930185 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 14:33:48.931469 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 14:33:48.931469 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 14:33:48.931469 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 14:33:48.931469 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 14:33:48.931469 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:33:48.931469 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:33:48.931469 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:33:48.931469 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:33:48.931469 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:33:48.931469 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:33:48.931469 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:33:48.931469 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:33:48.931469 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:33:48.931469 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:33:48.931469 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:33:48.931469 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:33:48.932621 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:33:48.932621 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:33:48.932621 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:33:48.932621 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:33:48.932621 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 14:33:48.932621 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 14:33:48.932621 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 14:33:48.932621 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 14:33:48.932621 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 14:33:48.932621 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 14:33:48.932621 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 31 14:33:48.932621 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:33:48.932621 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 633/1263] 10.222.0.15 () {56 vars in 1096 bytes} [Tue May 31 14:33:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:33:48.937459 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a4be52-3872-43fc-a4d2-16de2ed78fa1 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:33:48.955359 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:33:49.033819 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a4be52-3872-43fc-a4d2-16de2ed78fa1 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:33:49.066541 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37c21d0-dc99-45e7-a13c-5103497be49d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:33:49.067228 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37c21d0-dc99-45e7-a13c-5103497be49d None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:33:49.067512 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37c21d0-dc99-45e7-a13c-5103497be49d None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:33:49.067800 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37c21d0-dc99-45e7-a13c-5103497be49d None admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:33:49.068557 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37c21d0-dc99-45e7-a13c-5103497be49d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:33:49.068867 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37c21d0-dc99-45e7-a13c-5103497be49d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:33:49.070234 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37c21d0-dc99-45e7-a13c-5103497be49d None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:33:49.078028 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 631/1264] 10.222.0.15 () {56 vars in 1099 bytes} [Tue May 31 14:33:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:33:49.084548 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9404fa2b-7e7d-4279-bc93-3ec843c3e308 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:33:49.151886 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:33:49.184655 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9404fa2b-7e7d-4279-bc93-3ec843c3e308 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:33:49.219033 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8376e2f1-f024-415e-998d-2df4bc4dd1c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:33:49.219815 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376e2f1-f024-415e-998d-2df4bc4dd1c6 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:33:49.220096 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376e2f1-f024-415e-998d-2df4bc4dd1c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:33:49.220364 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376e2f1-f024-415e-998d-2df4bc4dd1c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:33:49.230666 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8376e2f1-f024-415e-998d-2df4bc4dd1c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:33:49.232089 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8376e2f1-f024-415e-998d-2df4bc4dd1c6 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:33:49.248865 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-8376e2f1-f024-415e-998d-2df4bc4dd1c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:33:49.248865 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:33:49.248865 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:33:49.248865 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:33:49.248865 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:33:49.248865 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:33:49.248865 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:33:49.248865 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:33:49.248865 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:33:49.248865 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:33:49.248865 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:33:49.248865 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:33:49.248865 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 14:33:49.248865 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 14:33:49.248865 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 14:33:49.249951 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 14:33:49.249951 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:33:49.249951 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:33:49.249951 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:33:49.249951 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:33:49.249951 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:33:49.249951 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:33:49.249951 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:33:49.249951 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:33:49.249951 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:33:49.249951 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:33:49.249951 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:33:49.249951 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:33:49.249951 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:33:49.249951 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:33:49.249951 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:33:49.249951 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:33:49.251105 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 14:33:49.251105 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 14:33:49.251105 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:33:49.251105 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:33:49.251105 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 634/1265] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:33:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:33:49.255830 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37c21d0-dc99-45e7-a13c-5103497be49d None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:33:49.336438 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:33:49.355397 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37c21d0-dc99-45e7-a13c-5103497be49d None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:33:49.388681 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4eb245-4043-4afe-9aaa-777e84a59c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:33:49.389422 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4eb245-4043-4afe-9aaa-777e84a59c72 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:33:49.389704 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4eb245-4043-4afe-9aaa-777e84a59c72 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:33:49.390036 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4eb245-4043-4afe-9aaa-777e84a59c72 None admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:33:49.390866 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4eb245-4043-4afe-9aaa-777e84a59c72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:33:49.391184 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4eb245-4043-4afe-9aaa-777e84a59c72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:33:49.392558 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4eb245-4043-4afe-9aaa-777e84a59c72 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:33:49.405294 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 632/1266] 10.222.0.15 () {56 vars in 1109 bytes} [Tue May 31 14:33:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:33:49.411253 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8376e2f1-f024-415e-998d-2df4bc4dd1c6 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:33:49.508315 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8376e2f1-f024-415e-998d-2df4bc4dd1c6 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:33:49.527580 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:33:49.541874 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85751ef-afc7-44d6-98d5-b150317f4e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:33:49.542727 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85751ef-afc7-44d6-98d5-b150317f4e37 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:33:49.543014 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85751ef-afc7-44d6-98d5-b150317f4e37 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:33:49.543292 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85751ef-afc7-44d6-98d5-b150317f4e37 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:33:49.550900 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85751ef-afc7-44d6-98d5-b150317f4e37 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:33:49.552941 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85751ef-afc7-44d6-98d5-b150317f4e37 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:33:49.567341 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-c85751ef-afc7-44d6-98d5-b150317f4e37 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 31 14:33:49.567341 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:33:49.567341 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:33:49.567341 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:33:49.567341 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:33:49.567341 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:33:49.567341 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:33:49.567341 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:33:49.567341 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:33:49.567341 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:33:49.567341 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:33:49.567341 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:33:49.567341 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 14:33:49.567341 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 14:33:49.567341 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 14:33:49.567341 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 14:33:49.568370 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:33:49.568370 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:33:49.568370 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 14:33:49.568370 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 14:33:49.568370 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 14:33:49.568370 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 14:33:49.568370 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:33:49.568370 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:33:49.568370 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:33:49.568370 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:33:49.568370 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:33:49.568370 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:33:49.568370 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:33:49.568370 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:33:49.568370 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:33:49.568370 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:33:49.568370 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:33:49.568370 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:33:49.569444 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:33:49.569444 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:33:49.569444 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 14:33:49.569444 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 14:33:49.569444 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 14:33:49.569444 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 14:33:49.569444 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 14:33:49.569444 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 14:33:49.569444 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 31 14:33:49.569444 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:33:49.569444 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 635/1267] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:33:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:33:49.574369 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4eb245-4043-4afe-9aaa-777e84a59c72 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:33:49.669209 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4eb245-4043-4afe-9aaa-777e84a59c72 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:33:49.702336 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce3597d-0ee1-4c6f-843b-cfc37708d64e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:33:49.703022 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce3597d-0ee1-4c6f-843b-cfc37708d64e None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:33:49.703306 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce3597d-0ee1-4c6f-843b-cfc37708d64e None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:33:49.703580 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce3597d-0ee1-4c6f-843b-cfc37708d64e None admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:33:49.704395 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce3597d-0ee1-4c6f-843b-cfc37708d64e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:33:49.704700 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce3597d-0ee1-4c6f-843b-cfc37708d64e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:33:49.706116 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce3597d-0ee1-4c6f-843b-cfc37708d64e None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:33:49.715030 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:33:49.723687 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 633/1268] 10.222.0.15 () {56 vars in 1143 bytes} [Tue May 31 14:33:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:33:49.729980 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85751ef-afc7-44d6-98d5-b150317f4e37 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:33:49.826941 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85751ef-afc7-44d6-98d5-b150317f4e37 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:33:49.860455 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b66323-a1c2-4570-bce9-5e2ce2e62b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:33:49.861236 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b66323-a1c2-4570-bce9-5e2ce2e62b05 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:33:49.861519 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b66323-a1c2-4570-bce9-5e2ce2e62b05 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:33:49.861793 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b66323-a1c2-4570-bce9-5e2ce2e62b05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:33:49.871702 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b66323-a1c2-4570-bce9-5e2ce2e62b05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:33:49.873175 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b66323-a1c2-4570-bce9-5e2ce2e62b05 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:33:49.889961 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-74b66323-a1c2-4570-bce9-5e2ce2e62b05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:33:49.889961 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:33:49.889961 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:33:49.889961 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:33:49.889961 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:33:49.889961 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:33:49.889961 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:33:49.889961 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:33:49.889961 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:33:49.889961 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:33:49.889961 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:33:49.889961 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:33:49.889961 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 14:33:49.889961 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 14:33:49.889961 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 14:33:49.891076 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 14:33:49.891076 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:33:49.891076 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:33:49.891076 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:33:49.891076 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:33:49.891076 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:33:49.891076 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:33:49.891076 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:33:49.891076 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:33:49.891076 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:33:49.891076 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:33:49.891076 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:33:49.891076 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:33:49.891076 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:33:49.891076 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:33:49.891076 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:33:49.891076 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:33:49.892010 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 14:33:49.892010 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 14:33:49.892010 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:33:49.892010 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:33:49.892010 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 636/1269] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:33:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:33:49.897478 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce3597d-0ee1-4c6f-843b-cfc37708d64e None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:33:49.994503 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce3597d-0ee1-4c6f-843b-cfc37708d64e None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:33:50.029255 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab9187a-7e15-4373-b57f-6e026a91e97b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:33:50.029907 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab9187a-7e15-4373-b57f-6e026a91e97b None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:33:50.030185 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab9187a-7e15-4373-b57f-6e026a91e97b None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:33:50.030457 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab9187a-7e15-4373-b57f-6e026a91e97b None admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:33:50.031453 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab9187a-7e15-4373-b57f-6e026a91e97b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:33:50.031754 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab9187a-7e15-4373-b57f-6e026a91e97b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:33:50.033116 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab9187a-7e15-4373-b57f-6e026a91e97b None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:33:50.044723 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 634/1270] 10.222.0.15 () {56 vars in 1109 bytes} [Tue May 31 14:33:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:33:50.050618 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b66323-a1c2-4570-bce9-5e2ce2e62b05 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:33:50.081358 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:33:50.149887 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b66323-a1c2-4570-bce9-5e2ce2e62b05 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:33:50.182834 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ea99a-433d-4622-8fbb-faa0d2bcce17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:33:50.183619 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ea99a-433d-4622-8fbb-faa0d2bcce17 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:33:50.183971 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ea99a-433d-4622-8fbb-faa0d2bcce17 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:33:50.184189 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ea99a-433d-4622-8fbb-faa0d2bcce17 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:33:50.190752 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967ea99a-433d-4622-8fbb-faa0d2bcce17 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:33:50.192196 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967ea99a-433d-4622-8fbb-faa0d2bcce17 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:33:50.206140 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-967ea99a-433d-4622-8fbb-faa0d2bcce17 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 14:33:50.206140 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:33:50.206140 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:33:50.206140 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:33:50.206140 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:33:50.206140 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:33:50.206140 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:33:50.206140 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:33:50.206140 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:33:50.206140 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:33:50.206140 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:33:50.206140 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:33:50.206140 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 14:33:50.206140 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 14:33:50.206140 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 14:33:50.211817 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 14:33:50.211817 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:33:50.211817 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:33:50.211817 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:33:50.211817 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:33:50.211817 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:33:50.211817 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:33:50.211817 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:33:50.211817 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:33:50.211817 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:33:50.211817 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:33:50.211817 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:33:50.211817 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:33:50.211817 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:33:50.211817 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:33:50.211817 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:33:50.211817 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:33:50.212973 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 14:33:50.212973 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 14:33:50.212973 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 14:33:50.212973 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 14:33:50.212973 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 14:33:50.212973 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 14:33:50.212973 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 14:33:50.212973 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:33:50.212973 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 637/1271] 10.222.0.15 () {56 vars in 1111 bytes} [Tue May 31 14:33:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:33:50.214077 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab9187a-7e15-4373-b57f-6e026a91e97b None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:33:50.270855 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:33:50.313107 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab9187a-7e15-4373-b57f-6e026a91e97b None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:33:50.346497 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed250cf3-7abf-4c0e-bb18-22e568c7c29b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:33:50.347151 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed250cf3-7abf-4c0e-bb18-22e568c7c29b None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:33:50.347433 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed250cf3-7abf-4c0e-bb18-22e568c7c29b None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:33:50.347706 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed250cf3-7abf-4c0e-bb18-22e568c7c29b None admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:33:50.348473 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed250cf3-7abf-4c0e-bb18-22e568c7c29b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:33:50.348776 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed250cf3-7abf-4c0e-bb18-22e568c7c29b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:33:50.350197 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed250cf3-7abf-4c0e-bb18-22e568c7c29b None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:33:50.361875 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 635/1272] 10.222.0.15 () {56 vars in 1148 bytes} [Tue May 31 14:33:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:33:50.367896 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ea99a-433d-4622-8fbb-faa0d2bcce17 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:33:50.459544 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:33:50.467986 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ea99a-433d-4622-8fbb-faa0d2bcce17 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:33:50.500255 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5469916b-ccfd-4d5a-9719-f57344e0e542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:33:50.501124 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5469916b-ccfd-4d5a-9719-f57344e0e542 None admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:33:50.501400 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5469916b-ccfd-4d5a-9719-f57344e0e542 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:33:50.501666 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5469916b-ccfd-4d5a-9719-f57344e0e542 None admin] PATH_INFO: `/v3/projects/ffff4334538649fdba1beb80cad207fa/users/efc959ca520c4816b5ff7f95655e53e1/roles/76c53e2c353644f885028a0226c06146` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:33:50.503593 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5469916b-ccfd-4d5a-9719-f57344e0e542 None admin] RBAC: Authorizing `identity:create_grant(project_id=ffff4334538649fdba1beb80cad207fa, user_id=efc959ca520c4816b5ff7f95655e53e1, role_id=76c53e2c353644f885028a0226c06146)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:33:50.505011 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5469916b-ccfd-4d5a-9719-f57344e0e542 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:33:50.623749 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 638/1273] 10.222.0.15 () {58 vars in 1439 bytes} [Tue May 31 14:33:50 2022] PUT /identity/v3/projects/ffff4334538649fdba1beb80cad207fa/users/efc959ca520c4816b5ff7f95655e53e1/roles/76c53e2c353644f885028a0226c06146 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:33:52.838691 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d70233d-423a-4948-b803-537baacdd12b None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:33:52.839263 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d70233d-423a-4948-b803-537baacdd12b None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:33:52.839263 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d70233d-423a-4948-b803-537baacdd12b None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:33:52.840596 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 636/1274] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:33:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:33:52.845674 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd02c8b9-b8fa-4596-86d3-5f9eb7c4cd1a None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:33:52.846049 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd02c8b9-b8fa-4596-86d3-5f9eb7c4cd1a None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:33:52.846232 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd02c8b9-b8fa-4596-86d3-5f9eb7c4cd1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:33:52.863012 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-dd02c8b9-b8fa-4596-86d3-5f9eb7c4cd1a None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:33:52.864175 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-dd02c8b9-b8fa-4596-86d3-5f9eb7c4cd1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:33:52.927672 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 639/1275] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:33:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 14:33:52.951920 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d70233d-423a-4948-b803-537baacdd12b None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:33:53.050344 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d70233d-423a-4948-b803-537baacdd12b None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:33:53.066496 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:33:53.082603 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051a2160-d908-4da6-b0a7-d7c1e59677c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:33:53.083435 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051a2160-d908-4da6-b0a7-d7c1e59677c0 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:33:53.084304 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051a2160-d908-4da6-b0a7-d7c1e59677c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:33:53.084597 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051a2160-d908-4da6-b0a7-d7c1e59677c0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:33:53.094512 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051a2160-d908-4da6-b0a7-d7c1e59677c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 31 14:33:53.102082 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-051a2160-d908-4da6-b0a7-d7c1e59677c0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 31 14:33:53.102082 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:33:53.102082 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:33:53.102082 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:33:53.102082 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:33:53.102082 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:33:53.102082 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:33:53.102082 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:33:53.102082 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:33:53.102082 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:33:53.102082 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:33:53.102082 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:33:53.102082 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 31 14:33:53.102082 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(role_id) May 31 14:33:53.102082 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 31 14:33:53.102082 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 31 14:33:53.103227 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 31 14:33:53.103227 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 31 14:33:53.103227 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 31 14:33:53.103227 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 31 14:33:53.103227 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:33:53.103227 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:33:53.103227 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:33:53.103227 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:33:53.103227 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:33:53.103227 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:33:53.103227 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:33:53.103227 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:33:53.103227 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:33:53.103227 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:33:53.103227 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:33:53.103227 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:33:53.104076 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:33:53.104076 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:33:53.104076 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:33:53.104076 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:33:53.104076 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 31 14:33:53.104076 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 31 14:33:53.104076 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 31 14:33:53.104076 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 31 14:33:53.104076 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 31 14:33:53.104076 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 31 14:33:53.104076 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 31 14:33:53.104076 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:33:53.104076 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 637/1276] 10.222.0.15 () {56 vars in 1096 bytes} [Tue May 31 14:33:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:33:53.109173 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd02c8b9-b8fa-4596-86d3-5f9eb7c4cd1a None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:33:53.186881 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:33:53.204785 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd02c8b9-b8fa-4596-86d3-5f9eb7c4cd1a None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:33:53.238834 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3a924c-4850-4d3c-acda-90d5d3056617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:33:53.239539 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3a924c-4850-4d3c-acda-90d5d3056617 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:33:53.239862 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3a924c-4850-4d3c-acda-90d5d3056617 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:33:53.240631 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3a924c-4850-4d3c-acda-90d5d3056617 None admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:33:53.241429 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3a924c-4850-4d3c-acda-90d5d3056617 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:33:53.241738 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3a924c-4850-4d3c-acda-90d5d3056617 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:33:53.243135 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3a924c-4850-4d3c-acda-90d5d3056617 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:33:53.251128 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 640/1277] 10.222.0.15 () {56 vars in 1099 bytes} [Tue May 31 14:33:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:33:53.257015 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051a2160-d908-4da6-b0a7-d7c1e59677c0 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:33:53.355536 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051a2160-d908-4da6-b0a7-d7c1e59677c0 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:33:53.388020 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755c3bd4-bd57-4748-898d-8ed12639e902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:33:53.388807 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755c3bd4-bd57-4748-898d-8ed12639e902 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:33:53.389093 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755c3bd4-bd57-4748-898d-8ed12639e902 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:33:53.389371 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755c3bd4-bd57-4748-898d-8ed12639e902 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:33:53.399627 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755c3bd4-bd57-4748-898d-8ed12639e902 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:33:53.401065 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755c3bd4-bd57-4748-898d-8ed12639e902 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:33:53.418541 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-755c3bd4-bd57-4748-898d-8ed12639e902 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:33:53.418541 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:33:53.418541 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:33:53.418541 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:33:53.418541 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:33:53.418541 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:33:53.418541 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:33:53.418541 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:33:53.418541 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:33:53.418541 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:33:53.418541 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:33:53.418541 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:33:53.418541 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 14:33:53.418541 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 14:33:53.418541 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 14:33:53.419627 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 14:33:53.419627 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:33:53.419627 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:33:53.419627 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:33:53.419627 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:33:53.419627 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:33:53.419627 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:33:53.419627 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:33:53.419627 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:33:53.419627 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:33:53.419627 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:33:53.419627 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:33:53.419627 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:33:53.419627 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:33:53.419627 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:33:53.419627 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:33:53.419627 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:33:53.420759 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 14:33:53.420759 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 14:33:53.420759 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:33:53.420759 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:33:53.420759 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 638/1278] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:33:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:33:53.425792 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3a924c-4850-4d3c-acda-90d5d3056617 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:33:53.527557 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3a924c-4850-4d3c-acda-90d5d3056617 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:33:53.560430 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8185742c-a6fb-4714-8b97-239e197cf3f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:33:53.561082 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8185742c-a6fb-4714-8b97-239e197cf3f7 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:33:53.561371 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8185742c-a6fb-4714-8b97-239e197cf3f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:33:53.561652 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8185742c-a6fb-4714-8b97-239e197cf3f7 None admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:33:53.562366 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8185742c-a6fb-4714-8b97-239e197cf3f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:33:53.562719 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8185742c-a6fb-4714-8b97-239e197cf3f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:33:53.564082 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8185742c-a6fb-4714-8b97-239e197cf3f7 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:33:53.576047 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 641/1279] 10.222.0.15 () {56 vars in 1109 bytes} [Tue May 31 14:33:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:33:53.581724 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755c3bd4-bd57-4748-898d-8ed12639e902 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:33:53.612022 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:33:53.680984 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755c3bd4-bd57-4748-898d-8ed12639e902 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:33:53.717323 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aad398-b4df-4a49-aab2-8ffefa56fea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:33:53.718124 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aad398-b4df-4a49-aab2-8ffefa56fea9 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:33:53.718408 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aad398-b4df-4a49-aab2-8ffefa56fea9 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:33:53.718719 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aad398-b4df-4a49-aab2-8ffefa56fea9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:33:53.726265 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aad398-b4df-4a49-aab2-8ffefa56fea9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:33:53.727760 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aad398-b4df-4a49-aab2-8ffefa56fea9 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:33:53.742478 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-28aad398-b4df-4a49-aab2-8ffefa56fea9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 31 14:33:53.742478 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:33:53.742478 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:33:53.742478 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:33:53.742478 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:33:53.742478 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:33:53.742478 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:33:53.742478 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:33:53.742478 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:33:53.742478 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:33:53.742478 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:33:53.742478 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:33:53.742478 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 31 14:33:53.742478 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_user(user_id) May 31 14:33:53.742478 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 31 14:33:53.742478 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 31 14:33:53.743632 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:33:53.743632 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:33:53.743632 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 31 14:33:53.743632 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 14:33:53.743632 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 31 14:33:53.743632 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 31 14:33:53.743632 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:33:53.743632 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:33:53.743632 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:33:53.743632 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:33:53.743632 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:33:53.743632 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:33:53.743632 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:33:53.743632 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:33:53.743632 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:33:53.743632 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:33:53.743632 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:33:53.743632 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:33:53.745002 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:33:53.745002 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:33:53.745002 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 31 14:33:53.745002 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 31 14:33:53.745002 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 31 14:33:53.745002 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 31 14:33:53.745002 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 31 14:33:53.745002 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 31 14:33:53.745002 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 31 14:33:53.745002 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:33:53.745002 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 639/1280] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:33:53 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:33:53.749536 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8185742c-a6fb-4714-8b97-239e197cf3f7 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:33:53.753441 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:33:53.852816 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8185742c-a6fb-4714-8b97-239e197cf3f7 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:33:53.884840 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ccac8d-51ee-4d4f-b3eb-f465a0d86e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:33:53.885432 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ccac8d-51ee-4d4f-b3eb-f465a0d86e69 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:33:53.885712 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ccac8d-51ee-4d4f-b3eb-f465a0d86e69 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:33:53.885985 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ccac8d-51ee-4d4f-b3eb-f465a0d86e69 None admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:33:53.886820 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ccac8d-51ee-4d4f-b3eb-f465a0d86e69 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:33:53.887124 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ccac8d-51ee-4d4f-b3eb-f465a0d86e69 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:33:53.888565 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ccac8d-51ee-4d4f-b3eb-f465a0d86e69 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:33:53.904903 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 642/1281] 10.222.0.15 () {56 vars in 1143 bytes} [Tue May 31 14:33:53 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:33:53.910861 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aad398-b4df-4a49-aab2-8ffefa56fea9 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:33:54.005893 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:33:54.015149 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aad398-b4df-4a49-aab2-8ffefa56fea9 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:33:54.047675 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97de7f5-f641-4314-80e2-7ada81a72d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:33:54.048318 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97de7f5-f641-4314-80e2-7ada81a72d7c None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:33:54.048605 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97de7f5-f641-4314-80e2-7ada81a72d7c None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:33:54.048891 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97de7f5-f641-4314-80e2-7ada81a72d7c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:33:54.116209 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97de7f5-f641-4314-80e2-7ada81a72d7c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:33:54.117653 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97de7f5-f641-4314-80e2-7ada81a72d7c None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:33:54.211009 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:33:54.221959 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 640/1282] 10.222.0.15 () {58 vars in 1282 bytes} [Tue May 31 14:33:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 31 14:33:54.229151 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ccac8d-51ee-4d4f-b3eb-f465a0d86e69 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:33:54.297124 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:33:54.338249 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ccac8d-51ee-4d4f-b3eb-f465a0d86e69 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:33:54.375249 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875eb94a-f767-427e-92c3-dae6389d7e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:33:54.376101 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875eb94a-f767-427e-92c3-dae6389d7e2c None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:33:54.376386 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875eb94a-f767-427e-92c3-dae6389d7e2c None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:33:54.376882 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875eb94a-f767-427e-92c3-dae6389d7e2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:33:54.388540 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875eb94a-f767-427e-92c3-dae6389d7e2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:33:54.390012 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875eb94a-f767-427e-92c3-dae6389d7e2c None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:33:54.409754 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-875eb94a-f767-427e-92c3-dae6389d7e2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:33:54.409754 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:33:54.409754 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:33:54.409754 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:33:54.409754 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:33:54.409754 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:33:54.409754 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:33:54.409754 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:33:54.409754 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:33:54.409754 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:33:54.409754 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:33:54.409754 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:33:54.409754 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 31 14:33:54.409754 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 31 14:33:54.409754 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 31 14:33:54.412555 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 31 14:33:54.412555 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:33:54.412555 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:33:54.412555 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:33:54.412555 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:33:54.412555 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:33:54.412555 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:33:54.412555 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:33:54.412555 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:33:54.412555 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:33:54.412555 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:33:54.412555 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:33:54.412555 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:33:54.412555 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:33:54.412555 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:33:54.412555 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:33:54.412555 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:33:54.413518 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 31 14:33:54.413518 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 31 14:33:54.413518 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 31 14:33:54.413518 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:33:54.413518 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 643/1283] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:33:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:33:54.417704 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97de7f5-f641-4314-80e2-7ada81a72d7c None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:33:54.524211 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97de7f5-f641-4314-80e2-7ada81a72d7c None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:33:54.559656 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0fbcdf-eb59-41a1-880e-3d445c37909a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:33:54.560323 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0fbcdf-eb59-41a1-880e-3d445c37909a None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:33:54.560618 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0fbcdf-eb59-41a1-880e-3d445c37909a None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:33:54.560899 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0fbcdf-eb59-41a1-880e-3d445c37909a None admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:33:54.561613 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0fbcdf-eb59-41a1-880e-3d445c37909a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:33:54.561924 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0fbcdf-eb59-41a1-880e-3d445c37909a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:33:54.563362 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0fbcdf-eb59-41a1-880e-3d445c37909a None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:33:54.575317 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 641/1284] 10.222.0.15 () {56 vars in 1109 bytes} [Tue May 31 14:33:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:33:54.581141 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875eb94a-f767-427e-92c3-dae6389d7e2c None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:33:54.685102 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875eb94a-f767-427e-92c3-dae6389d7e2c None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:33:54.698942 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:33:54.718036 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9df981-72a2-4d3a-bdf3-5dc04fd6f6cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:33:54.718845 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9df981-72a2-4d3a-bdf3-5dc04fd6f6cb None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:33:54.719126 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9df981-72a2-4d3a-bdf3-5dc04fd6f6cb None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:33:54.719400 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9df981-72a2-4d3a-bdf3-5dc04fd6f6cb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:33:54.726460 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9df981-72a2-4d3a-bdf3-5dc04fd6f6cb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:33:54.727902 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9df981-72a2-4d3a-bdf3-5dc04fd6f6cb None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:33:54.742239 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application [None req-3b9df981-72a2-4d3a-bdf3-5dc04fd6f6cb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 31 14:33:54.742239 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:33:54.742239 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:33:54.742239 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:33:54.742239 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:33:54.742239 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:33:54.742239 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:33:54.742239 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:33:54.742239 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:33:54.742239 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:33:54.742239 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:33:54.742239 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:33:54.742239 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 31 14:33:54.742239 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_project(project_id) May 31 14:33:54.742239 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 31 14:33:54.743350 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 31 14:33:54.743350 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:33:54.743350 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:33:54.743350 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:33:54.743350 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:33:54.743350 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:33:54.743350 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:33:54.743350 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:33:54.743350 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application with Lock( May 31 14:33:54.743350 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:33:54.743350 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._enter() May 31 14:33:54.743350 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:33:54.743350 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:33:54.743350 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:33:54.743350 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.creator() May 31 14:33:54.743350 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:33:54.743350 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application created_value = creator( May 31 14:33:54.744318 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 31 14:33:54.744318 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 31 14:33:54.744318 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 31 14:33:54.744318 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 31 14:33:54.744318 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 31 14:33:54.744318 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 31 14:33:54.744318 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 31 14:33:54.744318 dv-cinder-839793-14-smb devstack@keystone.service[80503]: ERROR keystone.server.flask.application May 31 14:33:54.744318 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 644/1285] 10.222.0.15 () {56 vars in 1111 bytes} [Tue May 31 14:33:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:33:54.749283 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0fbcdf-eb59-41a1-880e-3d445c37909a None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:33:54.797240 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:33:54.845578 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0fbcdf-eb59-41a1-880e-3d445c37909a None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:33:54.879099 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7441144-d581-4599-8f74-93854e1b65b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:33:54.879756 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7441144-d581-4599-8f74-93854e1b65b0 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:33:54.880050 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7441144-d581-4599-8f74-93854e1b65b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:33:54.880348 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7441144-d581-4599-8f74-93854e1b65b0 None admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:33:54.881138 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7441144-d581-4599-8f74-93854e1b65b0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:33:54.881448 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7441144-d581-4599-8f74-93854e1b65b0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:33:54.882906 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7441144-d581-4599-8f74-93854e1b65b0 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:33:54.894642 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 642/1286] 10.222.0.15 () {56 vars in 1148 bytes} [Tue May 31 14:33:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:33:54.900628 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9df981-72a2-4d3a-bdf3-5dc04fd6f6cb None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:33:54.997794 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9df981-72a2-4d3a-bdf3-5dc04fd6f6cb None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:33:55.029953 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e08d61a-207e-4acd-8e0f-b23af8b563f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:33:55.030604 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e08d61a-207e-4acd-8e0f-b23af8b563f8 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:33:55.031169 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e08d61a-207e-4acd-8e0f-b23af8b563f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:33:55.031448 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e08d61a-207e-4acd-8e0f-b23af8b563f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:33:55.032267 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e08d61a-207e-4acd-8e0f-b23af8b563f8 None admin] RBAC: Adding query filter params (role.id=76c53e2c353644f885028a0226c06146, scope.project.id=ffff4334538649fdba1beb80cad207fa, user.id=efc959ca520c4816b5ff7f95655e53e1) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:33:55.032580 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e08d61a-207e-4acd-8e0f-b23af8b563f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:33:55.033996 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e08d61a-207e-4acd-8e0f-b23af8b563f8 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:33:55.040554 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 645/1287] 10.222.0.15 () {56 vars in 1374 bytes} [Tue May 31 14:33:54 2022] GET /identity/v3/role_assignments?user.id=efc959ca520c4816b5ff7f95655e53e1&scope.project.id=ffff4334538649fdba1beb80cad207fa&role.id=76c53e2c353644f885028a0226c06146 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:33:57.295488 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe4f10-0455-4869-9922-55386b163ca7 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:33:57.295937 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe4f10-0455-4869-9922-55386b163ca7 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:33:57.296039 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe4f10-0455-4869-9922-55386b163ca7 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:33:57.297399 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 643/1288] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:33:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:33:57.302721 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e469c2bb-03e0-48d4-8947-55156edee1c8 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:33:57.303141 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e469c2bb-03e0-48d4-8947-55156edee1c8 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:33:57.303277 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e469c2bb-03e0-48d4-8947-55156edee1c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:33:57.319591 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-e469c2bb-03e0-48d4-8947-55156edee1c8 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:33:57.320750 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-e469c2bb-03e0-48d4-8947-55156edee1c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:33:57.350150 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:33:57.384965 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 646/1289] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:33:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 14:33:57.407968 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfe4f10-0455-4869-9922-55386b163ca7 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:33:57.512580 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfe4f10-0455-4869-9922-55386b163ca7 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:33:57.651749 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:33:57.674366 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b74fba8-b49a-4253-82c6-56881f3a92a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:33:57.675174 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b74fba8-b49a-4253-82c6-56881f3a92a7 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:33:57.675457 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b74fba8-b49a-4253-82c6-56881f3a92a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:33:57.675751 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b74fba8-b49a-4253-82c6-56881f3a92a7 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:33:57.676354 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b74fba8-b49a-4253-82c6-56881f3a92a7 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:33:57.677700 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b74fba8-b49a-4253-82c6-56881f3a92a7 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:33:57.689181 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-5b74fba8-b49a-4253-82c6-56881f3a92a7 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 31 14:33:57.689181 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:33:57.689181 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 31 14:33:57.689181 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 31 14:33:57.689181 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 31 14:33:57.689181 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 31 14:33:57.689181 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 31 14:33:57.689181 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 14:33:57.689181 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 31 14:33:57.689181 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:33:57.689181 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 31 14:33:57.689181 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:33:57.689181 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:33:57.689181 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:33:57.689181 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:33:57.689181 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:33:57.689181 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:33:57.690397 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:33:57.690397 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:33:57.690397 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:33:57.690397 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:33:57.690397 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:33:57.690397 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:33:57.690397 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 31 14:33:57.690397 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_service(service_id) May 31 14:33:57.690397 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 31 14:33:57.690397 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 31 14:33:57.690397 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:33:57.690397 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:33:57.690397 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:33:57.690397 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:33:57.690397 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:33:57.690397 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:33:57.691654 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:33:57.691654 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:33:57.691654 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:33:57.691654 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:33:57.691654 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:33:57.691654 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:33:57.691654 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:33:57.691654 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:33:57.691654 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:33:57.691654 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:33:57.691654 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 31 14:33:57.691654 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 14:33:57.691654 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 31 14:33:57.691654 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:33:57.691654 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 644/1290] 10.222.0.15 () {56 vars in 1117 bytes} [Tue May 31 14:33:57 2022] GET /identity/v3/services/placement => generated 90 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:33:57.697327 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e469c2bb-03e0-48d4-8947-55156edee1c8 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:33:57.794515 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e469c2bb-03e0-48d4-8947-55156edee1c8 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:33:57.827841 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef38922-d8c9-412d-94f0-ce39ad80c2a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:33:57.828499 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef38922-d8c9-412d-94f0-ce39ad80c2a9 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:33:57.828785 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef38922-d8c9-412d-94f0-ce39ad80c2a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:33:57.829067 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef38922-d8c9-412d-94f0-ce39ad80c2a9 None admin] PATH_INFO: `/v3/services` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:33:57.829767 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef38922-d8c9-412d-94f0-ce39ad80c2a9 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:33:57.830077 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef38922-d8c9-412d-94f0-ce39ad80c2a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:33:57.831473 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef38922-d8c9-412d-94f0-ce39ad80c2a9 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:33:57.836945 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 647/1291] 10.222.0.15 () {56 vars in 1116 bytes} [Tue May 31 14:33:57 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:33:57.842691 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b74fba8-b49a-4253-82c6-56881f3a92a7 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:33:57.940739 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b74fba8-b49a-4253-82c6-56881f3a92a7 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:33:57.973138 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6f0821-d19c-41d6-9a2b-b6f92c013bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:33:57.973786 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f0821-d19c-41d6-9a2b-b6f92c013bc0 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:33:57.974071 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f0821-d19c-41d6-9a2b-b6f92c013bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:33:57.974350 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f0821-d19c-41d6-9a2b-b6f92c013bc0 None admin] PATH_INFO: `/v3/services` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:33:57.975100 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6f0821-d19c-41d6-9a2b-b6f92c013bc0 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:33:57.975407 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6f0821-d19c-41d6-9a2b-b6f92c013bc0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:33:57.976772 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6f0821-d19c-41d6-9a2b-b6f92c013bc0 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:33:57.981246 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 645/1292] 10.222.0.15 () {56 vars in 1116 bytes} [Tue May 31 14:33:57 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:34:00.231629 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9c8fd0-d1c4-4ac5-a5f0-d31375c713b2 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:34:00.271832 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9c8fd0-d1c4-4ac5-a5f0-d31375c713b2 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:34:00.271832 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9c8fd0-d1c4-4ac5-a5f0-d31375c713b2 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:34:00.271832 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 648/1293] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:34:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:34:00.272134 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69691cf-002a-4d6e-b4c8-bb234ac28219 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:34:00.272134 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69691cf-002a-4d6e-b4c8-bb234ac28219 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:34:00.272134 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69691cf-002a-4d6e-b4c8-bb234ac28219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:34:00.272134 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-b69691cf-002a-4d6e-b4c8-bb234ac28219 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:34:00.272134 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-b69691cf-002a-4d6e-b4c8-bb234ac28219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:34:00.285898 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:34:00.321793 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 646/1294] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:34:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 14:34:00.344826 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9c8fd0-d1c4-4ac5-a5f0-d31375c713b2 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:34:00.375708 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:34:00.445493 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9c8fd0-d1c4-4ac5-a5f0-d31375c713b2 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:34:00.479971 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8b68a8-020d-4cc3-9eb3-8d6c2739d4e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:34:00.480623 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8b68a8-020d-4cc3-9eb3-8d6c2739d4e1 None admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:34:00.480906 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8b68a8-020d-4cc3-9eb3-8d6c2739d4e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:34:00.481184 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8b68a8-020d-4cc3-9eb3-8d6c2739d4e1 None admin] PATH_INFO: `/v3/services` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:34:00.481941 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8b68a8-020d-4cc3-9eb3-8d6c2739d4e1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:34:00.483278 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8b68a8-020d-4cc3-9eb3-8d6c2739d4e1 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:34:00.590265 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 649/1295] 10.222.0.15 () {60 vars in 1141 bytes} [Tue May 31 14:34:00 2022] POST /identity/v3/services => generated 246 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:34:02.872939 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa76f81-f7f1-4c21-a3db-a6346bc6dce3 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:34:02.873492 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa76f81-f7f1-4c21-a3db-a6346bc6dce3 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:34:02.873492 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa76f81-f7f1-4c21-a3db-a6346bc6dce3 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:34:02.874892 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 647/1296] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:34:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:34:02.880201 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f07465-9fc6-451d-b8b6-698bef941224 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:34:02.880650 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f07465-9fc6-451d-b8b6-698bef941224 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:34:02.880748 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f07465-9fc6-451d-b8b6-698bef941224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:34:02.898123 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-28f07465-9fc6-451d-b8b6-698bef941224 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:34:02.899339 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-28f07465-9fc6-451d-b8b6-698bef941224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:34:02.969368 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 650/1297] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:34:02 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 14:34:02.992048 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa76f81-f7f1-4c21-a3db-a6346bc6dce3 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:34:03.088827 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa76f81-f7f1-4c21-a3db-a6346bc6dce3 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:34:03.124166 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3dcbb7-6001-4f9e-b5f1-a2da39488646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:34:03.124889 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3dcbb7-6001-4f9e-b5f1-a2da39488646 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:34:03.125171 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3dcbb7-6001-4f9e-b5f1-a2da39488646 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:34:03.125443 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3dcbb7-6001-4f9e-b5f1-a2da39488646 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:34:03.126124 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3dcbb7-6001-4f9e-b5f1-a2da39488646 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:34:03.127503 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3dcbb7-6001-4f9e-b5f1-a2da39488646 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:34:03.139619 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-5c3dcbb7-6001-4f9e-b5f1-a2da39488646 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 31 14:34:03.139619 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:34:03.139619 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 31 14:34:03.139619 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 31 14:34:03.139619 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 31 14:34:03.139619 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 31 14:34:03.139619 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 31 14:34:03.139619 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 14:34:03.139619 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 31 14:34:03.139619 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:34:03.139619 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 31 14:34:03.139619 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:34:03.139619 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:34:03.139619 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:34:03.139619 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:34:03.139619 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:34:03.139619 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:34:03.140875 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:34:03.140875 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:34:03.140875 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:34:03.140875 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:34:03.140875 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:34:03.140875 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:34:03.140875 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 31 14:34:03.140875 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_service(service_id) May 31 14:34:03.140875 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 31 14:34:03.140875 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 31 14:34:03.140875 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:34:03.140875 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:34:03.140875 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:34:03.140875 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:34:03.140875 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:34:03.140875 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:34:03.142192 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:34:03.142192 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:34:03.142192 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:34:03.142192 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:34:03.142192 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:34:03.142192 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:34:03.142192 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:34:03.142192 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:34:03.142192 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:34:03.142192 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:34:03.142192 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 31 14:34:03.142192 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 14:34:03.142192 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 31 14:34:03.142192 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:34:03.142192 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 648/1298] 10.222.0.15 () {56 vars in 1117 bytes} [Tue May 31 14:34:02 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:34:03.147552 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f07465-9fc6-451d-b8b6-698bef941224 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:34:03.165417 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:34:03.243378 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f07465-9fc6-451d-b8b6-698bef941224 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:34:03.275946 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48ae866-3c9d-49db-93b2-9279e96ec540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:34:03.276600 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ae866-3c9d-49db-93b2-9279e96ec540 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:34:03.276883 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ae866-3c9d-49db-93b2-9279e96ec540 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:34:03.277159 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ae866-3c9d-49db-93b2-9279e96ec540 None admin] PATH_INFO: `/v3/services` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:34:03.277853 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48ae866-3c9d-49db-93b2-9279e96ec540 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:34:03.278159 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48ae866-3c9d-49db-93b2-9279e96ec540 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:34:03.279544 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48ae866-3c9d-49db-93b2-9279e96ec540 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:34:03.284956 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 651/1299] 10.222.0.15 () {56 vars in 1116 bytes} [Tue May 31 14:34:03 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:34:03.291106 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3dcbb7-6001-4f9e-b5f1-a2da39488646 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:34:03.323085 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:34:03.387320 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3dcbb7-6001-4f9e-b5f1-a2da39488646 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:34:03.419121 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98f96a2-0055-4e74-933c-a3956d2abebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:34:03.421379 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f96a2-0055-4e74-933c-a3956d2abebe None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:34:03.421379 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f96a2-0055-4e74-933c-a3956d2abebe None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:34:03.421379 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f96a2-0055-4e74-933c-a3956d2abebe None admin] PATH_INFO: `/v3/endpoints` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:34:03.421379 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98f96a2-0055-4e74-933c-a3956d2abebe None admin] RBAC: Adding query filter params (interface=public, service_id=f1413fc441544b8c9e111fc02fe9c344, region_id=RegionOne) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:34:03.421727 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98f96a2-0055-4e74-933c-a3956d2abebe None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:34:03.422889 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98f96a2-0055-4e74-933c-a3956d2abebe None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:34:03.427707 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 649/1300] 10.222.0.15 () {56 vars in 1251 bytes} [Tue May 31 14:34:03 2022] GET /identity/v3/endpoints?service_id=f1413fc441544b8c9e111fc02fe9c344&interface=public®ion_id=RegionOne => generated 194 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:34:03.433962 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48ae866-3c9d-49db-93b2-9279e96ec540 None admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:34:03.516033 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:34:03.533909 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48ae866-3c9d-49db-93b2-9279e96ec540 None admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:34:03.567301 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bfba3f-7d82-4447-9a2b-d414b3bc2d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:34:03.567960 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bfba3f-7d82-4447-9a2b-d414b3bc2d07 None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:34:03.568247 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bfba3f-7d82-4447-9a2b-d414b3bc2d07 None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:34:03.568527 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bfba3f-7d82-4447-9a2b-d414b3bc2d07 None admin] PATH_INFO: `/v3/services` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:34:03.569195 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bfba3f-7d82-4447-9a2b-d414b3bc2d07 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:34:03.570585 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bfba3f-7d82-4447-9a2b-d414b3bc2d07 None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:34:03.577469 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 652/1301] 10.222.0.15 () {56 vars in 1087 bytes} [Tue May 31 14:34:03 2022] GET /identity/v3/services => generated 2191 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:34:05.819814 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc05364-22af-4aa3-b2ce-c40387ee8fd4 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:34:05.820359 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc05364-22af-4aa3-b2ce-c40387ee8fd4 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:34:05.820359 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc05364-22af-4aa3-b2ce-c40387ee8fd4 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:34:05.821728 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 650/1302] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:34:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:34:05.826884 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005fe3f4-ec91-45b6-80e3-32890d29577e None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:34:05.827292 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005fe3f4-ec91-45b6-80e3-32890d29577e None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:34:05.827441 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005fe3f4-ec91-45b6-80e3-32890d29577e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:34:05.843494 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-005fe3f4-ec91-45b6-80e3-32890d29577e None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:34:05.844657 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-005fe3f4-ec91-45b6-80e3-32890d29577e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:34:05.908835 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 653/1303] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:34:05 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 31 14:34:05.932605 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc05364-22af-4aa3-b2ce-c40387ee8fd4 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:34:06.023260 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:34:06.029690 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc05364-22af-4aa3-b2ce-c40387ee8fd4 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:34:06.063268 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35444dce-7c42-4c31-be5f-53d030cb8902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:34:06.064055 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35444dce-7c42-4c31-be5f-53d030cb8902 None admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:34:06.064338 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35444dce-7c42-4c31-be5f-53d030cb8902 None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:34:06.064612 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35444dce-7c42-4c31-be5f-53d030cb8902 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:34:06.065252 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35444dce-7c42-4c31-be5f-53d030cb8902 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:34:06.066638 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35444dce-7c42-4c31-be5f-53d030cb8902 None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:34:06.078216 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application [None req-35444dce-7c42-4c31-be5f-53d030cb8902 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 31 14:34:06.078216 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:34:06.078216 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 31 14:34:06.078216 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 31 14:34:06.078216 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 31 14:34:06.078216 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 31 14:34:06.078216 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 31 14:34:06.078216 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 14:34:06.078216 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 31 14:34:06.078216 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:34:06.078216 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 31 14:34:06.078216 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:34:06.078216 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application Traceback (most recent call last): May 31 14:34:06.078216 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 31 14:34:06.078216 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 31 14:34:06.078216 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 31 14:34:06.078216 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 31 14:34:06.079440 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 31 14:34:06.079440 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 31 14:34:06.079440 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 31 14:34:06.079440 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 31 14:34:06.079440 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 31 14:34:06.079440 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 31 14:34:06.079440 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 31 14:34:06.079440 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._get_service(service_id) May 31 14:34:06.079440 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 31 14:34:06.079440 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 31 14:34:06.079440 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 31 14:34:06.079440 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 31 14:34:06.079440 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 31 14:34:06.079440 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 31 14:34:06.079440 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 31 14:34:06.079440 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.get_or_create( May 31 14:34:06.080451 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 31 14:34:06.080451 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application with Lock( May 31 14:34:06.080451 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 31 14:34:06.080451 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self._enter() May 31 14:34:06.080451 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 31 14:34:06.080451 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 31 14:34:06.080451 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 31 14:34:06.080451 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application return self.creator() May 31 14:34:06.080451 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 31 14:34:06.080451 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application created_value = creator( May 31 14:34:06.080451 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 31 14:34:06.080451 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 31 14:34:06.080451 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 31 14:34:06.080451 dv-cinder-839793-14-smb devstack@keystone.service[80502]: ERROR keystone.server.flask.application May 31 14:34:06.080451 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 651/1304] 10.222.0.15 () {56 vars in 1117 bytes} [Tue May 31 14:34:05 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 31 14:34:06.085592 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005fe3f4-ec91-45b6-80e3-32890d29577e None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:34:06.160568 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:34:06.182799 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005fe3f4-ec91-45b6-80e3-32890d29577e None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:34:06.215579 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4747a92b-677d-42ef-aef4-f036e6c21d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:34:06.216244 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4747a92b-677d-42ef-aef4-f036e6c21d2a None admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:34:06.216526 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4747a92b-677d-42ef-aef4-f036e6c21d2a None admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:34:06.216801 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4747a92b-677d-42ef-aef4-f036e6c21d2a None admin] PATH_INFO: `/v3/services` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:34:06.219116 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4747a92b-677d-42ef-aef4-f036e6c21d2a None admin] RBAC: Adding query filter params (name=placement) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:34:06.219429 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4747a92b-677d-42ef-aef4-f036e6c21d2a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:34:06.220825 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4747a92b-677d-42ef-aef4-f036e6c21d2a None admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:34:06.229131 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 654/1305] 10.222.0.15 () {56 vars in 1116 bytes} [Tue May 31 14:34:06 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:34:06.235301 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35444dce-7c42-4c31-be5f-53d030cb8902 None admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:34:06.335126 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35444dce-7c42-4c31-be5f-53d030cb8902 None admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:34:06.367483 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d249b753-8ae7-432d-93c0-4ef20885a0cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:34:06.368143 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d249b753-8ae7-432d-93c0-4ef20885a0cf None admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:34:06.368427 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d249b753-8ae7-432d-93c0-4ef20885a0cf None admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:34:06.368700 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d249b753-8ae7-432d-93c0-4ef20885a0cf None admin] PATH_INFO: `/v3/endpoints` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:34:06.369429 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d249b753-8ae7-432d-93c0-4ef20885a0cf None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:34:06.370814 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d249b753-8ae7-432d-93c0-4ef20885a0cf None admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:34:06.476342 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 652/1306] 10.222.0.15 () {60 vars in 1144 bytes} [Tue May 31 14:34:06 2022] POST /identity/v3/endpoints => generated 331 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:34:16.223213 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=30 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:34:16.471115 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:40:28.427026 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416655fb-4945-4155-b459-0ad9a42f9dbf None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:40:28.427574 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416655fb-4945-4155-b459-0ad9a42f9dbf None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:40:28.427574 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416655fb-4945-4155-b459-0ad9a42f9dbf None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:40:28.434184 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f735d520-dc07-4bdd-a6e9-07b6f578c101 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:40:28.434824 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f735d520-dc07-4bdd-a6e9-07b6f578c101 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:40:28.434824 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f735d520-dc07-4bdd-a6e9-07b6f578c101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:40:28.438210 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 655/1307] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:40:28 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:40:28.510025 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-f735d520-dc07-4bdd-a6e9-07b6f578c101 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:40:28.511244 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-f735d520-dc07-4bdd-a6e9-07b6f578c101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:40:28.616604 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 653/1308] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:40:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 14:40:28.665680 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827b30a2-5876-4c6e-8911-78c1dec3ad87 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:40:28.667106 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827b30a2-5876-4c6e-8911-78c1dec3ad87 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:40:28.668315 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827b30a2-5876-4c6e-8911-78c1dec3ad87 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:40:28.674025 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 656/1309] 10.222.0.15 () {54 vars in 964 bytes} [Tue May 31 14:40:28 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:40:28.679018 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d09bc98-af15-43a0-b431-ab4a3900c295 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:40:28.679304 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d09bc98-af15-43a0-b431-ab4a3900c295 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:40:28.679587 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d09bc98-af15-43a0-b431-ab4a3900c295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:40:28.770762 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-9d09bc98-af15-43a0-b431-ab4a3900c295 None None] MFA Rules not processed for user `c5262f4b9b2948fdb3b4ab504311453b`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:40:28.772002 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-9d09bc98-af15-43a0-b431-ab4a3900c295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:40:28.807331 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:40:28.871050 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 654/1310] 10.222.0.15 () {58 vars in 1061 bytes} [Tue May 31 14:40:28 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:40:28.880465 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827b30a2-5876-4c6e-8911-78c1dec3ad87 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:40:28.882258 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-827b30a2-5876-4c6e-8911-78c1dec3ad87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:40:29.027659 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827b30a2-5876-4c6e-8911-78c1dec3ad87 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:40:29.108517 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35a4a01-57c8-4837-a49c-d95adbe03b53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:40:29.109182 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a4a01-57c8-4837-a49c-d95adbe03b53 service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:40:29.109462 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a4a01-57c8-4837-a49c-d95adbe03b53 service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:40:29.109736 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a4a01-57c8-4837-a49c-d95adbe03b53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:40:29.111490 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-b35a4a01-57c8-4837-a49c-d95adbe03b53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:40:29.169109 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:40:29.224004 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35a4a01-57c8-4837-a49c-d95adbe03b53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:40:29.225426 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35a4a01-57c8-4837-a49c-d95adbe03b53 service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:40:29.246135 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 657/1311] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:40:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:40:31.780388 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae365a99-6590-4b41-aee1-67f86f3e11f3 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:40:31.780933 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae365a99-6590-4b41-aee1-67f86f3e11f3 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:40:31.781044 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae365a99-6590-4b41-aee1-67f86f3e11f3 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:40:31.782789 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 655/1312] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:40:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:40:31.788489 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dfee6d-a19b-4166-b919-6d7afab0224d None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:40:31.788954 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dfee6d-a19b-4166-b919-6d7afab0224d None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:40:31.789038 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dfee6d-a19b-4166-b919-6d7afab0224d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:40:31.877642 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-11dfee6d-a19b-4166-b919-6d7afab0224d None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:40:31.878889 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-11dfee6d-a19b-4166-b919-6d7afab0224d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:40:31.992771 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 658/1313] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:40:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:40:32.031895 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae365a99-6590-4b41-aee1-67f86f3e11f3 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:40:32.033421 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-ae365a99-6590-4b41-aee1-67f86f3e11f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:40:32.141613 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae365a99-6590-4b41-aee1-67f86f3e11f3 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:40:32.216160 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:40:32.219011 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c68f190-4ba0-4248-b222-645d3060c35f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:40:32.219658 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68f190-4ba0-4248-b222-645d3060c35f service neutron] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:40:32.219954 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68f190-4ba0-4248-b222-645d3060c35f service neutron] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:40:32.220219 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68f190-4ba0-4248-b222-645d3060c35f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:40:32.221915 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-8c68f190-4ba0-4248-b222-645d3060c35f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:40:32.337794 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c68f190-4ba0-4248-b222-645d3060c35f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:40:32.339293 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c68f190-4ba0-4248-b222-645d3060c35f service neutron] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:40:32.357928 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 656/1314] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:40:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:40:35.154782 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a0560a-850a-4fca-949f-5e7205c0b350 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:40:35.155305 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a0560a-850a-4fca-949f-5e7205c0b350 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:40:35.155305 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a0560a-850a-4fca-949f-5e7205c0b350 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:40:35.156669 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 659/1315] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:40:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:40:35.161814 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e19e83f-27cd-4541-b033-8ee330163eb6 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:40:35.162212 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e19e83f-27cd-4541-b033-8ee330163eb6 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:40:35.162374 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e19e83f-27cd-4541-b033-8ee330163eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:40:35.227395 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-6e19e83f-27cd-4541-b033-8ee330163eb6 None None] MFA Rules not processed for user `6c51550d3d834029bb4659c457cb292f`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:40:35.228606 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-6e19e83f-27cd-4541-b033-8ee330163eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:40:35.280169 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:40:35.323883 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 657/1316] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:40:35 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:40:35.364122 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a0560a-850a-4fca-949f-5e7205c0b350 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:40:35.365665 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-64a0560a-850a-4fca-949f-5e7205c0b350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:40:35.375285 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:40:35.466326 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a0560a-850a-4fca-949f-5e7205c0b350 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:40:35.537275 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2a4450-3af6-438b-8180-3dd535a97cd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:40:35.537912 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a4450-3af6-438b-8180-3dd535a97cd8 service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:40:35.538194 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a4450-3af6-438b-8180-3dd535a97cd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:40:35.538468 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a4450-3af6-438b-8180-3dd535a97cd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:40:35.540378 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-8d2a4450-3af6-438b-8180-3dd535a97cd8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:40:35.599961 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:40:35.645924 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2a4450-3af6-438b-8180-3dd535a97cd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:40:35.647387 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2a4450-3af6-438b-8180-3dd535a97cd8 service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:40:35.665505 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 660/1317] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:40:35 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:40:38.718240 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d032c2-48e4-4220-bb44-f7c6d616184c None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:40:38.718801 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d032c2-48e4-4220-bb44-f7c6d616184c None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:40:38.718801 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d032c2-48e4-4220-bb44-f7c6d616184c None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:40:38.720072 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 658/1318] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:40:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:40:38.725651 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86f2ed2-df82-4770-a238-49ebdb544f63 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:40:38.726073 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86f2ed2-df82-4770-a238-49ebdb544f63 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:40:38.726212 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86f2ed2-df82-4770-a238-49ebdb544f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:40:38.790276 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-d86f2ed2-df82-4770-a238-49ebdb544f63 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:40:38.791494 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-d86f2ed2-df82-4770-a238-49ebdb544f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:40:38.883264 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 661/1319] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:40:38 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:40:38.941250 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36764ba-4818-4d58-8d4e-f06ef2ca9f16 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:40:38.941541 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36764ba-4818-4d58-8d4e-f06ef2ca9f16 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:40:38.941826 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36764ba-4818-4d58-8d4e-f06ef2ca9f16 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:40:38.943239 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 659/1320] 10.222.0.15 () {54 vars in 964 bytes} [Tue May 31 14:40:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:40:38.949717 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e22510-a852-4418-99b7-f02bd296d7ff None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:40:38.950006 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e22510-a852-4418-99b7-f02bd296d7ff None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:40:38.950287 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e22510-a852-4418-99b7-f02bd296d7ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:40:38.970985 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:40:39.023622 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-82e22510-a852-4418-99b7-f02bd296d7ff None None] MFA Rules not processed for user `c5262f4b9b2948fdb3b4ab504311453b`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:40:39.024811 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-82e22510-a852-4418-99b7-f02bd296d7ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:40:39.099817 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 662/1321] 10.222.0.15 () {58 vars in 1061 bytes} [Tue May 31 14:40:38 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:40:39.109003 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36764ba-4818-4d58-8d4e-f06ef2ca9f16 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:40:39.110526 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-a36764ba-4818-4d58-8d4e-f06ef2ca9f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:40:39.213196 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36764ba-4818-4d58-8d4e-f06ef2ca9f16 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:40:39.285479 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b816edd2-ad7c-4519-8921-454fc967107c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:40:39.286053 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b816edd2-ad7c-4519-8921-454fc967107c service neutron] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:40:39.286335 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b816edd2-ad7c-4519-8921-454fc967107c service neutron] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:40:39.286647 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b816edd2-ad7c-4519-8921-454fc967107c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:40:39.288299 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-b816edd2-ad7c-4519-8921-454fc967107c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:40:39.296022 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:40:39.393496 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b816edd2-ad7c-4519-8921-454fc967107c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:40:39.394953 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b816edd2-ad7c-4519-8921-454fc967107c service neutron] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:40:39.412025 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 660/1322] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:40:39 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:40:43.068759 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e7ad93-05ce-445c-be29-c5537629ecb8 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:40:43.069311 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e7ad93-05ce-445c-be29-c5537629ecb8 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:40:43.069403 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e7ad93-05ce-445c-be29-c5537629ecb8 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:40:43.070746 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 663/1323] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:40:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:40:43.076273 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29f4e2e-36fa-4601-8a15-3721521d5616 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:40:43.076716 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29f4e2e-36fa-4601-8a15-3721521d5616 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:40:43.076897 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29f4e2e-36fa-4601-8a15-3721521d5616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:40:43.140983 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-c29f4e2e-36fa-4601-8a15-3721521d5616 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:40:43.142188 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-c29f4e2e-36fa-4601-8a15-3721521d5616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:40:43.199143 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:40:43.238181 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 661/1324] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:40:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:40:43.274706 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e7ad93-05ce-445c-be29-c5537629ecb8 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:40:43.276276 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-41e7ad93-05ce-445c-be29-c5537629ecb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:40:43.383321 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e7ad93-05ce-445c-be29-c5537629ecb8 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:40:43.396187 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:40:43.459030 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa7bd25-2128-4fbd-b8ef-1839f806d980 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:40:43.459673 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa7bd25-2128-4fbd-b8ef-1839f806d980 service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:40:43.459957 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa7bd25-2128-4fbd-b8ef-1839f806d980 service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:40:43.460233 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa7bd25-2128-4fbd-b8ef-1839f806d980 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:40:43.461910 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-4fa7bd25-2128-4fbd-b8ef-1839f806d980 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:40:43.572767 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa7bd25-2128-4fbd-b8ef-1839f806d980 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:40:43.574871 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa7bd25-2128-4fbd-b8ef-1839f806d980 service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:40:43.593639 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 664/1325] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:40:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:40:45.926782 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae43fca-8a5a-42ef-8ed0-25892df7e6f9 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:40:45.927378 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae43fca-8a5a-42ef-8ed0-25892df7e6f9 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:40:45.927378 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae43fca-8a5a-42ef-8ed0-25892df7e6f9 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:40:45.928775 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 662/1326] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:40:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:40:45.934134 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae53411c-f9a1-4694-b04e-b3862f7048da None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:40:45.934539 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae53411c-f9a1-4694-b04e-b3862f7048da None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:40:45.934736 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae53411c-f9a1-4694-b04e-b3862f7048da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:40:45.983163 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:40:46.001267 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-ae53411c-f9a1-4694-b04e-b3862f7048da None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:40:46.002510 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-ae53411c-f9a1-4694-b04e-b3862f7048da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:40:46.103756 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 665/1327] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:40:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:40:46.140199 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae43fca-8a5a-42ef-8ed0-25892df7e6f9 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:40:46.141732 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-5ae43fca-8a5a-42ef-8ed0-25892df7e6f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:40:46.250006 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae43fca-8a5a-42ef-8ed0-25892df7e6f9 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:40:46.326418 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678d102a-6f88-4aab-8500-4f837fd7f5ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:40:46.327092 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d102a-6f88-4aab-8500-4f837fd7f5ef service neutron] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:40:46.327374 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d102a-6f88-4aab-8500-4f837fd7f5ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:40:46.327650 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d102a-6f88-4aab-8500-4f837fd7f5ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:40:46.329338 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-678d102a-6f88-4aab-8500-4f837fd7f5ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:40:46.347767 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:40:46.436996 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678d102a-6f88-4aab-8500-4f837fd7f5ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:40:46.438425 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678d102a-6f88-4aab-8500-4f837fd7f5ef service neutron] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:40:46.456384 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 663/1328] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:40:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:40:48.782479 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b0ceb6-3e9d-455c-bad6-5fda7f18714f None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:40:48.783046 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b0ceb6-3e9d-455c-bad6-5fda7f18714f None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:40:48.783046 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b0ceb6-3e9d-455c-bad6-5fda7f18714f None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:40:48.784500 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 666/1329] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:40:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:40:48.789752 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5453e7-3284-4dee-a904-447a966ba159 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:40:48.790140 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5453e7-3284-4dee-a904-447a966ba159 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:40:48.790319 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5453e7-3284-4dee-a904-447a966ba159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:40:48.854990 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-8b5453e7-3284-4dee-a904-447a966ba159 None None] MFA Rules not processed for user `6c51550d3d834029bb4659c457cb292f`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:40:48.856206 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-8b5453e7-3284-4dee-a904-447a966ba159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:40:48.920267 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:40:48.951264 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 664/1330] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:40:48 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:40:48.989780 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b0ceb6-3e9d-455c-bad6-5fda7f18714f None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:40:48.991364 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-36b0ceb6-3e9d-455c-bad6-5fda7f18714f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:40:49.097629 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b0ceb6-3e9d-455c-bad6-5fda7f18714f None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:40:49.118147 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:40:49.171741 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c815da-b252-48c2-af84-4fbd23e2fa71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:40:49.172406 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c815da-b252-48c2-af84-4fbd23e2fa71 service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:40:49.172686 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c815da-b252-48c2-af84-4fbd23e2fa71 service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:40:49.172957 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c815da-b252-48c2-af84-4fbd23e2fa71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:40:49.174603 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-d0c815da-b252-48c2-af84-4fbd23e2fa71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:40:49.282683 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c815da-b252-48c2-af84-4fbd23e2fa71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:40:49.284151 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c815da-b252-48c2-af84-4fbd23e2fa71 service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:40:49.304803 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 667/1331] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:40:48 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 14:40:51.984588 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1713161c-0235-44c8-a368-6e43bc99ff98 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:40:51.985085 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1713161c-0235-44c8-a368-6e43bc99ff98 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:40:51.985199 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1713161c-0235-44c8-a368-6e43bc99ff98 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:40:51.986500 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 665/1332] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:40:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:40:51.991670 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef28170-9ec2-48fc-8eb7-eed505609016 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:40:51.992194 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef28170-9ec2-48fc-8eb7-eed505609016 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:40:51.992302 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef28170-9ec2-48fc-8eb7-eed505609016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:40:52.053910 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:40:52.057961 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-4ef28170-9ec2-48fc-8eb7-eed505609016 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:40:52.059187 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-4ef28170-9ec2-48fc-8eb7-eed505609016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:40:52.156114 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 668/1333] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:40:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:40:52.192223 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1713161c-0235-44c8-a368-6e43bc99ff98 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:40:52.193800 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-1713161c-0235-44c8-a368-6e43bc99ff98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:40:52.298843 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1713161c-0235-44c8-a368-6e43bc99ff98 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:40:52.371113 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bdca02-c72d-4c2f-be1a-4064a56722c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:40:52.371760 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bdca02-c72d-4c2f-be1a-4064a56722c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:40:52.372047 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bdca02-c72d-4c2f-be1a-4064a56722c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:40:52.372329 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bdca02-c72d-4c2f-be1a-4064a56722c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:40:52.373971 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-c4bdca02-c72d-4c2f-be1a-4064a56722c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:40:52.400594 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:40:52.484987 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bdca02-c72d-4c2f-be1a-4064a56722c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:40:52.486661 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bdca02-c72d-4c2f-be1a-4064a56722c2 service neutron] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:40:52.510946 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 666/1334] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:40:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:40:54.810330 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa7e5bb-5e58-461b-af5e-8cc1dc75bbf2 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:40:54.810881 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa7e5bb-5e58-461b-af5e-8cc1dc75bbf2 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:40:54.810977 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa7e5bb-5e58-461b-af5e-8cc1dc75bbf2 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:40:54.812260 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 669/1335] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:40:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:40:54.817526 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5155b33-797d-4169-9c0c-397255f142e4 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:40:54.817949 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5155b33-797d-4169-9c0c-397255f142e4 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:40:54.818096 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5155b33-797d-4169-9c0c-397255f142e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:40:54.883438 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-b5155b33-797d-4169-9c0c-397255f142e4 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:40:54.884567 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-b5155b33-797d-4169-9c0c-397255f142e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:40:54.956991 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:40:54.978871 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 667/1336] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:40:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:40:55.019782 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa7e5bb-5e58-461b-af5e-8cc1dc75bbf2 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:40:55.021362 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-eaa7e5bb-5e58-461b-af5e-8cc1dc75bbf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:40:55.125496 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa7e5bb-5e58-461b-af5e-8cc1dc75bbf2 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:40:55.153888 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:40:55.197995 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5a8b96-69d0-4e03-bfb3-a8c7e646ca3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:40:55.198663 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5a8b96-69d0-4e03-bfb3-a8c7e646ca3f service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:40:55.199446 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5a8b96-69d0-4e03-bfb3-a8c7e646ca3f service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:40:55.199717 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5a8b96-69d0-4e03-bfb3-a8c7e646ca3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:40:55.201376 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-ab5a8b96-69d0-4e03-bfb3-a8c7e646ca3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:40:55.313827 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5a8b96-69d0-4e03-bfb3-a8c7e646ca3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:40:55.315300 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5a8b96-69d0-4e03-bfb3-a8c7e646ca3f service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:40:55.335098 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 670/1337] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:40:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:40:58.326640 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253aa89a-87f3-429c-94a1-aa4b84a19021 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:40:58.327110 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253aa89a-87f3-429c-94a1-aa4b84a19021 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:40:58.327222 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253aa89a-87f3-429c-94a1-aa4b84a19021 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:40:58.328586 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 668/1338] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:40:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:40:58.333790 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dbee8f-6a42-4bc5-9e8f-c68cb22887ce None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:40:58.334227 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dbee8f-6a42-4bc5-9e8f-c68cb22887ce None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:40:58.334330 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dbee8f-6a42-4bc5-9e8f-c68cb22887ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:40:58.400640 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-98dbee8f-6a42-4bc5-9e8f-c68cb22887ce None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:40:58.401878 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-98dbee8f-6a42-4bc5-9e8f-c68cb22887ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:40:58.410591 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:40:58.497508 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 671/1339] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:40:58 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:40:58.533178 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253aa89a-87f3-429c-94a1-aa4b84a19021 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:40:58.536161 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-253aa89a-87f3-429c-94a1-aa4b84a19021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:40:58.644440 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253aa89a-87f3-429c-94a1-aa4b84a19021 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:40:58.647978 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9615fd7c-6064-4343-8aea-69f3765705db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:40:58.648619 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9615fd7c-6064-4343-8aea-69f3765705db service neutron] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:40:58.648901 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9615fd7c-6064-4343-8aea-69f3765705db service neutron] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:40:58.649177 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9615fd7c-6064-4343-8aea-69f3765705db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:40:58.650946 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-9615fd7c-6064-4343-8aea-69f3765705db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:40:58.748794 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9615fd7c-6064-4343-8aea-69f3765705db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:40:58.750210 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9615fd7c-6064-4343-8aea-69f3765705db service neutron] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:40:58.760173 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:40:58.769330 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 669/1340] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:40:58 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:41:03.278682 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2fee3a-e6ac-4e5d-a242-6d5bbb70384c None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:41:03.279303 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2fee3a-e6ac-4e5d-a242-6d5bbb70384c None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:41:03.279303 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2fee3a-e6ac-4e5d-a242-6d5bbb70384c None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:41:03.280872 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 672/1341] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:41:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:41:03.285854 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3252d298-f365-42c2-8462-172848aef601 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:41:03.286292 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3252d298-f365-42c2-8462-172848aef601 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:41:03.286450 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3252d298-f365-42c2-8462-172848aef601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:41:03.334900 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-3252d298-f365-42c2-8462-172848aef601 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:41:03.336031 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-3252d298-f365-42c2-8462-172848aef601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:41:03.413637 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 670/1342] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:41:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:41:03.453172 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2fee3a-e6ac-4e5d-a242-6d5bbb70384c None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:41:03.455373 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-0d2fee3a-e6ac-4e5d-a242-6d5bbb70384c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:41:03.468556 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2fee3a-e6ac-4e5d-a242-6d5bbb70384c None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:41:03.471999 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4bb086-d8bf-4478-ac00-45a83dbb3219 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:41:03.472623 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4bb086-d8bf-4478-ac00-45a83dbb3219 service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:41:03.472911 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4bb086-d8bf-4478-ac00-45a83dbb3219 service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:41:03.473179 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4bb086-d8bf-4478-ac00-45a83dbb3219 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:41:03.482414 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4bb086-d8bf-4478-ac00-45a83dbb3219 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:41:03.483854 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4bb086-d8bf-4478-ac00-45a83dbb3219 service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:41:03.492970 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 673/1343] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:41:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:41:06.887247 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fcef93-965e-4abc-aef8-ee2745c2737a None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:41:06.887845 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fcef93-965e-4abc-aef8-ee2745c2737a None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:41:06.887845 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fcef93-965e-4abc-aef8-ee2745c2737a None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:41:06.889182 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 671/1344] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:41:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:41:06.894376 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17599bd8-f0ba-4520-b6fc-7e1791dcc556 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:41:06.894844 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17599bd8-f0ba-4520-b6fc-7e1791dcc556 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:41:06.894971 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17599bd8-f0ba-4520-b6fc-7e1791dcc556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:41:06.923698 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-17599bd8-f0ba-4520-b6fc-7e1791dcc556 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:41:06.925229 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-17599bd8-f0ba-4520-b6fc-7e1791dcc556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:41:06.933173 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 674/1345] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:41:06 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:41:06.970520 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fcef93-965e-4abc-aef8-ee2745c2737a None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:41:06.981776 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fcef93-965e-4abc-aef8-ee2745c2737a None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:41:06.985292 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba544a5b-61c7-4f7b-acf8-5901d4f93704 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:41:06.985928 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba544a5b-61c7-4f7b-acf8-5901d4f93704 service neutron] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:41:06.986210 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba544a5b-61c7-4f7b-acf8-5901d4f93704 service neutron] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:41:06.986487 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba544a5b-61c7-4f7b-acf8-5901d4f93704 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:41:06.995752 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba544a5b-61c7-4f7b-acf8-5901d4f93704 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:41:06.997223 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba544a5b-61c7-4f7b-acf8-5901d4f93704 service neutron] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:41:07.008924 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 672/1346] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:41:06 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:41:11.601853 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e0c701-79e6-4b3a-b4bb-fb51296233c8 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:41:11.602395 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e0c701-79e6-4b3a-b4bb-fb51296233c8 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:41:11.602511 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e0c701-79e6-4b3a-b4bb-fb51296233c8 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:41:11.603825 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 675/1347] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:41:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:41:11.609653 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409059eb-9569-47b4-866c-e0eb445a8327 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:41:11.610083 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409059eb-9569-47b4-866c-e0eb445a8327 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:41:11.610210 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409059eb-9569-47b4-866c-e0eb445a8327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:41:11.628658 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-409059eb-9569-47b4-866c-e0eb445a8327 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:41:11.629830 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-409059eb-9569-47b4-866c-e0eb445a8327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:41:11.638189 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 673/1348] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:41:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:41:11.676439 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e0c701-79e6-4b3a-b4bb-fb51296233c8 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:41:11.687091 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e0c701-79e6-4b3a-b4bb-fb51296233c8 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:41:11.690566 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e054eec7-dae9-450d-bce7-2acf4126ac35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:41:11.691203 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e054eec7-dae9-450d-bce7-2acf4126ac35 service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:41:11.691484 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e054eec7-dae9-450d-bce7-2acf4126ac35 service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:41:11.691759 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e054eec7-dae9-450d-bce7-2acf4126ac35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:41:11.700990 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e054eec7-dae9-450d-bce7-2acf4126ac35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:41:11.702410 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e054eec7-dae9-450d-bce7-2acf4126ac35 service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:41:11.711700 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 676/1349] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:41:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:41:17.015041 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb0f939-9446-4509-b126-003aba4ae118 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:41:17.016019 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb0f939-9446-4509-b126-003aba4ae118 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:41:17.016516 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb0f939-9446-4509-b126-003aba4ae118 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:41:17.018457 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 674/1350] 10.222.0.15 () {54 vars in 921 bytes} [Tue May 31 14:41:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:41:17.023716 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2de28c3-25b2-4cd4-9ca6-3111941b2d23 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:41:17.024172 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2de28c3-25b2-4cd4-9ca6-3111941b2d23 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:41:17.024264 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2de28c3-25b2-4cd4-9ca6-3111941b2d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:41:17.110677 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-c2de28c3-25b2-4cd4-9ca6-3111941b2d23 None None] MFA Rules not processed for user `efc959ca520c4816b5ff7f95655e53e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:41:17.112107 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-c2de28c3-25b2-4cd4-9ca6-3111941b2d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:41:17.160517 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:41:17.191201 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 677/1351] 10.222.0.15 () {58 vars in 1018 bytes} [Tue May 31 14:41:17 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:41:21.589219 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeae368-29c5-493c-887a-f13b0ce1e094 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:41:21.589797 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeae368-29c5-493c-887a-f13b0ce1e094 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:41:21.590088 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeae368-29c5-493c-887a-f13b0ce1e094 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:41:21.592003 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 675/1352] 10.222.0.15 () {54 vars in 921 bytes} [Tue May 31 14:41:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:41:21.597448 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349852e7-5ba9-414c-ac05-013517fed4e5 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:41:21.597878 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349852e7-5ba9-414c-ac05-013517fed4e5 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:41:21.598018 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349852e7-5ba9-414c-ac05-013517fed4e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:41:21.616771 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-349852e7-5ba9-414c-ac05-013517fed4e5 None None] MFA Rules not processed for user `efc959ca520c4816b5ff7f95655e53e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:41:21.618044 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-349852e7-5ba9-414c-ac05-013517fed4e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:41:21.623730 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=56 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:41:21.627103 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 678/1353] 10.222.0.15 () {58 vars in 1018 bytes} [Tue May 31 14:41:21 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:41:23.196293 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfbaa35-3db3-4690-b4d2-acd2b835628f None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:41:23.196847 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfbaa35-3db3-4690-b4d2-acd2b835628f None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:41:23.196929 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfbaa35-3db3-4690-b4d2-acd2b835628f None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:41:23.198257 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 676/1354] 10.222.0.15 () {54 vars in 921 bytes} [Tue May 31 14:41:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:41:23.204432 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25696d63-8b42-4bbb-b92a-72ddeefa915a None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:41:23.204916 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25696d63-8b42-4bbb-b92a-72ddeefa915a None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:41:23.205185 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25696d63-8b42-4bbb-b92a-72ddeefa915a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:41:23.223349 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-25696d63-8b42-4bbb-b92a-72ddeefa915a None None] MFA Rules not processed for user `efc959ca520c4816b5ff7f95655e53e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:41:23.224578 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-25696d63-8b42-4bbb-b92a-72ddeefa915a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:41:23.233796 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 679/1355] 10.222.0.15 () {58 vars in 1018 bytes} [Tue May 31 14:41:23 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:41:27.174755 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e6c62d-0653-4ca5-bf1f-48a87103e51e None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:41:27.175288 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e6c62d-0653-4ca5-bf1f-48a87103e51e None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:41:27.175288 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e6c62d-0653-4ca5-bf1f-48a87103e51e None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:41:27.180481 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 677/1356] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:41:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:41:27.182484 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cfee48-6c7c-4231-9620-98f3d410bae3 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:41:27.182942 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cfee48-6c7c-4231-9620-98f3d410bae3 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:41:27.183109 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cfee48-6c7c-4231-9620-98f3d410bae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:41:27.201793 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-d6cfee48-6c7c-4231-9620-98f3d410bae3 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:41:27.203338 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-d6cfee48-6c7c-4231-9620-98f3d410bae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:41:27.226099 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 680/1357] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:41:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:41:27.270318 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154b8e08-59d5-4455-a931-b79fe345b90a None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:41:27.270845 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154b8e08-59d5-4455-a931-b79fe345b90a None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:41:27.271193 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154b8e08-59d5-4455-a931-b79fe345b90a None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:41:27.272995 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 678/1358] 10.222.0.15 () {54 vars in 961 bytes} [Tue May 31 14:41:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:41:27.281532 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ebc01-4288-4858-b730-570a7cb92068 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:41:27.281824 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ebc01-4288-4858-b730-570a7cb92068 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:41:27.282111 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ebc01-4288-4858-b730-570a7cb92068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:41:27.337173 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-5e0ebc01-4288-4858-b730-570a7cb92068 None None] MFA Rules not processed for user `b57768d448e345ad8879bf29f21b48ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:41:27.338724 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-5e0ebc01-4288-4858-b730-570a7cb92068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:41:27.427208 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 681/1359] 10.222.0.15 () {58 vars in 1058 bytes} [Tue May 31 14:41:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 14:41:27.435825 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154b8e08-59d5-4455-a931-b79fe345b90a None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:41:27.453514 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154b8e08-59d5-4455-a931-b79fe345b90a None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:41:27.460867 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea9dc73-0662-46fd-b342-ab5241ff6a5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57768d448e345ad8879bf29f21b48ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:41:27.464911 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea9dc73-0662-46fd-b342-ab5241ff6a5b service nova] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:41:27.464911 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea9dc73-0662-46fd-b342-ab5241ff6a5b service nova] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:41:27.464911 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea9dc73-0662-46fd-b342-ab5241ff6a5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:41:27.471620 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea9dc73-0662-46fd-b342-ab5241ff6a5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:41:27.473202 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea9dc73-0662-46fd-b342-ab5241ff6a5b service nova] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:41:27.484979 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 679/1360] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:41:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:41:30.007681 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801de2c2-d790-44f4-a93e-71cc332a7984 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:41:30.008283 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801de2c2-d790-44f4-a93e-71cc332a7984 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:41:30.008283 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801de2c2-d790-44f4-a93e-71cc332a7984 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:41:30.009755 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 682/1361] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:41:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:41:30.014895 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112fa8d3-6999-42eb-89d0-9d16e479e4bc None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:41:30.015330 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112fa8d3-6999-42eb-89d0-9d16e479e4bc None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:41:30.015432 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112fa8d3-6999-42eb-89d0-9d16e479e4bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:41:30.034178 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-112fa8d3-6999-42eb-89d0-9d16e479e4bc None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:41:30.035342 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-112fa8d3-6999-42eb-89d0-9d16e479e4bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:41:30.043980 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 680/1362] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:41:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:41:30.089333 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801de2c2-d790-44f4-a93e-71cc332a7984 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:41:30.104781 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801de2c2-d790-44f4-a93e-71cc332a7984 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:41:30.110961 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424c159f-3f3c-45f9-b60f-15f6f6d2b981 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57768d448e345ad8879bf29f21b48ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:41:30.111709 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c159f-3f3c-45f9-b60f-15f6f6d2b981 service nova] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:41:30.112096 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c159f-3f3c-45f9-b60f-15f6f6d2b981 service nova] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:41:30.112473 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c159f-3f3c-45f9-b60f-15f6f6d2b981 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:41:30.121077 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424c159f-3f3c-45f9-b60f-15f6f6d2b981 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:41:30.122943 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424c159f-3f3c-45f9-b60f-15f6f6d2b981 service nova] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:41:30.132945 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 683/1363] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:41:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 14:41:32.888049 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f6de4-ee06-4e46-92fb-d4631b18e4e2 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:41:32.888572 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f6de4-ee06-4e46-92fb-d4631b18e4e2 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:41:32.888572 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f6de4-ee06-4e46-92fb-d4631b18e4e2 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:41:32.889890 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 681/1364] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:41:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:41:32.895328 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56db2fb7-199d-4272-b3cb-ebdbf2841aae None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:41:32.895761 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56db2fb7-199d-4272-b3cb-ebdbf2841aae None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:41:32.895907 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56db2fb7-199d-4272-b3cb-ebdbf2841aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:41:32.913901 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-56db2fb7-199d-4272-b3cb-ebdbf2841aae None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:41:32.915692 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-56db2fb7-199d-4272-b3cb-ebdbf2841aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:41:32.923854 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 684/1365] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:41:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:41:32.971098 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdda3d33-f506-41d7-996a-5141dcfac31e None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:41:32.971399 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdda3d33-f506-41d7-996a-5141dcfac31e None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:41:32.971688 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdda3d33-f506-41d7-996a-5141dcfac31e None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:41:32.973038 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 682/1366] 10.222.0.15 () {54 vars in 961 bytes} [Tue May 31 14:41:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:41:32.978903 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5b586a-44f0-4ade-b005-26e1d092e733 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:41:32.979198 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5b586a-44f0-4ade-b005-26e1d092e733 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:41:32.979486 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5b586a-44f0-4ade-b005-26e1d092e733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:41:32.998314 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-6e5b586a-44f0-4ade-b005-26e1d092e733 None None] MFA Rules not processed for user `b57768d448e345ad8879bf29f21b48ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:41:32.999575 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-6e5b586a-44f0-4ade-b005-26e1d092e733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:41:33.008807 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 685/1367] 10.222.0.15 () {58 vars in 1058 bytes} [Tue May 31 14:41:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 14:41:33.016367 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdda3d33-f506-41d7-996a-5141dcfac31e None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:41:33.031382 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdda3d33-f506-41d7-996a-5141dcfac31e None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:41:33.036768 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18428e3a-76e0-4f88-826f-0efd36be54c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57768d448e345ad8879bf29f21b48ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:41:33.037399 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18428e3a-76e0-4f88-826f-0efd36be54c8 service nova] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:41:33.037935 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18428e3a-76e0-4f88-826f-0efd36be54c8 service nova] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:41:33.038214 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18428e3a-76e0-4f88-826f-0efd36be54c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:41:33.047082 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18428e3a-76e0-4f88-826f-0efd36be54c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:41:33.048659 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18428e3a-76e0-4f88-826f-0efd36be54c8 service nova] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:41:33.058785 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 683/1368] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:41:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 14:41:35.568693 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e40d44a-2125-44fd-b1ee-a910d147e6e4 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:41:35.569198 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e40d44a-2125-44fd-b1ee-a910d147e6e4 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:41:35.569198 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e40d44a-2125-44fd-b1ee-a910d147e6e4 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:41:35.570508 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 686/1369] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:41:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:41:35.576538 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dbf578-a7a6-4184-94a5-082a5c8f980d None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:41:35.576986 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dbf578-a7a6-4184-94a5-082a5c8f980d None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:41:35.577177 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dbf578-a7a6-4184-94a5-082a5c8f980d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:41:35.581683 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd088bc-d023-49df-b4ef-5aefcc52b80a None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:41:35.581977 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd088bc-d023-49df-b4ef-5aefcc52b80a None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:41:35.582255 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd088bc-d023-49df-b4ef-5aefcc52b80a None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:41:35.583623 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 687/1370] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:41:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:41:35.590045 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e7e6f-4039-4cbc-8d2c-240202a54583 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:41:35.590329 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e7e6f-4039-4cbc-8d2c-240202a54583 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:41:35.590646 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e7e6f-4039-4cbc-8d2c-240202a54583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:41:35.597439 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-41dbf578-a7a6-4184-94a5-082a5c8f980d None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:41:35.598780 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-41dbf578-a7a6-4184-94a5-082a5c8f980d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:41:35.607884 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 684/1371] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:41:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:41:35.609813 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-912e7e6f-4039-4cbc-8d2c-240202a54583 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:41:35.611106 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-912e7e6f-4039-4cbc-8d2c-240202a54583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:41:35.620354 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 688/1372] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:41:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 14:41:35.667573 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dbf578-a7a6-4184-94a5-082a5c8f980d None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:41:35.682539 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dbf578-a7a6-4184-94a5-082a5c8f980d None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:41:35.688393 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7349b74a-00b4-4ecb-8d53-7293b1d9d0b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57768d448e345ad8879bf29f21b48ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:41:35.689147 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7349b74a-00b4-4ecb-8d53-7293b1d9d0b2 service nova] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:41:35.689527 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7349b74a-00b4-4ecb-8d53-7293b1d9d0b2 service nova] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:41:35.689915 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7349b74a-00b4-4ecb-8d53-7293b1d9d0b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:41:35.698887 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7349b74a-00b4-4ecb-8d53-7293b1d9d0b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:41:35.700567 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7349b74a-00b4-4ecb-8d53-7293b1d9d0b2 service nova] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:41:35.710322 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 685/1373] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:41:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:41:35.918154 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e555f4c-7e44-475d-86a5-edbe52437a29 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:41:35.918453 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e555f4c-7e44-475d-86a5-edbe52437a29 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:41:35.922158 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e555f4c-7e44-475d-86a5-edbe52437a29 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:41:35.922158 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 689/1374] 10.222.0.15 () {54 vars in 963 bytes} [Tue May 31 14:41:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:41:35.929793 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b963b-61e6-4b76-b56a-a2fe869893a6 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:41:35.930934 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b963b-61e6-4b76-b56a-a2fe869893a6 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:41:35.931397 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b963b-61e6-4b76-b56a-a2fe869893a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:41:35.993498 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-a15b963b-61e6-4b76-b56a-a2fe869893a6 None None] MFA Rules not processed for user `afbf718dcd9b4741a926b0a2321bd53e`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:41:35.994907 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-a15b963b-61e6-4b76-b56a-a2fe869893a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:41:36.065763 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 686/1375] 10.222.0.15 () {58 vars in 1060 bytes} [Tue May 31 14:41:35 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:41:36.074589 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e555f4c-7e44-475d-86a5-edbe52437a29 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:41:36.087074 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e555f4c-7e44-475d-86a5-edbe52437a29 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:41:36.091558 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681fe173-7928-4b97-a8b6-0e254597acca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afbf718dcd9b4741a926b0a2321bd53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:41:36.092296 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681fe173-7928-4b97-a8b6-0e254597acca service cinder] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:41:36.092582 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681fe173-7928-4b97-a8b6-0e254597acca service cinder] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:41:36.092857 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681fe173-7928-4b97-a8b6-0e254597acca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:41:36.104184 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681fe173-7928-4b97-a8b6-0e254597acca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:41:36.105651 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681fe173-7928-4b97-a8b6-0e254597acca service cinder] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:41:36.116951 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 690/1376] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:41:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:41:38.174050 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e594ab-ecde-4548-bb70-06da0f9e459c None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:41:38.174660 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e594ab-ecde-4548-bb70-06da0f9e459c None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:41:38.174660 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e594ab-ecde-4548-bb70-06da0f9e459c None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:41:38.176058 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 687/1377] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:41:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:41:38.182025 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d92087-948c-46f8-b0ea-5ba89d77caab None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:41:38.182631 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d92087-948c-46f8-b0ea-5ba89d77caab None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:41:38.182631 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d92087-948c-46f8-b0ea-5ba89d77caab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:41:38.201766 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-e2d92087-948c-46f8-b0ea-5ba89d77caab None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:41:38.203012 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-e2d92087-948c-46f8-b0ea-5ba89d77caab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:41:38.211056 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 691/1378] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:41:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:41:38.256484 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e594ab-ecde-4548-bb70-06da0f9e459c None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:41:38.271815 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e594ab-ecde-4548-bb70-06da0f9e459c None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:41:38.277303 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ce010b-b8e2-4be3-be2f-633c8bc16952 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57768d448e345ad8879bf29f21b48ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:41:38.277943 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce010b-b8e2-4be3-be2f-633c8bc16952 service nova] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:41:38.278232 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce010b-b8e2-4be3-be2f-633c8bc16952 service nova] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:41:38.278516 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce010b-b8e2-4be3-be2f-633c8bc16952 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:41:38.295222 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ce010b-b8e2-4be3-be2f-633c8bc16952 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:41:38.296850 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ce010b-b8e2-4be3-be2f-633c8bc16952 service nova] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:41:38.307656 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 688/1379] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:41:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:41:40.727510 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd1b1f2-9a1e-4312-943e-822852f150fd None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:41:40.728037 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd1b1f2-9a1e-4312-943e-822852f150fd None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:41:40.728037 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd1b1f2-9a1e-4312-943e-822852f150fd None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:41:40.729296 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 692/1380] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:41:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:41:40.734411 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a2811f-7eb4-4392-9b10-9ae37221c983 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:41:40.734912 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a2811f-7eb4-4392-9b10-9ae37221c983 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:41:40.734998 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a2811f-7eb4-4392-9b10-9ae37221c983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:41:40.753186 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-67a2811f-7eb4-4392-9b10-9ae37221c983 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:41:40.754759 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-67a2811f-7eb4-4392-9b10-9ae37221c983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:41:40.762905 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 689/1381] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:41:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:41:40.807294 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd1b1f2-9a1e-4312-943e-822852f150fd None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:41:40.822185 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd1b1f2-9a1e-4312-943e-822852f150fd None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:41:40.827731 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1216785f-1cf8-4020-a636-2f7c5c06bf9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57768d448e345ad8879bf29f21b48ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:41:40.828438 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1216785f-1cf8-4020-a636-2f7c5c06bf9f service nova] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:41:40.828800 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1216785f-1cf8-4020-a636-2f7c5c06bf9f service nova] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:41:40.829150 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1216785f-1cf8-4020-a636-2f7c5c06bf9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:41:40.838040 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1216785f-1cf8-4020-a636-2f7c5c06bf9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:41:40.839743 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1216785f-1cf8-4020-a636-2f7c5c06bf9f service nova] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:41:40.849471 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 693/1382] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:41:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:41:43.458202 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7da2bc5-0eda-4ff9-928f-fd53b65dea0a None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:41:43.458809 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7da2bc5-0eda-4ff9-928f-fd53b65dea0a None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:41:43.458809 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7da2bc5-0eda-4ff9-928f-fd53b65dea0a None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:41:43.460137 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 690/1383] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:41:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:41:43.465758 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b00f182-1927-48e7-8034-e8e9e38d0e18 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:41:43.466181 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b00f182-1927-48e7-8034-e8e9e38d0e18 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:41:43.466330 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b00f182-1927-48e7-8034-e8e9e38d0e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:41:43.473401 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:41:43.485102 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-0b00f182-1927-48e7-8034-e8e9e38d0e18 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:41:43.492087 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-0b00f182-1927-48e7-8034-e8e9e38d0e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:41:43.495173 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 694/1384] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:41:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:41:43.536885 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7da2bc5-0eda-4ff9-928f-fd53b65dea0a None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:41:43.553476 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7da2bc5-0eda-4ff9-928f-fd53b65dea0a None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:41:43.559271 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65689d85-8749-4941-9f9d-c72016530010 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57768d448e345ad8879bf29f21b48ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:41:43.560037 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65689d85-8749-4941-9f9d-c72016530010 service nova] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:41:43.560414 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65689d85-8749-4941-9f9d-c72016530010 service nova] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:41:43.560788 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65689d85-8749-4941-9f9d-c72016530010 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:41:43.569552 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65689d85-8749-4941-9f9d-c72016530010 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:41:43.571332 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65689d85-8749-4941-9f9d-c72016530010 service nova] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:41:43.581952 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 691/1385] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:41:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:41:45.907039 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e708cd-559a-4862-a032-1dcd15e15c32 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:41:45.907729 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e708cd-559a-4862-a032-1dcd15e15c32 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:41:45.907729 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e708cd-559a-4862-a032-1dcd15e15c32 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:41:45.909026 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 695/1386] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:41:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:41:45.914634 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca4d34-00e5-4d4e-8841-1d400d63503d None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:41:45.915384 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca4d34-00e5-4d4e-8841-1d400d63503d None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:41:45.915384 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca4d34-00e5-4d4e-8841-1d400d63503d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:41:45.934360 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-90ca4d34-00e5-4d4e-8841-1d400d63503d None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:41:45.935619 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-90ca4d34-00e5-4d4e-8841-1d400d63503d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:41:45.943586 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 692/1387] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:41:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:41:45.997457 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e708cd-559a-4862-a032-1dcd15e15c32 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:41:46.012536 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e708cd-559a-4862-a032-1dcd15e15c32 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:41:46.018009 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c09c79-787e-4f52-af8e-a279ff6301c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57768d448e345ad8879bf29f21b48ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:41:46.018681 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c09c79-787e-4f52-af8e-a279ff6301c6 service nova] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:41:46.018971 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c09c79-787e-4f52-af8e-a279ff6301c6 service nova] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:41:46.019251 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c09c79-787e-4f52-af8e-a279ff6301c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:41:46.027454 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c09c79-787e-4f52-af8e-a279ff6301c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:41:46.029036 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c09c79-787e-4f52-af8e-a279ff6301c6 service nova] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:41:46.038891 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 696/1388] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:41:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:41:48.496513 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c30547e-4e14-4c3e-b6f9-1587bd4e685d None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:41:48.497093 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c30547e-4e14-4c3e-b6f9-1587bd4e685d None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:41:48.497093 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c30547e-4e14-4c3e-b6f9-1587bd4e685d None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:41:48.498520 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 693/1389] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:41:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:41:48.505496 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1365a1e-5655-43bf-8adb-2ec22f7200d9 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:41:48.505963 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1365a1e-5655-43bf-8adb-2ec22f7200d9 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:41:48.506090 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1365a1e-5655-43bf-8adb-2ec22f7200d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:41:48.525158 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-b1365a1e-5655-43bf-8adb-2ec22f7200d9 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:41:48.526359 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-b1365a1e-5655-43bf-8adb-2ec22f7200d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:41:48.534318 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 697/1390] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:41:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:41:48.579570 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c30547e-4e14-4c3e-b6f9-1587bd4e685d None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:41:48.595168 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c30547e-4e14-4c3e-b6f9-1587bd4e685d None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:41:48.600966 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0197352-9347-4bad-902a-e05b4dcd4c8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57768d448e345ad8879bf29f21b48ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:41:48.602144 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0197352-9347-4bad-902a-e05b4dcd4c8a service nova] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:41:48.602429 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0197352-9347-4bad-902a-e05b4dcd4c8a service nova] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:41:48.602736 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0197352-9347-4bad-902a-e05b4dcd4c8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:41:48.614693 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0197352-9347-4bad-902a-e05b4dcd4c8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:41:48.617553 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0197352-9347-4bad-902a-e05b4dcd4c8a service nova] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:41:48.633012 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 694/1391] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:41:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 14:41:51.103237 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed708479-35ee-4fd9-ae0a-ca34eb5f5470 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:41:51.104094 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed708479-35ee-4fd9-ae0a-ca34eb5f5470 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:41:51.104094 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed708479-35ee-4fd9-ae0a-ca34eb5f5470 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:41:51.105143 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 698/1392] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:41:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:41:51.112200 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc8905f-5e81-4ad4-8bc4-9c793b3c415d None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:41:51.112817 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc8905f-5e81-4ad4-8bc4-9c793b3c415d None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:41:51.113121 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc8905f-5e81-4ad4-8bc4-9c793b3c415d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:41:51.138739 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-9fc8905f-5e81-4ad4-8bc4-9c793b3c415d None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:41:51.140366 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-9fc8905f-5e81-4ad4-8bc4-9c793b3c415d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:41:51.151014 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 695/1393] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:41:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:41:51.194966 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed708479-35ee-4fd9-ae0a-ca34eb5f5470 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:41:51.210241 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed708479-35ee-4fd9-ae0a-ca34eb5f5470 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:41:51.215965 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8c9941-c26a-4aaa-9e0b-fc8ab7b3efa4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57768d448e345ad8879bf29f21b48ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:41:51.216601 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8c9941-c26a-4aaa-9e0b-fc8ab7b3efa4 service nova] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:41:51.216883 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8c9941-c26a-4aaa-9e0b-fc8ab7b3efa4 service nova] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:41:51.217157 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8c9941-c26a-4aaa-9e0b-fc8ab7b3efa4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:41:51.225806 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8c9941-c26a-4aaa-9e0b-fc8ab7b3efa4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:41:51.227420 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8c9941-c26a-4aaa-9e0b-fc8ab7b3efa4 service nova] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:41:51.237019 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 699/1394] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:41:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:41:53.366451 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e2108-da38-483b-ac8c-83c71deaa48a None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:41:53.367318 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e2108-da38-483b-ac8c-83c71deaa48a None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:41:53.367631 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e2108-da38-483b-ac8c-83c71deaa48a None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:41:53.369208 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 696/1395] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:41:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:41:53.374441 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb8a5d-ec05-47bf-bf79-8bf42ac063e1 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:41:53.374951 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb8a5d-ec05-47bf-bf79-8bf42ac063e1 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:41:53.375051 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb8a5d-ec05-47bf-bf79-8bf42ac063e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:41:53.393314 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-c6bb8a5d-ec05-47bf-bf79-8bf42ac063e1 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:41:53.394533 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-c6bb8a5d-ec05-47bf-bf79-8bf42ac063e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:41:53.403376 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 700/1396] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:41:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:41:53.462658 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c83a0e-011c-4a76-8c8a-f704a939d29f None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:41:53.463081 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c83a0e-011c-4a76-8c8a-f704a939d29f None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:41:53.463460 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c83a0e-011c-4a76-8c8a-f704a939d29f None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:41:53.464905 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 697/1397] 10.222.0.15 () {54 vars in 962 bytes} [Tue May 31 14:41:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:41:53.470469 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfdb3a0-3af9-4764-9d38-66e1956d0c53 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:41:53.470807 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfdb3a0-3af9-4764-9d38-66e1956d0c53 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:41:53.471294 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfdb3a0-3af9-4764-9d38-66e1956d0c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:41:53.522303 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-acfdb3a0-3af9-4764-9d38-66e1956d0c53 None None] MFA Rules not processed for user `14ba98b007cc4ae1b20e7f261824b77c`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:41:53.523555 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-acfdb3a0-3af9-4764-9d38-66e1956d0c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:41:53.584285 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 701/1398] 10.222.0.15 () {58 vars in 1059 bytes} [Tue May 31 14:41:53 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:41:53.592680 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c83a0e-011c-4a76-8c8a-f704a939d29f None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:41:53.598178 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=90 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:41:53.604644 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c83a0e-011c-4a76-8c8a-f704a939d29f None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:41:53.608286 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4511d0c-7826-4924-a1df-4c31c74b1c02 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ba98b007cc4ae1b20e7f261824b77c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:41:53.609000 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4511d0c-7826-4924-a1df-4c31c74b1c02 service glance] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:41:53.609375 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4511d0c-7826-4924-a1df-4c31c74b1c02 service glance] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:41:53.609716 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4511d0c-7826-4924-a1df-4c31c74b1c02 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:41:53.619321 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4511d0c-7826-4924-a1df-4c31c74b1c02 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:41:53.620973 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4511d0c-7826-4924-a1df-4c31c74b1c02 service glance] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:41:53.630569 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 698/1399] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:41:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:41:53.670231 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb4f9b-15e2-4da2-bd8c-c18f4b4bc521 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:41:53.670524 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb4f9b-15e2-4da2-bd8c-c18f4b4bc521 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:41:53.670841 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb4f9b-15e2-4da2-bd8c-c18f4b4bc521 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:41:53.672197 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 702/1400] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:41:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:41:53.677492 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e66c1-d4b1-4c33-981c-4c265590976f None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:41:53.677788 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e66c1-d4b1-4c33-981c-4c265590976f None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:41:53.678073 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e66c1-d4b1-4c33-981c-4c265590976f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:41:53.696115 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-4e0e66c1-d4b1-4c33-981c-4c265590976f None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:41:53.697279 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-4e0e66c1-d4b1-4c33-981c-4c265590976f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:41:53.705094 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 699/1401] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:41:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:41:53.748982 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb4f9b-15e2-4da2-bd8c-c18f4b4bc521 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:41:53.764499 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb4f9b-15e2-4da2-bd8c-c18f4b4bc521 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:41:53.770038 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319a78ce-efa5-4c10-a85c-88ab138ebe50 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57768d448e345ad8879bf29f21b48ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:41:53.770730 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a78ce-efa5-4c10-a85c-88ab138ebe50 service nova] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:41:53.771038 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a78ce-efa5-4c10-a85c-88ab138ebe50 service nova] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:41:53.771315 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a78ce-efa5-4c10-a85c-88ab138ebe50 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:41:53.780713 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319a78ce-efa5-4c10-a85c-88ab138ebe50 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:41:53.782279 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319a78ce-efa5-4c10-a85c-88ab138ebe50 service nova] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:41:53.792321 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 703/1402] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:41:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:41:54.302830 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521acc0a-e7b9-4e20-b1e3-4acfb9dab876 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:41:54.303122 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521acc0a-e7b9-4e20-b1e3-4acfb9dab876 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:41:54.303446 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521acc0a-e7b9-4e20-b1e3-4acfb9dab876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:41:54.351772 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-521acc0a-e7b9-4e20-b1e3-4acfb9dab876 None None] MFA Rules not processed for user `735d2518c8404bd991acee533b314039`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:41:54.352882 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-521acc0a-e7b9-4e20-b1e3-4acfb9dab876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:41:54.416200 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 700/1403] 10.222.0.15 () {58 vars in 1009 bytes} [Tue May 31 14:41:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:41:54.459799 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee27ba-983d-4576-b02f-b5daba5b6970 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:41:54.460291 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee27ba-983d-4576-b02f-b5daba5b6970 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:41:54.460398 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee27ba-983d-4576-b02f-b5daba5b6970 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:41:54.461764 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 704/1404] 10.222.0.15 () {54 vars in 942 bytes} [Tue May 31 14:41:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:41:54.468233 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32099f75-187e-4830-83de-2ca8b6a26558 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:41:54.468524 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32099f75-187e-4830-83de-2ca8b6a26558 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:41:54.468826 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32099f75-187e-4830-83de-2ca8b6a26558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:41:54.517595 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-32099f75-187e-4830-83de-2ca8b6a26558 None None] MFA Rules not processed for user `e158f461c66e4d779f23fb7760672897`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:41:54.518899 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-32099f75-187e-4830-83de-2ca8b6a26558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:41:54.589933 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 701/1405] 10.222.0.15 () {58 vars in 1039 bytes} [Tue May 31 14:41:54 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:41:54.599290 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fee27ba-983d-4576-b02f-b5daba5b6970 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:41:54.613083 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fee27ba-983d-4576-b02f-b5daba5b6970 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:41:54.618993 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1fe724-3021-4d4e-9c46-7aefb37cd1c2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e158f461c66e4d779f23fb7760672897', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:41:54.619631 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1fe724-3021-4d4e-9c46-7aefb37cd1c2 service swift] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:41:54.619911 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1fe724-3021-4d4e-9c46-7aefb37cd1c2 service swift] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:41:54.620184 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1fe724-3021-4d4e-9c46-7aefb37cd1c2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:41:54.628157 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1fe724-3021-4d4e-9c46-7aefb37cd1c2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:41:54.629726 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1fe724-3021-4d4e-9c46-7aefb37cd1c2 service swift] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:41:54.637662 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 705/1406] 10.222.0.15 () {60 vars in 1384 bytes} [Tue May 31 14:41:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 31 14:41:56.199735 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c168e86d-db67-4fb3-b218-ee91fd74294e None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:41:56.200283 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c168e86d-db67-4fb3-b218-ee91fd74294e None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:41:56.200283 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c168e86d-db67-4fb3-b218-ee91fd74294e None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:41:56.201676 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 702/1407] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:41:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:41:56.206945 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edba1de6-8444-457a-9cfe-703d06d31261 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:41:56.207721 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edba1de6-8444-457a-9cfe-703d06d31261 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:41:56.207993 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edba1de6-8444-457a-9cfe-703d06d31261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:41:56.227280 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-edba1de6-8444-457a-9cfe-703d06d31261 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:41:56.228496 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-edba1de6-8444-457a-9cfe-703d06d31261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:41:56.236665 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 706/1408] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:41:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:41:56.280769 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c168e86d-db67-4fb3-b218-ee91fd74294e None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:41:56.299401 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c168e86d-db67-4fb3-b218-ee91fd74294e None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:41:56.311555 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af32bd3c-c25f-4c18-923e-d5cec1ec5a3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57768d448e345ad8879bf29f21b48ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:41:56.312264 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af32bd3c-c25f-4c18-923e-d5cec1ec5a3c service nova] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:41:56.312549 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af32bd3c-c25f-4c18-923e-d5cec1ec5a3c service nova] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:41:56.312823 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af32bd3c-c25f-4c18-923e-d5cec1ec5a3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:41:56.322195 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af32bd3c-c25f-4c18-923e-d5cec1ec5a3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:41:56.323830 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af32bd3c-c25f-4c18-923e-d5cec1ec5a3c service nova] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:41:56.344742 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 703/1409] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:41:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 14:42:06.221473 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=72 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:42:06.329085 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=98 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:42:18.851443 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9e4c2a-ddc9-4ff7-886c-7e6a5398bc10 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:42:18.852089 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9e4c2a-ddc9-4ff7-886c-7e6a5398bc10 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:42:18.852089 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9e4c2a-ddc9-4ff7-886c-7e6a5398bc10 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:42:18.853358 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 707/1410] 10.222.0.15 () {54 vars in 918 bytes} [Tue May 31 14:42:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:42:18.858477 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756f83ae-b5eb-44d4-8bde-66ab3579cc10 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:42:18.858987 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756f83ae-b5eb-44d4-8bde-66ab3579cc10 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:42:18.859141 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756f83ae-b5eb-44d4-8bde-66ab3579cc10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:42:18.876946 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-756f83ae-b5eb-44d4-8bde-66ab3579cc10 None None] MFA Rules not processed for user `efc959ca520c4816b5ff7f95655e53e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:42:18.878134 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-756f83ae-b5eb-44d4-8bde-66ab3579cc10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:42:18.886573 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 704/1411] 10.222.0.15 () {58 vars in 1015 bytes} [Tue May 31 14:42:18 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:42:18.901150 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b6cb87-9ca2-4215-a219-bdb0bda8e0c3 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:42:18.901443 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b6cb87-9ca2-4215-a219-bdb0bda8e0c3 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:42:18.901723 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b6cb87-9ca2-4215-a219-bdb0bda8e0c3 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:42:18.903092 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 708/1412] 10.222.0.15 () {54 vars in 918 bytes} [Tue May 31 14:42:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:42:18.917035 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2079b5de-c826-4c06-b065-d247c0395b20 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:42:18.917035 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2079b5de-c826-4c06-b065-d247c0395b20 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:42:18.917035 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2079b5de-c826-4c06-b065-d247c0395b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:42:18.936257 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-2079b5de-c826-4c06-b065-d247c0395b20 None None] MFA Rules not processed for user `b57768d448e345ad8879bf29f21b48ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:42:18.937455 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-2079b5de-c826-4c06-b065-d247c0395b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:42:18.946502 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 705/1413] 10.222.0.15 () {58 vars in 1015 bytes} [Tue May 31 14:42:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:42:21.675426 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee751b3-e722-4add-b8f3-a2b4ae505f38 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:42:21.675956 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee751b3-e722-4add-b8f3-a2b4ae505f38 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:42:21.675956 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee751b3-e722-4add-b8f3-a2b4ae505f38 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:42:21.677215 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 709/1414] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 31 14:42:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:42:21.683212 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f373fd66-9465-4934-93d5-820ecda3223f None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:42:21.683614 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f373fd66-9465-4934-93d5-820ecda3223f None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:42:21.683801 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f373fd66-9465-4934-93d5-820ecda3223f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:42:21.701151 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-f373fd66-9465-4934-93d5-820ecda3223f None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:42:21.702345 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-f373fd66-9465-4934-93d5-820ecda3223f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:42:21.710628 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 706/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 31 14:42:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:42:21.753343 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee751b3-e722-4add-b8f3-a2b4ae505f38 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:42:21.768089 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee751b3-e722-4add-b8f3-a2b4ae505f38 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:42:21.773936 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802eb5c9-af20-47f1-9371-28ec33d63362 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57768d448e345ad8879bf29f21b48ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:42:21.774631 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802eb5c9-af20-47f1-9371-28ec33d63362 service nova] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:42:21.774936 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802eb5c9-af20-47f1-9371-28ec33d63362 service nova] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:42:21.775213 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802eb5c9-af20-47f1-9371-28ec33d63362 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:42:21.783388 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802eb5c9-af20-47f1-9371-28ec33d63362 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:42:21.784965 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802eb5c9-af20-47f1-9371-28ec33d63362 service nova] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:42:21.795667 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 710/1416] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:42:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:42:22.768702 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b65a9-3ca1-46aa-ad47-835b861d673f None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:42:22.769238 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b65a9-3ca1-46aa-ad47-835b861d673f None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:42:22.769238 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b65a9-3ca1-46aa-ad47-835b861d673f None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:42:22.770528 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 707/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 31 14:42:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:42:22.775507 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d437ea-c23e-4990-ada7-87dccfc4b159 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:42:22.775983 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d437ea-c23e-4990-ada7-87dccfc4b159 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:42:22.776159 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d437ea-c23e-4990-ada7-87dccfc4b159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:42:22.793968 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-f6d437ea-c23e-4990-ada7-87dccfc4b159 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:42:22.795183 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-f6d437ea-c23e-4990-ada7-87dccfc4b159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:42:22.802929 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 711/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 31 14:42:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:42:22.956178 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9b65a9-3ca1-46aa-ad47-835b861d673f None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:42:22.970642 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9b65a9-3ca1-46aa-ad47-835b861d673f None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:42:22.976833 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffab3d5-e0af-4054-905d-8565416b684c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57768d448e345ad8879bf29f21b48ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:42:22.977521 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffab3d5-e0af-4054-905d-8565416b684c service nova] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:42:22.977805 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffab3d5-e0af-4054-905d-8565416b684c service nova] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:42:22.978109 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffab3d5-e0af-4054-905d-8565416b684c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:42:22.986306 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffab3d5-e0af-4054-905d-8565416b684c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:42:22.987919 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffab3d5-e0af-4054-905d-8565416b684c service nova] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:42:22.998434 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 708/1419] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:42:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:42:23.946111 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de37c440-55dc-4d72-ae3e-df2f767ea34c None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:42:23.946701 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de37c440-55dc-4d72-ae3e-df2f767ea34c None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:42:23.946701 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de37c440-55dc-4d72-ae3e-df2f767ea34c None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:42:23.948040 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 712/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 31 14:42:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:42:23.953133 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c825de-ae3f-432e-a7b8-b7457392c287 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:42:23.953547 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c825de-ae3f-432e-a7b8-b7457392c287 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:42:23.953674 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c825de-ae3f-432e-a7b8-b7457392c287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:42:23.971553 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-10c825de-ae3f-432e-a7b8-b7457392c287 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:42:23.972724 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-10c825de-ae3f-432e-a7b8-b7457392c287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:42:23.980556 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 709/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 31 14:42:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 14:42:24.128294 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de37c440-55dc-4d72-ae3e-df2f767ea34c None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:42:24.142903 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de37c440-55dc-4d72-ae3e-df2f767ea34c None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:42:24.148225 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a970b9e7-df26-4e5c-bd9b-22b07dbbb167 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57768d448e345ad8879bf29f21b48ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:42:24.148853 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a970b9e7-df26-4e5c-bd9b-22b07dbbb167 service nova] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:42:24.149138 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a970b9e7-df26-4e5c-bd9b-22b07dbbb167 service nova] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:42:24.149416 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a970b9e7-df26-4e5c-bd9b-22b07dbbb167 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:42:24.157497 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a970b9e7-df26-4e5c-bd9b-22b07dbbb167 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:42:24.159195 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a970b9e7-df26-4e5c-bd9b-22b07dbbb167 service nova] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:42:24.168859 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 713/1422] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:42:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:42:25.085689 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09128f88-4b81-4f84-a8f9-2da763abf3c8 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:42:25.086233 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09128f88-4b81-4f84-a8f9-2da763abf3c8 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:42:25.086233 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09128f88-4b81-4f84-a8f9-2da763abf3c8 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:42:25.087689 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 710/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 31 14:42:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:42:25.092667 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d95528d-63b9-49e6-85dc-19ea5e37d37b None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:42:25.093090 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d95528d-63b9-49e6-85dc-19ea5e37d37b None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:42:25.093325 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d95528d-63b9-49e6-85dc-19ea5e37d37b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:42:25.111617 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-6d95528d-63b9-49e6-85dc-19ea5e37d37b None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:42:25.112814 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-6d95528d-63b9-49e6-85dc-19ea5e37d37b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:42:25.121268 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 714/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 31 14:42:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:42:25.269471 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09128f88-4b81-4f84-a8f9-2da763abf3c8 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:42:25.283510 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09128f88-4b81-4f84-a8f9-2da763abf3c8 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:42:25.289738 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534550fb-3394-489f-9daa-e5ec15a8bc75 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57768d448e345ad8879bf29f21b48ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:42:25.290414 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534550fb-3394-489f-9daa-e5ec15a8bc75 service nova] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:42:25.290734 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534550fb-3394-489f-9daa-e5ec15a8bc75 service nova] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:42:25.291059 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534550fb-3394-489f-9daa-e5ec15a8bc75 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:42:25.299756 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534550fb-3394-489f-9daa-e5ec15a8bc75 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:42:25.301352 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534550fb-3394-489f-9daa-e5ec15a8bc75 service nova] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:42:25.311478 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 711/1425] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:42:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:42:26.221420 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7eb8fa-4c87-4f0f-b4b7-046a3ad019bf None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:42:26.221986 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7eb8fa-4c87-4f0f-b4b7-046a3ad019bf None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:42:26.221986 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7eb8fa-4c87-4f0f-b4b7-046a3ad019bf None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:42:26.223350 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 715/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 31 14:42:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:42:26.228292 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed62a17d-cdcf-4ff3-91c9-3992776acb31 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:42:26.228708 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed62a17d-cdcf-4ff3-91c9-3992776acb31 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:42:26.228856 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed62a17d-cdcf-4ff3-91c9-3992776acb31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:42:26.246861 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-ed62a17d-cdcf-4ff3-91c9-3992776acb31 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:42:26.248066 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-ed62a17d-cdcf-4ff3-91c9-3992776acb31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:42:26.255688 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 712/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 31 14:42:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:42:26.407947 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7eb8fa-4c87-4f0f-b4b7-046a3ad019bf None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:42:26.422192 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7eb8fa-4c87-4f0f-b4b7-046a3ad019bf None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:42:26.427468 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7648061-988b-400a-81c8-c23f6107bf0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57768d448e345ad8879bf29f21b48ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:42:26.428666 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7648061-988b-400a-81c8-c23f6107bf0a service nova] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:42:26.428950 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7648061-988b-400a-81c8-c23f6107bf0a service nova] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:42:26.429227 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7648061-988b-400a-81c8-c23f6107bf0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:42:26.437173 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7648061-988b-400a-81c8-c23f6107bf0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:42:26.438781 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7648061-988b-400a-81c8-c23f6107bf0a service nova] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:42:26.448523 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 716/1428] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:42:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:42:27.377420 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e6b7fd-ef09-4d34-ad40-e657f7fa666a None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:42:27.377986 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e6b7fd-ef09-4d34-ad40-e657f7fa666a None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:42:27.377986 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e6b7fd-ef09-4d34-ad40-e657f7fa666a None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:42:27.379370 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 713/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 31 14:42:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:42:27.384285 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7041a5b2-cf60-466b-a94e-a6ee2acedf61 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:42:27.384680 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7041a5b2-cf60-466b-a94e-a6ee2acedf61 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:42:27.384869 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7041a5b2-cf60-466b-a94e-a6ee2acedf61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:42:27.402326 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-7041a5b2-cf60-466b-a94e-a6ee2acedf61 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:42:27.403536 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-7041a5b2-cf60-466b-a94e-a6ee2acedf61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:42:27.411208 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 717/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 31 14:42:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:42:27.559759 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e6b7fd-ef09-4d34-ad40-e657f7fa666a None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:42:27.574061 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e6b7fd-ef09-4d34-ad40-e657f7fa666a None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:42:27.579682 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c098a5c4-264e-4c40-b44c-6c91df75945b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57768d448e345ad8879bf29f21b48ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:42:27.580321 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c098a5c4-264e-4c40-b44c-6c91df75945b service nova] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:42:27.580600 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c098a5c4-264e-4c40-b44c-6c91df75945b service nova] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:42:27.580873 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c098a5c4-264e-4c40-b44c-6c91df75945b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:42:27.591312 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c098a5c4-264e-4c40-b44c-6c91df75945b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:42:27.592915 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c098a5c4-264e-4c40-b44c-6c91df75945b service nova] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:42:27.602923 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 714/1431] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:42:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:42:28.540923 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1445e124-f7bd-4d42-8807-0ef4e6aac558 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:42:28.541457 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1445e124-f7bd-4d42-8807-0ef4e6aac558 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:42:28.541457 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1445e124-f7bd-4d42-8807-0ef4e6aac558 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:42:28.542854 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 718/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 31 14:42:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:42:28.547760 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6031a2e3-67cd-4ebd-8126-7f891047b8e2 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:42:28.548149 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6031a2e3-67cd-4ebd-8126-7f891047b8e2 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:42:28.548329 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6031a2e3-67cd-4ebd-8126-7f891047b8e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:42:28.566082 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-6031a2e3-67cd-4ebd-8126-7f891047b8e2 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:42:28.567295 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-6031a2e3-67cd-4ebd-8126-7f891047b8e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:42:28.575942 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 715/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 31 14:42:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:42:28.725545 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1445e124-f7bd-4d42-8807-0ef4e6aac558 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:42:28.739790 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1445e124-f7bd-4d42-8807-0ef4e6aac558 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:42:28.745810 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3dad78-1e8d-43e8-a0a4-12b656677ddc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57768d448e345ad8879bf29f21b48ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:42:28.746444 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3dad78-1e8d-43e8-a0a4-12b656677ddc service nova] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:42:28.746748 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3dad78-1e8d-43e8-a0a4-12b656677ddc service nova] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:42:28.747023 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3dad78-1e8d-43e8-a0a4-12b656677ddc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:42:28.755249 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3dad78-1e8d-43e8-a0a4-12b656677ddc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:42:28.757993 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3dad78-1e8d-43e8-a0a4-12b656677ddc service nova] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:42:28.766686 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 719/1434] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:42:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:42:29.651541 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423ca30f-1de8-4303-a409-8d782b48154c None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:42:29.652060 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423ca30f-1de8-4303-a409-8d782b48154c None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:42:29.652060 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423ca30f-1de8-4303-a409-8d782b48154c None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:42:29.653388 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 716/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 31 14:42:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:42:29.658329 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2918e45e-c339-46e9-b5fc-2bdb378f4ab5 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:42:29.658784 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2918e45e-c339-46e9-b5fc-2bdb378f4ab5 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:42:29.658927 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2918e45e-c339-46e9-b5fc-2bdb378f4ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:42:29.677279 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-2918e45e-c339-46e9-b5fc-2bdb378f4ab5 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:42:29.679110 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-2918e45e-c339-46e9-b5fc-2bdb378f4ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:42:29.686933 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 720/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 31 14:42:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:42:29.835612 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423ca30f-1de8-4303-a409-8d782b48154c None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:42:29.850243 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423ca30f-1de8-4303-a409-8d782b48154c None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:42:29.855676 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a66b1a9-87db-477b-bc72-25a8cfe54ab2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57768d448e345ad8879bf29f21b48ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:42:29.856307 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a66b1a9-87db-477b-bc72-25a8cfe54ab2 service nova] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:42:29.856595 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a66b1a9-87db-477b-bc72-25a8cfe54ab2 service nova] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:42:29.856877 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a66b1a9-87db-477b-bc72-25a8cfe54ab2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:42:29.864870 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a66b1a9-87db-477b-bc72-25a8cfe54ab2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:42:29.867146 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a66b1a9-87db-477b-bc72-25a8cfe54ab2 service nova] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:42:29.878040 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 717/1437] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:42:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:42:30.789273 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc116509-cad3-4221-b175-5c448c224c29 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:42:30.789832 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc116509-cad3-4221-b175-5c448c224c29 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:42:30.789832 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc116509-cad3-4221-b175-5c448c224c29 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:42:30.791226 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 721/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 31 14:42:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:42:30.796196 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc733e57-7593-498b-8821-c4cba78292f6 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:42:30.796622 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc733e57-7593-498b-8821-c4cba78292f6 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:42:30.796720 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc733e57-7593-498b-8821-c4cba78292f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:42:30.814963 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-fc733e57-7593-498b-8821-c4cba78292f6 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:42:30.816136 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-fc733e57-7593-498b-8821-c4cba78292f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:42:30.824577 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 718/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 31 14:42:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:42:30.975367 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc116509-cad3-4221-b175-5c448c224c29 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:42:30.989955 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc116509-cad3-4221-b175-5c448c224c29 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:42:30.996133 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b6d82e-5968-497c-a3af-4215b505aca0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57768d448e345ad8879bf29f21b48ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:42:30.996768 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b6d82e-5968-497c-a3af-4215b505aca0 service nova] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:42:30.997060 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b6d82e-5968-497c-a3af-4215b505aca0 service nova] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:42:30.997340 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b6d82e-5968-497c-a3af-4215b505aca0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:42:31.005579 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b6d82e-5968-497c-a3af-4215b505aca0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:42:31.007857 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b6d82e-5968-497c-a3af-4215b505aca0 service nova] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:42:31.017122 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 722/1440] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:42:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:42:33.114162 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d1408d-84f2-4aa1-b2f9-0e9604d05536 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:42:33.114691 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d1408d-84f2-4aa1-b2f9-0e9604d05536 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:42:33.114691 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d1408d-84f2-4aa1-b2f9-0e9604d05536 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:42:33.116087 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 719/1441] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 31 14:42:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:42:33.121458 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dcae03-eae3-4de9-b48a-9502706fad13 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:42:33.121895 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dcae03-eae3-4de9-b48a-9502706fad13 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:42:33.122022 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dcae03-eae3-4de9-b48a-9502706fad13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:42:33.139318 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-84dcae03-eae3-4de9-b48a-9502706fad13 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:42:33.140498 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-84dcae03-eae3-4de9-b48a-9502706fad13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:42:33.148594 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 723/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 31 14:42:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:42:33.187093 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d1408d-84f2-4aa1-b2f9-0e9604d05536 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:42:33.197489 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d1408d-84f2-4aa1-b2f9-0e9604d05536 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:42:33.201071 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9f928b-ff2a-4dbb-86f5-6cad191f3a54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:42:33.201721 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f928b-ff2a-4dbb-86f5-6cad191f3a54 service neutron] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:42:33.202011 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f928b-ff2a-4dbb-86f5-6cad191f3a54 service neutron] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:42:33.202295 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f928b-ff2a-4dbb-86f5-6cad191f3a54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:42:33.211831 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9f928b-ff2a-4dbb-86f5-6cad191f3a54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:42:33.213251 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9f928b-ff2a-4dbb-86f5-6cad191f3a54 service neutron] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:42:33.222471 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 720/1443] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:42:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:42:35.654624 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7793fb15-caf8-4adf-b6bf-071ce69fc9d5 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:42:35.655150 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7793fb15-caf8-4adf-b6bf-071ce69fc9d5 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:42:35.655150 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7793fb15-caf8-4adf-b6bf-071ce69fc9d5 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:42:35.656477 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 724/1444] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 31 14:42:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:42:35.662539 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725fca30-6401-4c26-bc3a-f7d1b6631589 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:42:35.662968 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725fca30-6401-4c26-bc3a-f7d1b6631589 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:42:35.663132 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725fca30-6401-4c26-bc3a-f7d1b6631589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:42:35.680980 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-725fca30-6401-4c26-bc3a-f7d1b6631589 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:42:35.682177 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-725fca30-6401-4c26-bc3a-f7d1b6631589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:42:35.689888 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 721/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 31 14:42:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:42:35.728052 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7793fb15-caf8-4adf-b6bf-071ce69fc9d5 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:42:35.738582 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7793fb15-caf8-4adf-b6bf-071ce69fc9d5 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:42:35.742754 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a020261-4bbc-42e6-9933-0cc4e851c581 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:42:35.743383 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a020261-4bbc-42e6-9933-0cc4e851c581 service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:42:35.743666 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a020261-4bbc-42e6-9933-0cc4e851c581 service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:42:35.743942 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a020261-4bbc-42e6-9933-0cc4e851c581 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:42:35.752647 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a020261-4bbc-42e6-9933-0cc4e851c581 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:42:35.754062 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a020261-4bbc-42e6-9933-0cc4e851c581 service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:42:35.763357 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 725/1446] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:42:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:42:38.347099 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8edbc2-0b11-4f00-a095-dc32fafea838 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:42:38.347705 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8edbc2-0b11-4f00-a095-dc32fafea838 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:42:38.347705 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8edbc2-0b11-4f00-a095-dc32fafea838 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:42:38.350018 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 722/1447] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 31 14:42:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:42:38.355346 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db024fbf-bcb6-4886-8929-f9e4e474e14e None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:42:38.355767 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db024fbf-bcb6-4886-8929-f9e4e474e14e None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:42:38.355949 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db024fbf-bcb6-4886-8929-f9e4e474e14e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:42:38.373882 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-db024fbf-bcb6-4886-8929-f9e4e474e14e None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:42:38.375098 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-db024fbf-bcb6-4886-8929-f9e4e474e14e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:42:38.383407 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 726/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 31 14:42:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:42:38.420823 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8edbc2-0b11-4f00-a095-dc32fafea838 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:42:38.431934 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8edbc2-0b11-4f00-a095-dc32fafea838 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:42:38.435419 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b96063-53e5-4844-a4d5-2502a4811598 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:42:38.436054 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b96063-53e5-4844-a4d5-2502a4811598 service neutron] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:42:38.436336 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b96063-53e5-4844-a4d5-2502a4811598 service neutron] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:42:38.436612 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b96063-53e5-4844-a4d5-2502a4811598 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:42:38.445863 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b96063-53e5-4844-a4d5-2502a4811598 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:42:38.447330 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b96063-53e5-4844-a4d5-2502a4811598 service neutron] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:42:38.456617 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 723/1449] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:42:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:42:40.806204 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c67d5-e513-45af-a59a-22e6c32b1d35 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:42:40.806763 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c67d5-e513-45af-a59a-22e6c32b1d35 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:42:40.806763 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c67d5-e513-45af-a59a-22e6c32b1d35 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:42:40.808108 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 727/1450] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 31 14:42:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:42:40.813689 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b32f9-736e-4a15-8b3d-c182f44bf25b None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:42:40.814111 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b32f9-736e-4a15-8b3d-c182f44bf25b None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:42:40.814253 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b32f9-736e-4a15-8b3d-c182f44bf25b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:42:40.832663 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-821b32f9-736e-4a15-8b3d-c182f44bf25b None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:42:40.834479 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-821b32f9-736e-4a15-8b3d-c182f44bf25b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:42:40.842125 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 724/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 31 14:42:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:42:40.879608 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1c67d5-e513-45af-a59a-22e6c32b1d35 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:42:40.890759 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1c67d5-e513-45af-a59a-22e6c32b1d35 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:42:40.894351 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebb45b7-780a-485d-b77b-b21ef3026d3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:42:40.895016 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebb45b7-780a-485d-b77b-b21ef3026d3d service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:42:40.895303 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebb45b7-780a-485d-b77b-b21ef3026d3d service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:42:40.895585 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebb45b7-780a-485d-b77b-b21ef3026d3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:42:40.905003 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebb45b7-780a-485d-b77b-b21ef3026d3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:42:40.906427 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebb45b7-780a-485d-b77b-b21ef3026d3d service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:42:40.915895 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 728/1452] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:42:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 14:42:43.202188 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cc42a8-fe04-4ce2-bed5-b1b4e960c249 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:42:43.202798 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cc42a8-fe04-4ce2-bed5-b1b4e960c249 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:42:43.202798 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cc42a8-fe04-4ce2-bed5-b1b4e960c249 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:42:43.204117 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 725/1453] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 31 14:42:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:42:43.209319 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51c40ef-5430-4ab5-837c-ffb1a9277898 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:42:43.209758 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51c40ef-5430-4ab5-837c-ffb1a9277898 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:42:43.209880 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51c40ef-5430-4ab5-837c-ffb1a9277898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:42:43.227759 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-d51c40ef-5430-4ab5-837c-ffb1a9277898 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:42:43.228957 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-d51c40ef-5430-4ab5-837c-ffb1a9277898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:42:43.236627 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 729/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 31 14:42:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:42:43.274735 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cc42a8-fe04-4ce2-bed5-b1b4e960c249 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:42:43.285190 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cc42a8-fe04-4ce2-bed5-b1b4e960c249 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:42:43.289487 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eeb3f7-6b73-4da3-9079-38adea90c9e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:42:43.290111 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eeb3f7-6b73-4da3-9079-38adea90c9e0 service neutron] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:42:43.290396 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eeb3f7-6b73-4da3-9079-38adea90c9e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:42:43.290695 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eeb3f7-6b73-4da3-9079-38adea90c9e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:42:43.299772 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eeb3f7-6b73-4da3-9079-38adea90c9e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:42:43.301191 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eeb3f7-6b73-4da3-9079-38adea90c9e0 service neutron] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:42:43.310927 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 726/1455] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:42:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:42:45.604262 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d51e3c-3201-4715-93ce-e80050e45219 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:42:45.604879 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d51e3c-3201-4715-93ce-e80050e45219 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:42:45.604879 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d51e3c-3201-4715-93ce-e80050e45219 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:42:45.606082 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 730/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 31 14:42:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:42:45.611389 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2151af-5913-478e-94ad-b7c349d41459 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:42:45.611788 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2151af-5913-478e-94ad-b7c349d41459 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:42:45.611959 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2151af-5913-478e-94ad-b7c349d41459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:42:45.629762 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-7a2151af-5913-478e-94ad-b7c349d41459 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:42:45.631020 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-7a2151af-5913-478e-94ad-b7c349d41459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:42:45.638707 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 727/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 31 14:42:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:42:45.676948 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d51e3c-3201-4715-93ce-e80050e45219 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:42:45.688244 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d51e3c-3201-4715-93ce-e80050e45219 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:42:45.691715 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e26170-d194-4c1c-b0f0-8a5277393591 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:42:45.692348 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e26170-d194-4c1c-b0f0-8a5277393591 service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:42:45.692631 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e26170-d194-4c1c-b0f0-8a5277393591 service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:42:45.692904 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e26170-d194-4c1c-b0f0-8a5277393591 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:42:45.701657 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e26170-d194-4c1c-b0f0-8a5277393591 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:42:45.703135 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e26170-d194-4c1c-b0f0-8a5277393591 service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:42:45.712889 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 731/1458] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:42:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:42:47.996121 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f0e00-d2e2-4ba7-b0b5-9658eef1285b None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:42:47.996720 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f0e00-d2e2-4ba7-b0b5-9658eef1285b None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:42:47.996720 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f0e00-d2e2-4ba7-b0b5-9658eef1285b None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:42:47.998046 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 728/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 31 14:42:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:42:48.003251 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc1d8ee-f9d7-440e-947b-2a3aa29d0eb4 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:42:48.003674 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc1d8ee-f9d7-440e-947b-2a3aa29d0eb4 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:42:48.003789 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc1d8ee-f9d7-440e-947b-2a3aa29d0eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:42:48.010403 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=70 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:42:48.022124 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-cbc1d8ee-f9d7-440e-947b-2a3aa29d0eb4 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:42:48.023349 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-cbc1d8ee-f9d7-440e-947b-2a3aa29d0eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:42:48.030987 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 732/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 31 14:42:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:42:48.069841 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7f0e00-d2e2-4ba7-b0b5-9658eef1285b None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:42:48.075117 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=73 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:42:48.081026 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7f0e00-d2e2-4ba7-b0b5-9658eef1285b None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:42:48.084557 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1d552f-94c0-4359-8944-e23f85e15a40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:42:48.089591 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1d552f-94c0-4359-8944-e23f85e15a40 service neutron] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:42:48.089591 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1d552f-94c0-4359-8944-e23f85e15a40 service neutron] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:42:48.089591 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1d552f-94c0-4359-8944-e23f85e15a40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:42:48.094569 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1d552f-94c0-4359-8944-e23f85e15a40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:42:48.096049 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1d552f-94c0-4359-8944-e23f85e15a40 service neutron] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:42:48.105484 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 729/1461] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:42:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:42:50.378030 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba2109-6868-4dc5-9f87-7b3d9ad739d6 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:42:50.378615 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba2109-6868-4dc5-9f87-7b3d9ad739d6 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:42:50.378734 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba2109-6868-4dc5-9f87-7b3d9ad739d6 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:42:50.379995 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 733/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 31 14:42:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:42:50.385430 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03320edc-98db-4fe3-b1df-a63797249756 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:42:50.385893 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03320edc-98db-4fe3-b1df-a63797249756 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:42:50.386002 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03320edc-98db-4fe3-b1df-a63797249756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:42:50.403631 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-03320edc-98db-4fe3-b1df-a63797249756 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:42:50.404814 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-03320edc-98db-4fe3-b1df-a63797249756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:42:50.413342 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 730/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 31 14:42:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:42:50.449654 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ba2109-6868-4dc5-9f87-7b3d9ad739d6 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:42:50.460699 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ba2109-6868-4dc5-9f87-7b3d9ad739d6 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:42:50.464265 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76340e6-7f14-445b-9eeb-faec0006f5d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:42:50.464898 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76340e6-7f14-445b-9eeb-faec0006f5d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:42:50.465183 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76340e6-7f14-445b-9eeb-faec0006f5d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:42:50.465460 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76340e6-7f14-445b-9eeb-faec0006f5d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:42:50.474897 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76340e6-7f14-445b-9eeb-faec0006f5d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:42:50.476336 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76340e6-7f14-445b-9eeb-faec0006f5d0 service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:42:50.485449 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 734/1464] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:42:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:42:52.728191 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b7173-4af0-40f9-9db8-1c73f1cb6cd8 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:42:52.728722 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b7173-4af0-40f9-9db8-1c73f1cb6cd8 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:42:52.728722 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b7173-4af0-40f9-9db8-1c73f1cb6cd8 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:42:52.730101 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 731/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 31 14:42:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:42:52.735501 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b114ea63-031f-40ce-aa74-70f1e20c1bb6 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:42:52.735888 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b114ea63-031f-40ce-aa74-70f1e20c1bb6 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:42:52.736059 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b114ea63-031f-40ce-aa74-70f1e20c1bb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:42:52.753363 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-b114ea63-031f-40ce-aa74-70f1e20c1bb6 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:42:52.754538 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-b114ea63-031f-40ce-aa74-70f1e20c1bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:42:52.762066 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 735/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 31 14:42:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:42:52.798827 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9b7173-4af0-40f9-9db8-1c73f1cb6cd8 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:42:52.809486 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9b7173-4af0-40f9-9db8-1c73f1cb6cd8 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:42:52.812937 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee6c9c4-6ddf-4274-b06a-328e9ff9e4c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:42:52.813568 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee6c9c4-6ddf-4274-b06a-328e9ff9e4c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:42:52.813854 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee6c9c4-6ddf-4274-b06a-328e9ff9e4c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:42:52.814132 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee6c9c4-6ddf-4274-b06a-328e9ff9e4c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:42:52.823483 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee6c9c4-6ddf-4274-b06a-328e9ff9e4c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:42:52.824915 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee6c9c4-6ddf-4274-b06a-328e9ff9e4c0 service neutron] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:42:52.834712 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 732/1467] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:42:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:42:55.102811 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15fbb03-b5fd-4b96-af9f-42256a508553 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:42:55.103530 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15fbb03-b5fd-4b96-af9f-42256a508553 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:42:55.103530 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15fbb03-b5fd-4b96-af9f-42256a508553 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:42:55.104705 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 736/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 31 14:42:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:42:55.109923 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d0d5c2-826a-42a2-bc67-58cd0547fdc7 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:42:55.110306 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d0d5c2-826a-42a2-bc67-58cd0547fdc7 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:42:55.110482 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d0d5c2-826a-42a2-bc67-58cd0547fdc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:42:55.128483 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-b7d0d5c2-826a-42a2-bc67-58cd0547fdc7 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:42:55.129684 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-b7d0d5c2-826a-42a2-bc67-58cd0547fdc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:42:55.137320 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 733/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 31 14:42:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:42:55.173574 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15fbb03-b5fd-4b96-af9f-42256a508553 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:42:55.184785 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15fbb03-b5fd-4b96-af9f-42256a508553 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:42:55.188336 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7804119e-95bb-411d-aa8b-b264b84985e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:42:55.188965 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7804119e-95bb-411d-aa8b-b264b84985e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:42:55.189248 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7804119e-95bb-411d-aa8b-b264b84985e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:42:55.189526 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7804119e-95bb-411d-aa8b-b264b84985e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:42:55.198238 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7804119e-95bb-411d-aa8b-b264b84985e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:42:55.199690 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7804119e-95bb-411d-aa8b-b264b84985e4 service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:42:55.208951 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 737/1470] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:42:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:43:05.123410 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=17 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:43:05.204855 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=17 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:43:27.089414 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ef53e2-060d-4f24-9a98-436baee74d6d None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:43:27.090024 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ef53e2-060d-4f24-9a98-436baee74d6d None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:43:27.090024 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ef53e2-060d-4f24-9a98-436baee74d6d None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:43:27.091367 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 734/1471] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:43:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:43:27.096727 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729176c6-c6ac-4509-bb85-e746d093a4dd None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:43:27.097145 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729176c6-c6ac-4509-bb85-e746d093a4dd None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:43:27.097299 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729176c6-c6ac-4509-bb85-e746d093a4dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:43:27.115269 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-729176c6-c6ac-4509-bb85-e746d093a4dd None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:43:27.116463 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-729176c6-c6ac-4509-bb85-e746d093a4dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:43:27.124331 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 738/1472] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:43:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 14:43:27.171641 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8560c1dc-5e4f-49a1-9102-60a9e8050b38 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:43:27.171920 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8560c1dc-5e4f-49a1-9102-60a9e8050b38 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:43:27.172200 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8560c1dc-5e4f-49a1-9102-60a9e8050b38 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:43:27.173556 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 735/1473] 10.222.0.15 () {54 vars in 962 bytes} [Tue May 31 14:43:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:43:27.178845 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5399d40b-0efa-4102-9378-564ede604f54 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:43:27.179150 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5399d40b-0efa-4102-9378-564ede604f54 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:43:27.179436 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5399d40b-0efa-4102-9378-564ede604f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:43:27.199059 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-5399d40b-0efa-4102-9378-564ede604f54 None None] MFA Rules not processed for user `14ba98b007cc4ae1b20e7f261824b77c`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:43:27.200264 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-5399d40b-0efa-4102-9378-564ede604f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:43:27.206855 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 739/1474] 10.222.0.15 () {58 vars in 1059 bytes} [Tue May 31 14:43:27 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:43:27.214118 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8560c1dc-5e4f-49a1-9102-60a9e8050b38 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:43:27.224787 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8560c1dc-5e4f-49a1-9102-60a9e8050b38 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:43:27.228616 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1edf588-696a-49ca-b0aa-201bacb9cca0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ba98b007cc4ae1b20e7f261824b77c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:43:27.229256 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1edf588-696a-49ca-b0aa-201bacb9cca0 service glance] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:43:27.229541 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1edf588-696a-49ca-b0aa-201bacb9cca0 service glance] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:43:27.229819 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1edf588-696a-49ca-b0aa-201bacb9cca0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:43:27.239580 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1edf588-696a-49ca-b0aa-201bacb9cca0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:43:27.241981 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1edf588-696a-49ca-b0aa-201bacb9cca0 service glance] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:43:27.250415 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 736/1475] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:43:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:43:29.590817 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fbbc66-6cb7-46d2-ab69-8e1814d088c0 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:43:29.591343 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fbbc66-6cb7-46d2-ab69-8e1814d088c0 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:43:29.591343 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fbbc66-6cb7-46d2-ab69-8e1814d088c0 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:43:29.592645 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 740/1476] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:43:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:43:29.598251 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4732456-5331-4524-95a2-87f1b7126f1f None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:43:29.598683 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4732456-5331-4524-95a2-87f1b7126f1f None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:43:29.598835 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4732456-5331-4524-95a2-87f1b7126f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:43:29.616625 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-e4732456-5331-4524-95a2-87f1b7126f1f None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:43:29.617799 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-e4732456-5331-4524-95a2-87f1b7126f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:43:29.625378 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 737/1477] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:43:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:43:29.648544 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fbbc66-6cb7-46d2-ab69-8e1814d088c0 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:43:29.661634 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fbbc66-6cb7-46d2-ab69-8e1814d088c0 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:43:29.670826 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b18f08-4294-4bf2-a6be-e2f43bf753c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:43:29.671472 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b18f08-4294-4bf2-a6be-e2f43bf753c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:43:29.671751 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b18f08-4294-4bf2-a6be-e2f43bf753c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:43:29.672025 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b18f08-4294-4bf2-a6be-e2f43bf753c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:43:29.672749 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b18f08-4294-4bf2-a6be-e2f43bf753c3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:43:29.674449 dv-cinder-839793-14-smb devstack@keystone.service[80503]: WARNING py.warnings [None req-48b18f08-4294-4bf2-a6be-e2f43bf753c3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 31 14:43:29.674449 dv-cinder-839793-14-smb devstack@keystone.service[80503]: warnings.warn(msg) May 31 14:43:29.674449 dv-cinder-839793-14-smb devstack@keystone.service[80503]: May 31 14:43:29.676238 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b18f08-4294-4bf2-a6be-e2f43bf753c3 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:43:29.694823 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 741/1478] 10.222.0.15 () {56 vars in 1108 bytes} [Tue May 31 14:43:29 2022] GET /identity/v3/projects => generated 2553 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:43:31.952639 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d9e4ee-78ce-40af-99cf-cbb8c3470a26 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:43:31.953170 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d9e4ee-78ce-40af-99cf-cbb8c3470a26 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:43:31.953289 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d9e4ee-78ce-40af-99cf-cbb8c3470a26 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:43:31.954574 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 738/1479] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:43:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:43:31.960601 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b0562-a4ba-4b5f-a48a-6f4c5dd4ef63 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:43:31.961049 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b0562-a4ba-4b5f-a48a-6f4c5dd4ef63 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:43:31.961156 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b0562-a4ba-4b5f-a48a-6f4c5dd4ef63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:43:31.978778 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-641b0562-a4ba-4b5f-a48a-6f4c5dd4ef63 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:43:31.979953 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-641b0562-a4ba-4b5f-a48a-6f4c5dd4ef63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:43:31.988380 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 742/1480] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:43:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 14:43:32.031934 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d9e4ee-78ce-40af-99cf-cbb8c3470a26 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:43:32.046637 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d9e4ee-78ce-40af-99cf-cbb8c3470a26 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:43:32.052168 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0a5874-0ce4-4788-ac80-94e3a42f30c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57768d448e345ad8879bf29f21b48ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:43:32.052810 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0a5874-0ce4-4788-ac80-94e3a42f30c2 service nova] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:43:32.053096 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0a5874-0ce4-4788-ac80-94e3a42f30c2 service nova] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:43:32.053374 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0a5874-0ce4-4788-ac80-94e3a42f30c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:43:32.065103 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0a5874-0ce4-4788-ac80-94e3a42f30c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:43:32.065103 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0a5874-0ce4-4788-ac80-94e3a42f30c2 service nova] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:43:32.073133 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 739/1481] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:43:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:43:34.484452 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a99b2-1272-4cab-994a-4a4a61823b4f None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:43:34.485040 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a99b2-1272-4cab-994a-4a4a61823b4f None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:43:34.485150 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a99b2-1272-4cab-994a-4a4a61823b4f None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:43:34.486475 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 743/1482] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:43:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:43:34.491948 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a53b233-5042-4bf6-a28c-33fdc2e8ea37 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:43:34.492407 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a53b233-5042-4bf6-a28c-33fdc2e8ea37 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:43:34.492527 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a53b233-5042-4bf6-a28c-33fdc2e8ea37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:43:34.509794 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-2a53b233-5042-4bf6-a28c-33fdc2e8ea37 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:43:34.511029 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-2a53b233-5042-4bf6-a28c-33fdc2e8ea37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:43:34.519371 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 740/1483] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:43:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:43:34.555660 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9a99b2-1272-4cab-994a-4a4a61823b4f None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:43:34.566370 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9a99b2-1272-4cab-994a-4a4a61823b4f None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:43:34.569876 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c1efcc-5fe8-4c0c-895e-ee52b62554e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:43:34.570505 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c1efcc-5fe8-4c0c-895e-ee52b62554e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:43:34.570815 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c1efcc-5fe8-4c0c-895e-ee52b62554e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:43:34.571090 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c1efcc-5fe8-4c0c-895e-ee52b62554e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:43:34.579916 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c1efcc-5fe8-4c0c-895e-ee52b62554e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:43:34.581818 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c1efcc-5fe8-4c0c-895e-ee52b62554e5 service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:43:34.591375 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 744/1484] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:43:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:43:36.870736 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db33e4-096a-463c-a9cc-912c94b74507 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:43:36.871281 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db33e4-096a-463c-a9cc-912c94b74507 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:43:36.871281 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db33e4-096a-463c-a9cc-912c94b74507 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:43:36.872600 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 741/1485] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:43:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:43:36.877743 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74558ec1-54ad-4aae-8d86-c96d293b8caa None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:43:36.878177 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74558ec1-54ad-4aae-8d86-c96d293b8caa None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:43:36.878332 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74558ec1-54ad-4aae-8d86-c96d293b8caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:43:36.896483 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-74558ec1-54ad-4aae-8d86-c96d293b8caa None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:43:36.897683 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-74558ec1-54ad-4aae-8d86-c96d293b8caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:43:36.905440 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 745/1486] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:43:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:43:36.943418 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7db33e4-096a-463c-a9cc-912c94b74507 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:43:36.953875 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7db33e4-096a-463c-a9cc-912c94b74507 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:43:36.957957 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55c65df-4dfc-4618-921e-20b9e2bde1c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:43:36.958666 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55c65df-4dfc-4618-921e-20b9e2bde1c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:43:36.958950 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55c65df-4dfc-4618-921e-20b9e2bde1c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:43:36.959225 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55c65df-4dfc-4618-921e-20b9e2bde1c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:43:36.968236 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55c65df-4dfc-4618-921e-20b9e2bde1c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:43:36.969660 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55c65df-4dfc-4618-921e-20b9e2bde1c0 service neutron] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:43:36.979388 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 742/1487] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:43:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:43:39.369799 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c9937f-2a70-41f1-aee9-81fe8ccc4811 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:43:39.370320 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c9937f-2a70-41f1-aee9-81fe8ccc4811 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:43:39.370320 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c9937f-2a70-41f1-aee9-81fe8ccc4811 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:43:39.371715 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 746/1488] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:43:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:43:39.376936 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e940bf55-c93e-4ac8-b462-573aa6c0018a None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:43:39.377376 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e940bf55-c93e-4ac8-b462-573aa6c0018a None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:43:39.377506 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e940bf55-c93e-4ac8-b462-573aa6c0018a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:43:39.394842 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-e940bf55-c93e-4ac8-b462-573aa6c0018a None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:43:39.396057 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-e940bf55-c93e-4ac8-b462-573aa6c0018a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:43:39.403743 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 743/1489] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:43:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:43:39.444235 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c9937f-2a70-41f1-aee9-81fe8ccc4811 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:43:39.455052 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c9937f-2a70-41f1-aee9-81fe8ccc4811 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:43:39.458766 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062fb67f-3841-42c7-8a8d-78d87b9cf695 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:43:39.460081 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062fb67f-3841-42c7-8a8d-78d87b9cf695 service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:43:39.460370 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062fb67f-3841-42c7-8a8d-78d87b9cf695 service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:43:39.461305 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062fb67f-3841-42c7-8a8d-78d87b9cf695 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:43:39.470227 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062fb67f-3841-42c7-8a8d-78d87b9cf695 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:43:39.472190 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062fb67f-3841-42c7-8a8d-78d87b9cf695 service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:43:39.481753 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 747/1490] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:43:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:43:42.201035 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01303707-bc66-4308-be1d-29bd5f7676de None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:43:42.201642 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01303707-bc66-4308-be1d-29bd5f7676de None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:43:42.201642 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01303707-bc66-4308-be1d-29bd5f7676de None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:43:42.202994 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 744/1491] 10.222.0.15 () {54 vars in 926 bytes} [Tue May 31 14:43:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:43:42.208786 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4904f9-3a01-4d17-ba3c-865c8ebb58c8 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:43:42.209244 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4904f9-3a01-4d17-ba3c-865c8ebb58c8 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:43:42.209356 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4904f9-3a01-4d17-ba3c-865c8ebb58c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:43:42.227032 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-2c4904f9-3a01-4d17-ba3c-865c8ebb58c8 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:43:42.228205 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-2c4904f9-3a01-4d17-ba3c-865c8ebb58c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:43:42.235881 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 748/1492] 10.222.0.15 () {58 vars in 1023 bytes} [Tue May 31 14:43:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:43:42.274520 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01303707-bc66-4308-be1d-29bd5f7676de None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:43:42.285549 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01303707-bc66-4308-be1d-29bd5f7676de None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:43:42.289286 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460ea037-b604-4219-bb36-8b4e65b04338 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:43:42.289917 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ea037-b604-4219-bb36-8b4e65b04338 service neutron] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:43:42.290198 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ea037-b604-4219-bb36-8b4e65b04338 service neutron] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:43:42.290471 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ea037-b604-4219-bb36-8b4e65b04338 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:43:42.299600 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460ea037-b604-4219-bb36-8b4e65b04338 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:43:42.301050 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460ea037-b604-4219-bb36-8b4e65b04338 service neutron] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:43:42.310199 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 745/1493] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:43:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:43:52.221521 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=33 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:43:52.306117 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=33 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:45:27.962934 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff32a27-5cb6-449f-bccb-55868227b9b3 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:45:27.963519 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff32a27-5cb6-449f-bccb-55868227b9b3 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:45:27.963519 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff32a27-5cb6-449f-bccb-55868227b9b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:45:27.981715 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-5ff32a27-5cb6-449f-bccb-55868227b9b3 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:45:27.982940 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-5ff32a27-5cb6-449f-bccb-55868227b9b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:45:27.991398 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 749/1494] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:45:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:45:28.001258 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c0828-2e20-4bc7-aba8-60be9f2ca224 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:45:28.001727 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c0828-2e20-4bc7-aba8-60be9f2ca224 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:45:28.001907 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c0828-2e20-4bc7-aba8-60be9f2ca224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:45:28.019542 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-1c7c0828-2e20-4bc7-aba8-60be9f2ca224 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:45:28.020709 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-1c7c0828-2e20-4bc7-aba8-60be9f2ca224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:45:28.028608 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 746/1495] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:45:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:45:28.039155 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff32a27-5cb6-449f-bccb-55868227b9b3 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:45:28.048703 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff32a27-5cb6-449f-bccb-55868227b9b3 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:45:28.053772 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26ae93e-4a5d-45db-b572-29b3c0f36de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:45:28.054414 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ae93e-4a5d-45db-b572-29b3c0f36de0 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:45:28.054739 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ae93e-4a5d-45db-b572-29b3c0f36de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:45:28.055018 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ae93e-4a5d-45db-b572-29b3c0f36de0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:45:28.055726 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26ae93e-4a5d-45db-b572-29b3c0f36de0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:45:28.056031 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26ae93e-4a5d-45db-b572-29b3c0f36de0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:45:28.057029 dv-cinder-839793-14-smb devstack@keystone.service[80503]: WARNING py.warnings [None req-c26ae93e-4a5d-45db-b572-29b3c0f36de0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 31 14:45:28.057029 dv-cinder-839793-14-smb devstack@keystone.service[80503]: warnings.warn(msg) May 31 14:45:28.057029 dv-cinder-839793-14-smb devstack@keystone.service[80503]: May 31 14:45:28.057889 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26ae93e-4a5d-45db-b572-29b3c0f36de0 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:45:28.069255 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 750/1496] 10.222.0.15 () {58 vars in 1152 bytes} [Tue May 31 14:45:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:45:28.077419 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7c0828-2e20-4bc7-aba8-60be9f2ca224 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:45:28.086703 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7c0828-2e20-4bc7-aba8-60be9f2ca224 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:45:28.091202 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b54632-ed24-4997-bd4c-f5e04db2aca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:45:28.091846 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b54632-ed24-4997-bd4c-f5e04db2aca4 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:45:28.092126 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b54632-ed24-4997-bd4c-f5e04db2aca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:45:28.092426 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b54632-ed24-4997-bd4c-f5e04db2aca4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:45:28.093114 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b54632-ed24-4997-bd4c-f5e04db2aca4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:45:28.094963 dv-cinder-839793-14-smb devstack@keystone.service[80502]: WARNING py.warnings [None req-d8b54632-ed24-4997-bd4c-f5e04db2aca4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 31 14:45:28.094963 dv-cinder-839793-14-smb devstack@keystone.service[80502]: warnings.warn(msg) May 31 14:45:28.094963 dv-cinder-839793-14-smb devstack@keystone.service[80502]: May 31 14:45:28.096132 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b54632-ed24-4997-bd4c-f5e04db2aca4 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:45:28.222276 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 747/1497] 10.222.0.15 () {60 vars in 1152 bytes} [Tue May 31 14:45:28 2022] POST /identity/v3/projects => generated 379 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 14:45:28.227108 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26ae93e-4a5d-45db-b572-29b3c0f36de0 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:45:28.236970 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26ae93e-4a5d-45db-b572-29b3c0f36de0 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:45:28.292299 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e1ebf3-e26d-478a-9434-ea2ec10617e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:45:28.292963 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e1ebf3-e26d-478a-9434-ea2ec10617e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:45:28.293248 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e1ebf3-e26d-478a-9434-ea2ec10617e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:45:28.293525 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e1ebf3-e26d-478a-9434-ea2ec10617e8 admin admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:45:28.294221 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e1ebf3-e26d-478a-9434-ea2ec10617e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:45:28.295278 dv-cinder-839793-14-smb devstack@keystone.service[80503]: WARNING py.warnings [None req-14e1ebf3-e26d-478a-9434-ea2ec10617e8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 31 14:45:28.295278 dv-cinder-839793-14-smb devstack@keystone.service[80503]: warnings.warn(msg) May 31 14:45:28.295278 dv-cinder-839793-14-smb devstack@keystone.service[80503]: May 31 14:45:28.296465 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e1ebf3-e26d-478a-9434-ea2ec10617e8 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:45:28.375106 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 751/1498] 10.222.0.15 () {60 vars in 1143 bytes} [Tue May 31 14:45:28 2022] POST /identity/v3/users => generated 290 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:45:28.379254 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b54632-ed24-4997-bd4c-f5e04db2aca4 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:45:28.390336 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b54632-ed24-4997-bd4c-f5e04db2aca4 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:45:28.394877 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f22644-db14-4814-84e3-f14381d33a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:45:28.395612 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f22644-db14-4814-84e3-f14381d33a78 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:45:28.395913 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f22644-db14-4814-84e3-f14381d33a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:45:28.396179 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f22644-db14-4814-84e3-f14381d33a78 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:45:28.396953 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f22644-db14-4814-84e3-f14381d33a78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:45:28.397975 dv-cinder-839793-14-smb devstack@keystone.service[80502]: WARNING py.warnings [None req-a4f22644-db14-4814-84e3-f14381d33a78 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 31 14:45:28.397975 dv-cinder-839793-14-smb devstack@keystone.service[80502]: warnings.warn(msg) May 31 14:45:28.397975 dv-cinder-839793-14-smb devstack@keystone.service[80502]: May 31 14:45:28.398883 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f22644-db14-4814-84e3-f14381d33a78 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:45:28.411173 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 748/1499] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:45:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:45:28.415142 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e1ebf3-e26d-478a-9434-ea2ec10617e8 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:45:28.424899 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e1ebf3-e26d-478a-9434-ea2ec10617e8 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:45:28.432317 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9e874b-7720-4d27-b57f-be10793e07ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:45:28.432986 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9e874b-7720-4d27-b57f-be10793e07ba admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:45:28.433269 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9e874b-7720-4d27-b57f-be10793e07ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:45:28.433544 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9e874b-7720-4d27-b57f-be10793e07ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:45:28.434296 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9e874b-7720-4d27-b57f-be10793e07ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:45:28.435410 dv-cinder-839793-14-smb devstack@keystone.service[80503]: WARNING py.warnings [None req-dd9e874b-7720-4d27-b57f-be10793e07ba admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 31 14:45:28.435410 dv-cinder-839793-14-smb devstack@keystone.service[80503]: warnings.warn(msg) May 31 14:45:28.435410 dv-cinder-839793-14-smb devstack@keystone.service[80503]: May 31 14:45:28.436286 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9e874b-7720-4d27-b57f-be10793e07ba admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:45:28.450203 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 752/1500] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:45:28 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:45:28.454399 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f22644-db14-4814-84e3-f14381d33a78 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:45:28.464052 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f22644-db14-4814-84e3-f14381d33a78 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:45:28.468609 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751283f6-a43c-4737-91d7-95c099e3259d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:45:28.469481 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751283f6-a43c-4737-91d7-95c099e3259d admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:45:28.469772 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751283f6-a43c-4737-91d7-95c099e3259d admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:45:28.470047 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751283f6-a43c-4737-91d7-95c099e3259d admin admin] PATH_INFO: `/v3/projects/eafe8d0dfc0d46518f08c6ad33fe21a0/users/ab4c8ae04a7046e198f1f6140ef6d5d7/roles/317f725e26bf43648d8235bb1f7c4cb3` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:45:28.484403 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751283f6-a43c-4737-91d7-95c099e3259d admin admin] RBAC: Authorizing `identity:create_grant(project_id=eafe8d0dfc0d46518f08c6ad33fe21a0, user_id=ab4c8ae04a7046e198f1f6140ef6d5d7, role_id=317f725e26bf43648d8235bb1f7c4cb3)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:45:28.485386 dv-cinder-839793-14-smb devstack@keystone.service[80502]: WARNING py.warnings [None req-751283f6-a43c-4737-91d7-95c099e3259d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 31 14:45:28.485386 dv-cinder-839793-14-smb devstack@keystone.service[80502]: warnings.warn(msg) May 31 14:45:28.485386 dv-cinder-839793-14-smb devstack@keystone.service[80502]: May 31 14:45:28.487350 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751283f6-a43c-4737-91d7-95c099e3259d admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:45:28.570393 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 749/1501] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:45:28 2022] PUT /identity/v3/projects/eafe8d0dfc0d46518f08c6ad33fe21a0/users/ab4c8ae04a7046e198f1f6140ef6d5d7/roles/317f725e26bf43648d8235bb1f7c4cb3 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:45:28.582492 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f92ea-b94e-4a4a-b7be-ad40c2fd131d None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:45:28.582810 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f92ea-b94e-4a4a-b7be-ad40c2fd131d None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:45:28.583090 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f92ea-b94e-4a4a-b7be-ad40c2fd131d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:45:28.608972 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-747f92ea-b94e-4a4a-b7be-ad40c2fd131d None None] MFA Rules not processed for user `ab4c8ae04a7046e198f1f6140ef6d5d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:45:28.610174 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-747f92ea-b94e-4a4a-b7be-ad40c2fd131d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:45:28.679130 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 753/1502] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:45:28 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:45:28.695745 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300fa499-cf84-47b6-9d54-c8f6f2568c37 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:45:28.696036 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300fa499-cf84-47b6-9d54-c8f6f2568c37 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:45:28.696320 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300fa499-cf84-47b6-9d54-c8f6f2568c37 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:45:28.697769 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 750/1503] 10.222.0.15 () {54 vars in 963 bytes} [Tue May 31 14:45:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:45:28.702720 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aa332f-edfe-4695-9c9f-2d4e9295ea02 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:45:28.703015 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aa332f-edfe-4695-9c9f-2d4e9295ea02 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:45:28.703297 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aa332f-edfe-4695-9c9f-2d4e9295ea02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:45:28.722059 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-18aa332f-edfe-4695-9c9f-2d4e9295ea02 None None] MFA Rules not processed for user `afbf718dcd9b4741a926b0a2321bd53e`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:45:28.723860 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-18aa332f-edfe-4695-9c9f-2d4e9295ea02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:45:28.770598 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:45:28.778507 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 754/1504] 10.222.0.15 () {58 vars in 1060 bytes} [Tue May 31 14:45:28 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:45:28.786954 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300fa499-cf84-47b6-9d54-c8f6f2568c37 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:45:28.800010 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300fa499-cf84-47b6-9d54-c8f6f2568c37 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:45:28.804604 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be3400b-bef8-4283-b90c-9b2216b4b232 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afbf718dcd9b4741a926b0a2321bd53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:45:28.805315 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be3400b-bef8-4283-b90c-9b2216b4b232 service cinder] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:45:28.805602 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be3400b-bef8-4283-b90c-9b2216b4b232 service cinder] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:45:28.805884 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be3400b-bef8-4283-b90c-9b2216b4b232 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:45:28.816108 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be3400b-bef8-4283-b90c-9b2216b4b232 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:45:28.818085 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be3400b-bef8-4283-b90c-9b2216b4b232 service cinder] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:45:28.827810 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 751/1505] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:45:28 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:45:28.870351 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d2e67-85d2-4d6b-a6a5-b8c6f6243d56 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:45:28.870668 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d2e67-85d2-4d6b-a6a5-b8c6f6243d56 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:45:28.870948 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d2e67-85d2-4d6b-a6a5-b8c6f6243d56 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:45:28.872215 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 755/1506] 10.222.0.15 () {52 vars in 829 bytes} [Tue May 31 14:45:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:45:28.875831 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be3400b-bef8-4283-b90c-9b2216b4b232 service cinder] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:45:28.940211 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be3400b-bef8-4283-b90c-9b2216b4b232 service cinder] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:45:28.945076 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9982666-be45-43a8-afe2-e9fb51282f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:45:28.945987 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9982666-be45-43a8-afe2-e9fb51282f70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:45:28.946267 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9982666-be45-43a8-afe2-e9fb51282f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:45:28.946541 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9982666-be45-43a8-afe2-e9fb51282f70 admin admin] PATH_INFO: `/v3/users/ab4c8ae04a7046e198f1f6140ef6d5d7` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:45:28.948113 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9982666-be45-43a8-afe2-e9fb51282f70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab4c8ae04a7046e198f1f6140ef6d5d7)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:45:28.949951 dv-cinder-839793-14-smb devstack@keystone.service[80502]: WARNING py.warnings [None req-b9982666-be45-43a8-afe2-e9fb51282f70 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 31 14:45:28.949951 dv-cinder-839793-14-smb devstack@keystone.service[80502]: warnings.warn(msg) May 31 14:45:28.949951 dv-cinder-839793-14-smb devstack@keystone.service[80502]: May 31 14:45:28.951590 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9982666-be45-43a8-afe2-e9fb51282f70 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:45:29.181928 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-b9982666-be45-43a8-afe2-e9fb51282f70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab4c8ae04a7046e198f1f6140ef6d5d7'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:45:29.194013 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-b9982666-be45-43a8-afe2-e9fb51282f70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab4c8ae04a7046e198f1f6140ef6d5d7'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:45:29.194728 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-b9982666-be45-43a8-afe2-e9fb51282f70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab4c8ae04a7046e198f1f6140ef6d5d7'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:45:29.195433 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-b9982666-be45-43a8-afe2-e9fb51282f70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab4c8ae04a7046e198f1f6140ef6d5d7'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:45:29.217059 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-b9982666-be45-43a8-afe2-e9fb51282f70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab4c8ae04a7046e198f1f6140ef6d5d7'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:45:29.221198 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:45:29.336104 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 752/1507] 10.222.0.15 () {58 vars in 1223 bytes} [Tue May 31 14:45:28 2022] DELETE /identity/v3/users/ab4c8ae04a7046e198f1f6140ef6d5d7 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:45:29.340614 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c19438-a4cb-4a30-b314-97717f29c5ab None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:45:29.344924 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c19438-a4cb-4a30-b314-97717f29c5ab None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:45:29.344924 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c19438-a4cb-4a30-b314-97717f29c5ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:45:29.359040 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-51c19438-a4cb-4a30-b314-97717f29c5ab None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:45:29.360236 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-51c19438-a4cb-4a30-b314-97717f29c5ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:45:29.418088 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 756/1508] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:45:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:45:29.427683 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9982666-be45-43a8-afe2-e9fb51282f70 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:45:29.429088 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-b9982666-be45-43a8-afe2-e9fb51282f70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:45:29.484523 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9982666-be45-43a8-afe2-e9fb51282f70 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:45:29.488091 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e084ca28-1c47-4010-a76d-fbc2e9c6fe6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:45:29.488741 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e084ca28-1c47-4010-a76d-fbc2e9c6fe6f service neutron] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:45:29.489068 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e084ca28-1c47-4010-a76d-fbc2e9c6fe6f service neutron] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:45:29.489352 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e084ca28-1c47-4010-a76d-fbc2e9c6fe6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:45:29.498142 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e084ca28-1c47-4010-a76d-fbc2e9c6fe6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:45:29.499619 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e084ca28-1c47-4010-a76d-fbc2e9c6fe6f service neutron] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:45:29.509718 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 753/1509] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:45:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:45:30.039963 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c19438-a4cb-4a30-b314-97717f29c5ab None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:45:30.041577 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-51c19438-a4cb-4a30-b314-97717f29c5ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:45:30.058456 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c19438-a4cb-4a30-b314-97717f29c5ab None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:45:30.059033 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266da63c-fdf3-4823-aa3a-5645d2d6322b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:45:30.059980 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266da63c-fdf3-4823-aa3a-5645d2d6322b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:45:30.060262 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266da63c-fdf3-4823-aa3a-5645d2d6322b admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:45:30.060536 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266da63c-fdf3-4823-aa3a-5645d2d6322b admin admin] PATH_INFO: `/v3/projects/eafe8d0dfc0d46518f08c6ad33fe21a0` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:45:30.062007 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266da63c-fdf3-4823-aa3a-5645d2d6322b admin admin] RBAC: Authorizing `identity:delete_project(project_id=eafe8d0dfc0d46518f08c6ad33fe21a0)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:45:30.062928 dv-cinder-839793-14-smb devstack@keystone.service[80503]: WARNING py.warnings [None req-266da63c-fdf3-4823-aa3a-5645d2d6322b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 31 14:45:30.062928 dv-cinder-839793-14-smb devstack@keystone.service[80503]: warnings.warn(msg) May 31 14:45:30.062928 dv-cinder-839793-14-smb devstack@keystone.service[80503]: May 31 14:45:30.064123 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266da63c-fdf3-4823-aa3a-5645d2d6322b admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:45:30.174770 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-266da63c-fdf3-4823-aa3a-5645d2d6322b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eafe8d0dfc0d46518f08c6ad33fe21a0', 'request_id': 'req-266da63c-fdf3-4823-aa3a-5645d2d6322b'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:45:30.226529 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-266da63c-fdf3-4823-aa3a-5645d2d6322b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eafe8d0dfc0d46518f08c6ad33fe21a0', 'request_id': 'req-266da63c-fdf3-4823-aa3a-5645d2d6322b'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:45:30.232707 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-266da63c-fdf3-4823-aa3a-5645d2d6322b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eafe8d0dfc0d46518f08c6ad33fe21a0', 'request_id': 'req-266da63c-fdf3-4823-aa3a-5645d2d6322b'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:45:30.254105 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-266da63c-fdf3-4823-aa3a-5645d2d6322b admin admin] The token cache is being invalidate because project eafe8d0dfc0d46518f08c6ad33fe21a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80503) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 14:45:30.254402 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-266da63c-fdf3-4823-aa3a-5645d2d6322b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:45:30.255672 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-266da63c-fdf3-4823-aa3a-5645d2d6322b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:45:30.257446 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 757/1510] 10.222.0.15 () {58 vars in 1232 bytes} [Tue May 31 14:45:30 2022] DELETE /identity/v3/projects/eafe8d0dfc0d46518f08c6ad33fe21a0 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:45:39.505482 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:45:40.249254 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:47:15.022200 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4442c16a-eb0a-4c34-b00c-26cbd5fa6ec3 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:47:15.022850 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4442c16a-eb0a-4c34-b00c-26cbd5fa6ec3 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:47:15.022850 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4442c16a-eb0a-4c34-b00c-26cbd5fa6ec3 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:47:15.024086 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 754/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 31 14:47:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:47:15.029402 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b77bba-d7c6-4373-bcd1-be4c1d647ef6 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:47:15.029808 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b77bba-d7c6-4373-bcd1-be4c1d647ef6 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:47:15.029963 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b77bba-d7c6-4373-bcd1-be4c1d647ef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:47:15.047994 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-f8b77bba-d7c6-4373-bcd1-be4c1d647ef6 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:47:15.049195 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-f8b77bba-d7c6-4373-bcd1-be4c1d647ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:47:15.106935 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 758/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 31 14:47:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:47:15.272825 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4442c16a-eb0a-4c34-b00c-26cbd5fa6ec3 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:47:15.274482 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-4442c16a-eb0a-4c34-b00c-26cbd5fa6ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:47:15.352677 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4442c16a-eb0a-4c34-b00c-26cbd5fa6ec3 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:47:15.358057 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8d1962-eaca-440e-93ef-ed9f64a8c282 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57768d448e345ad8879bf29f21b48ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:47:15.358769 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d1962-eaca-440e-93ef-ed9f64a8c282 service nova] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:47:15.359055 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d1962-eaca-440e-93ef-ed9f64a8c282 service nova] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:47:15.359338 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d1962-eaca-440e-93ef-ed9f64a8c282 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:47:15.367273 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8d1962-eaca-440e-93ef-ed9f64a8c282 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:47:15.368858 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8d1962-eaca-440e-93ef-ed9f64a8c282 service nova] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:47:15.378653 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 755/1513] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:47:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:47:16.246096 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd12a5-4cee-4224-b70f-181247f99b3e None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:47:16.246668 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd12a5-4cee-4224-b70f-181247f99b3e None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:47:16.246668 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd12a5-4cee-4224-b70f-181247f99b3e None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:47:16.248024 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 759/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 31 14:47:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:47:16.253178 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb74e126-49c5-4ae5-b3f2-bd3530773880 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:47:16.253626 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb74e126-49c5-4ae5-b3f2-bd3530773880 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:47:16.253762 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb74e126-49c5-4ae5-b3f2-bd3530773880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:47:16.272439 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-cb74e126-49c5-4ae5-b3f2-bd3530773880 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:47:16.273674 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-cb74e126-49c5-4ae5-b3f2-bd3530773880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:47:16.282162 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 756/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 31 14:47:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:47:16.432395 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbd12a5-4cee-4224-b70f-181247f99b3e None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:47:16.446856 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbd12a5-4cee-4224-b70f-181247f99b3e None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:47:16.452838 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e52938-5d2b-4da2-a6f8-0f0f13fe89e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57768d448e345ad8879bf29f21b48ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:47:16.453468 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e52938-5d2b-4da2-a6f8-0f0f13fe89e8 service nova] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:47:16.453753 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e52938-5d2b-4da2-a6f8-0f0f13fe89e8 service nova] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:47:16.454030 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e52938-5d2b-4da2-a6f8-0f0f13fe89e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:47:16.462116 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e52938-5d2b-4da2-a6f8-0f0f13fe89e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:47:16.464321 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e52938-5d2b-4da2-a6f8-0f0f13fe89e8 service nova] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:47:16.473665 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 760/1516] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:47:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:47:16.559935 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e107c6a-7cb4-45bc-b472-48719e4b351b None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:47:16.560249 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e107c6a-7cb4-45bc-b472-48719e4b351b None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:47:16.560534 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e107c6a-7cb4-45bc-b472-48719e4b351b None None] PATH_INFO: `/v3` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:47:16.561858 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 757/1517] 10.222.0.73 () {54 vars in 925 bytes} [Tue May 31 14:47:16 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:47:16.568275 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bbdb75-d15b-4685-b0ee-b20d1d6cbfd0 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:47:16.568573 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bbdb75-d15b-4685-b0ee-b20d1d6cbfd0 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:47:16.568858 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bbdb75-d15b-4685-b0ee-b20d1d6cbfd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:47:16.588643 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-c5bbdb75-d15b-4685-b0ee-b20d1d6cbfd0 None None] MFA Rules not processed for user `efc959ca520c4816b5ff7f95655e53e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:47:16.589863 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-c5bbdb75-d15b-4685-b0ee-b20d1d6cbfd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:47:16.652794 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 761/1518] 10.222.0.73 () {58 vars in 1015 bytes} [Tue May 31 14:47:16 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:47:20.853306 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c5cb8-2107-4725-9d2a-debeb6c3c629 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:47:20.853832 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c5cb8-2107-4725-9d2a-debeb6c3c629 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:47:20.853955 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c5cb8-2107-4725-9d2a-debeb6c3c629 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:47:20.855307 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 758/1519] 10.222.0.15 () {54 vars in 960 bytes} [Tue May 31 14:47:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:47:20.862302 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21329583-0242-450b-bf6b-0f6796f9c8e1 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:47:20.862798 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21329583-0242-450b-bf6b-0f6796f9c8e1 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:47:20.862904 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21329583-0242-450b-bf6b-0f6796f9c8e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:47:20.881638 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-21329583-0242-450b-bf6b-0f6796f9c8e1 None None] MFA Rules not processed for user `efc959ca520c4816b5ff7f95655e53e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:47:20.882897 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-21329583-0242-450b-bf6b-0f6796f9c8e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:47:20.891852 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 762/1520] 10.222.0.15 () {58 vars in 1057 bytes} [Tue May 31 14:47:20 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:47:20.899324 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875c5cb8-2107-4725-9d2a-debeb6c3c629 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:47:20.913050 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875c5cb8-2107-4725-9d2a-debeb6c3c629 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:47:20.918215 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9395d37d-1059-4c7a-8bce-1c79268a26f8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc959ca520c4816b5ff7f95655e53e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:47:20.918879 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9395d37d-1059-4c7a-8bce-1c79268a26f8 service placement] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:47:20.919173 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9395d37d-1059-4c7a-8bce-1c79268a26f8 service placement] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:47:20.919453 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9395d37d-1059-4c7a-8bce-1c79268a26f8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:47:20.927565 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9395d37d-1059-4c7a-8bce-1c79268a26f8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:47:20.929138 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9395d37d-1059-4c7a-8bce-1c79268a26f8 service placement] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:47:20.938522 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 759/1521] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:47:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:47:27.752987 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089e7e81-b969-401b-90eb-4979d8456f6d None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:47:27.753450 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089e7e81-b969-401b-90eb-4979d8456f6d None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:47:27.753554 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089e7e81-b969-401b-90eb-4979d8456f6d None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:47:27.754933 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 763/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 31 14:47:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:47:27.759989 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae5112f-3a91-4b5d-b105-21058e0eb184 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:47:27.760434 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae5112f-3a91-4b5d-b105-21058e0eb184 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:47:27.760540 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae5112f-3a91-4b5d-b105-21058e0eb184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:47:27.777906 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-eae5112f-3a91-4b5d-b105-21058e0eb184 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:47:27.779128 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-eae5112f-3a91-4b5d-b105-21058e0eb184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:47:27.787151 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 760/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 31 14:47:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:47:27.942903 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089e7e81-b969-401b-90eb-4979d8456f6d None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:47:27.957202 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089e7e81-b969-401b-90eb-4979d8456f6d None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:47:27.962631 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7419c20a-1d4a-4285-83ef-456ec67517bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57768d448e345ad8879bf29f21b48ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:47:27.963267 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7419c20a-1d4a-4285-83ef-456ec67517bb service nova] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:47:27.963555 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7419c20a-1d4a-4285-83ef-456ec67517bb service nova] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:47:27.963841 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7419c20a-1d4a-4285-83ef-456ec67517bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:47:27.972430 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7419c20a-1d4a-4285-83ef-456ec67517bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:47:27.974012 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7419c20a-1d4a-4285-83ef-456ec67517bb service nova] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:47:27.984004 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 764/1524] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:47:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:47:28.871308 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e632981-8cfe-4677-abdd-83c734520453 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:47:28.871870 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e632981-8cfe-4677-abdd-83c734520453 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:47:28.871870 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e632981-8cfe-4677-abdd-83c734520453 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:47:28.873258 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 761/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 31 14:47:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:47:28.877959 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de55dc-7b10-4180-a573-3c05c444eafe None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:47:28.878374 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de55dc-7b10-4180-a573-3c05c444eafe None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:47:28.878517 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de55dc-7b10-4180-a573-3c05c444eafe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:47:28.897539 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-68de55dc-7b10-4180-a573-3c05c444eafe None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:47:28.898994 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-68de55dc-7b10-4180-a573-3c05c444eafe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:47:28.907157 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 765/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 31 14:47:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:47:29.059614 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e632981-8cfe-4677-abdd-83c734520453 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:47:29.074279 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e632981-8cfe-4677-abdd-83c734520453 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:47:29.079594 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7059c19d-0c1e-42f2-88ed-27f6bc602878 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57768d448e345ad8879bf29f21b48ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:47:29.080222 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059c19d-0c1e-42f2-88ed-27f6bc602878 service nova] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:47:29.080503 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059c19d-0c1e-42f2-88ed-27f6bc602878 service nova] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:47:29.080800 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059c19d-0c1e-42f2-88ed-27f6bc602878 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:47:29.088702 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7059c19d-0c1e-42f2-88ed-27f6bc602878 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:47:29.090931 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7059c19d-0c1e-42f2-88ed-27f6bc602878 service nova] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:47:29.099976 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 762/1527] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:47:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 14:47:33.482885 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918182f-8e35-4551-9c19-128bc7dde098 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:47:33.483453 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918182f-8e35-4551-9c19-128bc7dde098 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:47:33.483453 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918182f-8e35-4551-9c19-128bc7dde098 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:47:33.484810 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 766/1528] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 31 14:47:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:47:33.490355 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84580e20-59da-46eb-97fc-6f7eb7513d72 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:47:33.490789 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84580e20-59da-46eb-97fc-6f7eb7513d72 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:47:33.490958 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84580e20-59da-46eb-97fc-6f7eb7513d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:47:33.508856 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-84580e20-59da-46eb-97fc-6f7eb7513d72 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:47:33.510031 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-84580e20-59da-46eb-97fc-6f7eb7513d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:47:33.518147 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 763/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 31 14:47:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:47:33.555047 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3918182f-8e35-4551-9c19-128bc7dde098 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:47:33.556755 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-3918182f-8e35-4551-9c19-128bc7dde098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:47:33.613748 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3918182f-8e35-4551-9c19-128bc7dde098 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:47:33.617315 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0709d706-9019-4639-8e40-23192d204111 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:47:33.617950 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0709d706-9019-4639-8e40-23192d204111 service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:47:33.618237 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0709d706-9019-4639-8e40-23192d204111 service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:47:33.618517 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0709d706-9019-4639-8e40-23192d204111 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:47:33.628148 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0709d706-9019-4639-8e40-23192d204111 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:47:33.629572 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0709d706-9019-4639-8e40-23192d204111 service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:47:33.634440 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:47:33.639205 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 767/1530] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:47:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:47:35.861440 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eb358e-7ec4-47c3-9d93-947919b157c9 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:47:35.862003 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eb358e-7ec4-47c3-9d93-947919b157c9 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:47:35.862003 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eb358e-7ec4-47c3-9d93-947919b157c9 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:47:35.863382 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 764/1531] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 31 14:47:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:47:35.868550 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d9f27c-8f90-404f-a992-0e47a00909f5 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:47:35.868984 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d9f27c-8f90-404f-a992-0e47a00909f5 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:47:35.869119 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d9f27c-8f90-404f-a992-0e47a00909f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:47:35.887587 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-00d9f27c-8f90-404f-a992-0e47a00909f5 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:47:35.888787 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-00d9f27c-8f90-404f-a992-0e47a00909f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:47:35.896586 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 768/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 31 14:47:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:47:35.932214 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eb358e-7ec4-47c3-9d93-947919b157c9 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:47:35.942667 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eb358e-7ec4-47c3-9d93-947919b157c9 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:47:35.946076 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9232935-5b7c-4ad2-bc0c-b0983f1587fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:47:35.946739 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9232935-5b7c-4ad2-bc0c-b0983f1587fc service neutron] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:47:35.947020 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9232935-5b7c-4ad2-bc0c-b0983f1587fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:47:35.947297 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9232935-5b7c-4ad2-bc0c-b0983f1587fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:47:35.956735 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9232935-5b7c-4ad2-bc0c-b0983f1587fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:47:35.958176 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9232935-5b7c-4ad2-bc0c-b0983f1587fc service neutron] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:47:35.968213 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 765/1533] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:47:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:47:39.705232 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb96fd1-3bb3-42d0-bf2c-6f3c0a48e0bb None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:47:39.705764 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb96fd1-3bb3-42d0-bf2c-6f3c0a48e0bb None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:47:39.705764 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb96fd1-3bb3-42d0-bf2c-6f3c0a48e0bb None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:47:39.707085 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 769/1534] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 31 14:47:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:47:39.712250 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550e963-d0fe-46ef-b02d-5eef7d0393d2 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:47:39.712683 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550e963-d0fe-46ef-b02d-5eef7d0393d2 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:47:39.712846 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550e963-d0fe-46ef-b02d-5eef7d0393d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:47:39.719717 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=62 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:47:39.731303 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-6550e963-d0fe-46ef-b02d-5eef7d0393d2 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:47:39.732506 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-6550e963-d0fe-46ef-b02d-5eef7d0393d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:47:39.740243 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 766/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 31 14:47:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:47:40.010057 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb96fd1-3bb3-42d0-bf2c-6f3c0a48e0bb None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:47:40.012352 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-7fb96fd1-3bb3-42d0-bf2c-6f3c0a48e0bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:47:40.067260 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb96fd1-3bb3-42d0-bf2c-6f3c0a48e0bb None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:47:40.070750 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b7ee15-7b31-49b9-99d4-2a05259d4b41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afbf718dcd9b4741a926b0a2321bd53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:47:40.071381 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b7ee15-7b31-49b9-99d4-2a05259d4b41 service cinder] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:47:40.071661 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b7ee15-7b31-49b9-99d4-2a05259d4b41 service cinder] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:47:40.071934 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b7ee15-7b31-49b9-99d4-2a05259d4b41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:47:40.081802 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b7ee15-7b31-49b9-99d4-2a05259d4b41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:47:40.083368 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b7ee15-7b31-49b9-99d4-2a05259d4b41 service cinder] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:47:40.092599 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 770/1536] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:47:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:47:42.338722 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ecc8b9-7bf3-41be-ba38-5bd2a61caac8 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:47:42.339317 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ecc8b9-7bf3-41be-ba38-5bd2a61caac8 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:47:42.339317 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ecc8b9-7bf3-41be-ba38-5bd2a61caac8 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:47:42.340708 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 767/1537] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 31 14:47:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:47:42.345888 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c80fe48-33be-4312-886c-db515e82d38d None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:47:42.346275 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c80fe48-33be-4312-886c-db515e82d38d None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:47:42.346462 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c80fe48-33be-4312-886c-db515e82d38d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:47:42.364202 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-3c80fe48-33be-4312-886c-db515e82d38d None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:47:42.365394 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-3c80fe48-33be-4312-886c-db515e82d38d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:47:42.373862 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 771/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 31 14:47:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:47:42.646009 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ecc8b9-7bf3-41be-ba38-5bd2a61caac8 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:47:42.647750 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-f8ecc8b9-7bf3-41be-ba38-5bd2a61caac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:47:42.661584 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ecc8b9-7bf3-41be-ba38-5bd2a61caac8 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:47:42.665079 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4833a991-d84b-4105-b0b4-027d3ecddefc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afbf718dcd9b4741a926b0a2321bd53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:47:42.665854 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4833a991-d84b-4105-b0b4-027d3ecddefc service cinder] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:47:42.666412 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4833a991-d84b-4105-b0b4-027d3ecddefc service cinder] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:47:42.666729 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4833a991-d84b-4105-b0b4-027d3ecddefc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:47:42.675698 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4833a991-d84b-4105-b0b4-027d3ecddefc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:47:42.677117 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4833a991-d84b-4105-b0b4-027d3ecddefc service cinder] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:47:42.686416 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 768/1539] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:47:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:47:52.359086 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=32 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:47:52.682363 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=8 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:49:16.427865 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bfab7d-5930-415d-a7b3-3dca30ee4a8b None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:16.428974 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bfab7d-5930-415d-a7b3-3dca30ee4a8b None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:16.429500 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bfab7d-5930-415d-a7b3-3dca30ee4a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:16.461737 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-c4bfab7d-5930-415d-a7b3-3dca30ee4a8b None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:49:16.467779 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-c4bfab7d-5930-415d-a7b3-3dca30ee4a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:16.480582 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 772/1540] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:49:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:49:16.492751 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16afabcb-6721-48d7-aec7-4854587e5f26 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:16.493352 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16afabcb-6721-48d7-aec7-4854587e5f26 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:16.493352 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16afabcb-6721-48d7-aec7-4854587e5f26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:16.520396 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-16afabcb-6721-48d7-aec7-4854587e5f26 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:49:16.521719 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-16afabcb-6721-48d7-aec7-4854587e5f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:16.533927 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 769/1541] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:49:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:49:16.539192 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bfab7d-5930-415d-a7b3-3dca30ee4a8b None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:16.551008 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bfab7d-5930-415d-a7b3-3dca30ee4a8b None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:16.559361 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094a50e5-8eb8-46d8-8b97-f9dc0f2015aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:16.560534 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094a50e5-8eb8-46d8-8b97-f9dc0f2015aa admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:16.561047 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094a50e5-8eb8-46d8-8b97-f9dc0f2015aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:16.561563 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094a50e5-8eb8-46d8-8b97-f9dc0f2015aa admin admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:16.562804 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094a50e5-8eb8-46d8-8b97-f9dc0f2015aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:49:16.563349 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094a50e5-8eb8-46d8-8b97-f9dc0f2015aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:16.565430 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094a50e5-8eb8-46d8-8b97-f9dc0f2015aa admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:16.584901 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 773/1542] 10.222.0.15 () {58 vars in 1152 bytes} [Tue May 31 14:49:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:49:16.594658 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16afabcb-6721-48d7-aec7-4854587e5f26 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:16.605861 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16afabcb-6721-48d7-aec7-4854587e5f26 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:16.616821 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e785a49-1f31-404c-8b55-fb146acc7d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:16.618300 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e785a49-1f31-404c-8b55-fb146acc7d53 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:16.618864 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e785a49-1f31-404c-8b55-fb146acc7d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:16.619369 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e785a49-1f31-404c-8b55-fb146acc7d53 admin admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:16.620409 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e785a49-1f31-404c-8b55-fb146acc7d53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:16.623003 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e785a49-1f31-404c-8b55-fb146acc7d53 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:16.741093 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 770/1543] 10.222.0.15 () {60 vars in 1152 bytes} [Tue May 31 14:49:16 2022] POST /identity/v3/projects => generated 377 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:49:16.745111 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094a50e5-8eb8-46d8-8b97-f9dc0f2015aa admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:16.760367 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094a50e5-8eb8-46d8-8b97-f9dc0f2015aa admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:16.824734 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fbb591-8824-4c77-8843-5cd61efbd4d2 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:16.824958 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fbb591-8824-4c77-8843-5cd61efbd4d2 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:16.825746 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fbb591-8824-4c77-8843-5cd61efbd4d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:16.850841 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fba0950-b172-4b8a-80da-e0a1fd1c270f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:16.851860 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fba0950-b172-4b8a-80da-e0a1fd1c270f admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:16.852373 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fba0950-b172-4b8a-80da-e0a1fd1c270f admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:16.852848 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fba0950-b172-4b8a-80da-e0a1fd1c270f admin admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:16.853735 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fba0950-b172-4b8a-80da-e0a1fd1c270f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:16.857229 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fba0950-b172-4b8a-80da-e0a1fd1c270f admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:16.867561 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-c9fbb591-8824-4c77-8843-5cd61efbd4d2 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:49:16.868788 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-c9fbb591-8824-4c77-8843-5cd61efbd4d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:16.884300 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 771/1544] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:49:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:49:16.889369 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd237e3-60a8-4a7f-9c83-9531da558095 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:16.889783 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd237e3-60a8-4a7f-9c83-9531da558095 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:16.890078 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd237e3-60a8-4a7f-9c83-9531da558095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:16.922737 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-dfd237e3-60a8-4a7f-9c83-9531da558095 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:49:16.923961 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-dfd237e3-60a8-4a7f-9c83-9531da558095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:16.933061 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 772/1545] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:49:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:49:16.934586 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc115392-fcbf-408b-bfd1-343ccbbc8904 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:16.934884 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc115392-fcbf-408b-bfd1-343ccbbc8904 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:16.935175 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc115392-fcbf-408b-bfd1-343ccbbc8904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:16.956709 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 774/1546] 10.222.0.15 () {60 vars in 1143 bytes} [Tue May 31 14:49:16 2022] POST /identity/v3/users => generated 289 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:49:16.958431 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955a509b-9cb7-4eca-9d5d-84ca94fb1b6d None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:16.958957 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955a509b-9cb7-4eca-9d5d-84ca94fb1b6d None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:16.959461 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955a509b-9cb7-4eca-9d5d-84ca94fb1b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:16.973435 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-cc115392-fcbf-408b-bfd1-343ccbbc8904 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:49:16.974686 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-cc115392-fcbf-408b-bfd1-343ccbbc8904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:16.992406 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 773/1547] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:49:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:49:16.993549 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc115392-fcbf-408b-bfd1-343ccbbc8904 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:16.994051 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-955a509b-9cb7-4eca-9d5d-84ca94fb1b6d None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:49:16.995861 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-955a509b-9cb7-4eca-9d5d-84ca94fb1b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:17.009198 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc115392-fcbf-408b-bfd1-343ccbbc8904 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:17.011986 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 775/1548] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:49:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:49:17.013590 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d030975-767d-4631-a22f-ede7b26c048b None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:17.014104 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d030975-767d-4631-a22f-ede7b26c048b None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:17.014629 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d030975-767d-4631-a22f-ede7b26c048b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:17.018593 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fbab62-b278-4c7c-8e87-2b9c2d12ac45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:17.018593 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fbab62-b278-4c7c-8e87-2b9c2d12ac45 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:17.018593 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fbab62-b278-4c7c-8e87-2b9c2d12ac45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:17.018593 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fbab62-b278-4c7c-8e87-2b9c2d12ac45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:17.018986 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fbab62-b278-4c7c-8e87-2b9c2d12ac45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:17.020344 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fbab62-b278-4c7c-8e87-2b9c2d12ac45 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:17.040208 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 774/1549] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:49:16 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:49:17.041166 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fbab62-b278-4c7c-8e87-2b9c2d12ac45 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:17.042703 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-9d030975-767d-4631-a22f-ede7b26c048b None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:49:17.044994 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-9d030975-767d-4631-a22f-ede7b26c048b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:17.057531 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fbab62-b278-4c7c-8e87-2b9c2d12ac45 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:17.065313 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9457799-c5b9-44ca-a4fa-1ebdacd97691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:17.065977 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9457799-c5b9-44ca-a4fa-1ebdacd97691 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:17.066260 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9457799-c5b9-44ca-a4fa-1ebdacd97691 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:17.066531 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9457799-c5b9-44ca-a4fa-1ebdacd97691 admin admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:17.066848 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 776/1550] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:49:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:49:17.067569 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9457799-c5b9-44ca-a4fa-1ebdacd97691 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:49:17.067905 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9457799-c5b9-44ca-a4fa-1ebdacd97691 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:17.068168 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d8d991-43a3-4600-b941-7990d8349449 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:17.068459 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d8d991-43a3-4600-b941-7990d8349449 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:17.068739 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d8d991-43a3-4600-b941-7990d8349449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:17.068919 dv-cinder-839793-14-smb devstack@keystone.service[80502]: WARNING py.warnings [None req-f9457799-c5b9-44ca-a4fa-1ebdacd97691 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 31 14:49:17.068919 dv-cinder-839793-14-smb devstack@keystone.service[80502]: warnings.warn(msg) May 31 14:49:17.068919 dv-cinder-839793-14-smb devstack@keystone.service[80502]: May 31 14:49:17.069804 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9457799-c5b9-44ca-a4fa-1ebdacd97691 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:17.082837 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 775/1551] 10.222.0.15 () {58 vars in 1152 bytes} [Tue May 31 14:49:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:49:17.083697 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9457799-c5b9-44ca-a4fa-1ebdacd97691 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:17.092459 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-92d8d991-43a3-4600-b941-7990d8349449 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:49:17.093711 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-92d8d991-43a3-4600-b941-7990d8349449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:17.107902 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 777/1552] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:49:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:49:17.108583 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9457799-c5b9-44ca-a4fa-1ebdacd97691 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:17.108736 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d8d991-43a3-4600-b941-7990d8349449 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:17.113466 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab9788f-68a0-460a-8ae9-f770551fe60a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:17.114135 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab9788f-68a0-460a-8ae9-f770551fe60a admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:17.114416 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab9788f-68a0-460a-8ae9-f770551fe60a admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:17.114731 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab9788f-68a0-460a-8ae9-f770551fe60a admin admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:17.115455 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab9788f-68a0-460a-8ae9-f770551fe60a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:49:17.115760 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab9788f-68a0-460a-8ae9-f770551fe60a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:17.117712 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab9788f-68a0-460a-8ae9-f770551fe60a admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:17.118727 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d8d991-43a3-4600-b941-7990d8349449 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:17.123308 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c36bca-1d61-4605-b614-434ac1efc74a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:17.123961 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c36bca-1d61-4605-b614-434ac1efc74a admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:17.124245 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c36bca-1d61-4605-b614-434ac1efc74a admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:17.124590 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c36bca-1d61-4605-b614-434ac1efc74a admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:17.125336 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c36bca-1d61-4605-b614-434ac1efc74a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:17.126955 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c36bca-1d61-4605-b614-434ac1efc74a admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:17.129815 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 776/1553] 10.222.0.15 () {58 vars in 1152 bytes} [Tue May 31 14:49:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:49:17.131099 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92749c2-60a8-4845-bd10-136b5c652e36 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:17.131399 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92749c2-60a8-4845-bd10-136b5c652e36 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:17.131686 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92749c2-60a8-4845-bd10-136b5c652e36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:17.140541 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 778/1554] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:49:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:49:17.141221 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596752ec-5727-46e8-a52c-ab3e207e627e None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:17.141511 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596752ec-5727-46e8-a52c-ab3e207e627e None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:17.141848 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596752ec-5727-46e8-a52c-ab3e207e627e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:17.151239 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-e92749c2-60a8-4845-bd10-136b5c652e36 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:49:17.152447 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-e92749c2-60a8-4845-bd10-136b5c652e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:17.160356 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-596752ec-5727-46e8-a52c-ab3e207e627e None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:49:17.164090 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 777/1555] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:49:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:49:17.164231 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-596752ec-5727-46e8-a52c-ab3e207e627e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:17.164325 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92749c2-60a8-4845-bd10-136b5c652e36 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:17.171833 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92749c2-60a8-4845-bd10-136b5c652e36 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:17.175052 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 779/1556] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:49:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:49:17.176466 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a877a1-6020-4b6b-923b-0a04b4f348a4 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:17.176758 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a877a1-6020-4b6b-923b-0a04b4f348a4 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:17.177043 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a877a1-6020-4b6b-923b-0a04b4f348a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:17.180016 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb16d235-efe5-4f12-976e-2fff7772a5f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:17.180681 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16d235-efe5-4f12-976e-2fff7772a5f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:17.180972 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16d235-efe5-4f12-976e-2fff7772a5f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:17.181294 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16d235-efe5-4f12-976e-2fff7772a5f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:17.182079 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb16d235-efe5-4f12-976e-2fff7772a5f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:17.184005 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb16d235-efe5-4f12-976e-2fff7772a5f9 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:17.196112 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-31a877a1-6020-4b6b-923b-0a04b4f348a4 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:49:17.197298 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-31a877a1-6020-4b6b-923b-0a04b4f348a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:17.205227 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 780/1557] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:49:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:49:17.206532 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feaa543-5ac3-42d4-a368-c6b5d84174fb None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:17.206855 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feaa543-5ac3-42d4-a368-c6b5d84174fb None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:17.207119 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feaa543-5ac3-42d4-a368-c6b5d84174fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:17.225947 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-9feaa543-5ac3-42d4-a368-c6b5d84174fb None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:49:17.227176 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-9feaa543-5ac3-42d4-a368-c6b5d84174fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:17.235818 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 781/1558] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:49:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:49:17.237038 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b6edc5-770e-4ddc-8e64-3926fe86c610 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:17.237328 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b6edc5-770e-4ddc-8e64-3926fe86c610 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:17.237609 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b6edc5-770e-4ddc-8e64-3926fe86c610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:17.255557 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-24b6edc5-770e-4ddc-8e64-3926fe86c610 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:49:17.256819 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-24b6edc5-770e-4ddc-8e64-3926fe86c610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:17.264853 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 782/1559] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:49:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:49:17.269085 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b6edc5-770e-4ddc-8e64-3926fe86c610 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:17.274908 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b6edc5-770e-4ddc-8e64-3926fe86c610 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:17.280202 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dce0f81-d5c6-4e72-a2cf-b5a22a1707a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:17.280845 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce0f81-d5c6-4e72-a2cf-b5a22a1707a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:17.281127 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce0f81-d5c6-4e72-a2cf-b5a22a1707a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:17.281424 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce0f81-d5c6-4e72-a2cf-b5a22a1707a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:17.282095 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dce0f81-d5c6-4e72-a2cf-b5a22a1707a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:17.283143 dv-cinder-839793-14-smb devstack@keystone.service[80503]: WARNING py.warnings [None req-2dce0f81-d5c6-4e72-a2cf-b5a22a1707a9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 31 14:49:17.283143 dv-cinder-839793-14-smb devstack@keystone.service[80503]: warnings.warn(msg) May 31 14:49:17.283143 dv-cinder-839793-14-smb devstack@keystone.service[80503]: May 31 14:49:17.284319 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dce0f81-d5c6-4e72-a2cf-b5a22a1707a9 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:17.314944 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 778/1560] 10.222.0.15 () {60 vars in 1152 bytes} [Tue May 31 14:49:17 2022] POST /identity/v3/projects => generated 379 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:49:17.314944 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb16d235-efe5-4f12-976e-2fff7772a5f9 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:17.376697 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb16d235-efe5-4f12-976e-2fff7772a5f9 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:17.381319 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4993a9-dd4b-4ec1-9e0c-746be68de1dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:17.382325 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4993a9-dd4b-4ec1-9e0c-746be68de1dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:17.382639 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4993a9-dd4b-4ec1-9e0c-746be68de1dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:17.382914 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4993a9-dd4b-4ec1-9e0c-746be68de1dc admin admin] PATH_INFO: `/v3/projects/0efdb0dd783e4076a13f49c4700bcebf/users/ec0bc78fb2d849cb89fec3420844d738/roles/317f725e26bf43648d8235bb1f7c4cb3` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:17.392032 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 783/1561] 10.222.0.15 () {60 vars in 1152 bytes} [Tue May 31 14:49:17 2022] POST /identity/v3/projects => generated 403 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:49:17.393736 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9603e4cd-9ddc-4bec-b695-6bc13aca5662 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:17.394095 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9603e4cd-9ddc-4bec-b695-6bc13aca5662 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:17.394446 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9603e4cd-9ddc-4bec-b695-6bc13aca5662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:17.400770 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4993a9-dd4b-4ec1-9e0c-746be68de1dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=0efdb0dd783e4076a13f49c4700bcebf, user_id=ec0bc78fb2d849cb89fec3420844d738, role_id=317f725e26bf43648d8235bb1f7c4cb3)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:17.404070 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4993a9-dd4b-4ec1-9e0c-746be68de1dc admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:17.412916 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-9603e4cd-9ddc-4bec-b695-6bc13aca5662 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:49:17.414129 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-9603e4cd-9ddc-4bec-b695-6bc13aca5662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:17.457862 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:49:17.472395 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 784/1562] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:49:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:49:17.473198 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9603e4cd-9ddc-4bec-b695-6bc13aca5662 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:17.482834 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9603e4cd-9ddc-4bec-b695-6bc13aca5662 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:17.487612 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 779/1563] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:49:17 2022] PUT /identity/v3/projects/0efdb0dd783e4076a13f49c4700bcebf/users/ec0bc78fb2d849cb89fec3420844d738/roles/317f725e26bf43648d8235bb1f7c4cb3 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:49:17.488977 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1550c41e-e968-4902-88ca-2844441db689 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:17.489346 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1550c41e-e968-4902-88ca-2844441db689 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:17.489701 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1550c41e-e968-4902-88ca-2844441db689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:17.507381 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-1550c41e-e968-4902-88ca-2844441db689 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:49:17.508621 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-1550c41e-e968-4902-88ca-2844441db689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:17.533818 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:49:17.538903 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b95d0f-5caa-494c-a794-2e66af4de2ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:17.542546 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b95d0f-5caa-494c-a794-2e66af4de2ba admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:17.542546 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b95d0f-5caa-494c-a794-2e66af4de2ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:17.542546 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b95d0f-5caa-494c-a794-2e66af4de2ba admin admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:17.542546 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b95d0f-5caa-494c-a794-2e66af4de2ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:49:17.542546 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b95d0f-5caa-494c-a794-2e66af4de2ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:17.543098 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b95d0f-5caa-494c-a794-2e66af4de2ba admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:17.554855 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 785/1564] 10.222.0.15 () {58 vars in 1152 bytes} [Tue May 31 14:49:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:49:17.556091 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c1435f-7dd9-4aa4-95ea-a007cf96c4e2 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:17.556378 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c1435f-7dd9-4aa4-95ea-a007cf96c4e2 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:17.556652 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c1435f-7dd9-4aa4-95ea-a007cf96c4e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:17.573691 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 780/1565] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:49:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:49:17.574534 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1550c41e-e968-4902-88ca-2844441db689 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:17.574941 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-64c1435f-7dd9-4aa4-95ea-a007cf96c4e2 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:49:17.576319 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-64c1435f-7dd9-4aa4-95ea-a007cf96c4e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:17.584034 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1550c41e-e968-4902-88ca-2844441db689 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:17.588586 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 786/1566] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:49:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:49:17.588586 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c1435f-7dd9-4aa4-95ea-a007cf96c4e2 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:17.589861 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1708364-c7c7-41d4-ab65-ddd7642e46b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:17.591502 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1708364-c7c7-41d4-ab65-ddd7642e46b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:17.591883 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1708364-c7c7-41d4-ab65-ddd7642e46b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:17.592018 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1708364-c7c7-41d4-ab65-ddd7642e46b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:17.592721 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1708364-c7c7-41d4-ab65-ddd7642e46b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:49:17.593030 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1708364-c7c7-41d4-ab65-ddd7642e46b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:17.594702 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1708364-c7c7-41d4-ab65-ddd7642e46b3 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:17.596657 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c1435f-7dd9-4aa4-95ea-a007cf96c4e2 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:17.601661 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef643a49-2fa0-4737-8cf9-8a1153860eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:17.601975 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef643a49-2fa0-4737-8cf9-8a1153860eae admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:17.602259 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef643a49-2fa0-4737-8cf9-8a1153860eae admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:17.602535 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef643a49-2fa0-4737-8cf9-8a1153860eae admin admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:17.603247 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef643a49-2fa0-4737-8cf9-8a1153860eae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:17.605252 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef643a49-2fa0-4737-8cf9-8a1153860eae admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:17.608153 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 781/1567] 10.222.0.15 () {58 vars in 1152 bytes} [Tue May 31 14:49:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:49:17.608153 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1708364-c7c7-41d4-ab65-ddd7642e46b3 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:17.617894 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1708364-c7c7-41d4-ab65-ddd7642e46b3 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:17.623336 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c98d4c-51a8-410c-afec-297c992e9886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:17.623996 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c98d4c-51a8-410c-afec-297c992e9886 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:17.624285 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c98d4c-51a8-410c-afec-297c992e9886 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:17.624565 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c98d4c-51a8-410c-afec-297c992e9886 admin admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:17.625317 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c98d4c-51a8-410c-afec-297c992e9886 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:17.626481 dv-cinder-839793-14-smb devstack@keystone.service[80502]: WARNING py.warnings [None req-99c98d4c-51a8-410c-afec-297c992e9886 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 31 14:49:17.626481 dv-cinder-839793-14-smb devstack@keystone.service[80502]: warnings.warn(msg) May 31 14:49:17.626481 dv-cinder-839793-14-smb devstack@keystone.service[80502]: May 31 14:49:17.632484 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c98d4c-51a8-410c-afec-297c992e9886 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:17.737656 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 787/1568] 10.222.0.15 () {60 vars in 1143 bytes} [Tue May 31 14:49:17 2022] POST /identity/v3/users => generated 290 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:49:17.738487 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef643a49-2fa0-4737-8cf9-8a1153860eae admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:17.747978 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef643a49-2fa0-4737-8cf9-8a1153860eae admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:17.752413 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41b89f2-e886-440c-83c9-42c74092e68e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:17.753031 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b89f2-e886-440c-83c9-42c74092e68e admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:17.753313 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b89f2-e886-440c-83c9-42c74092e68e admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:17.753587 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b89f2-e886-440c-83c9-42c74092e68e admin admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:17.754289 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41b89f2-e886-440c-83c9-42c74092e68e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:49:17.754617 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41b89f2-e886-440c-83c9-42c74092e68e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:17.756364 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41b89f2-e886-440c-83c9-42c74092e68e admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:17.768964 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 788/1569] 10.222.0.15 () {58 vars in 1152 bytes} [Tue May 31 14:49:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:49:17.770299 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c302a7-d4ab-413c-8ace-dfd8ce1e9b6f None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:17.770614 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c302a7-d4ab-413c-8ace-dfd8ce1e9b6f None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:17.770896 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c302a7-d4ab-413c-8ace-dfd8ce1e9b6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:17.776324 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 782/1570] 10.222.0.15 () {60 vars in 1143 bytes} [Tue May 31 14:49:17 2022] POST /identity/v3/users => generated 302 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:49:17.776324 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c98d4c-51a8-410c-afec-297c992e9886 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:17.786037 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c98d4c-51a8-410c-afec-297c992e9886 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:17.790953 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94345647-cc71-4269-9407-fb66f4917d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:17.791116 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-19c302a7-d4ab-413c-8ace-dfd8ce1e9b6f None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:49:17.791613 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94345647-cc71-4269-9407-fb66f4917d34 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:17.791901 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94345647-cc71-4269-9407-fb66f4917d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:17.792181 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94345647-cc71-4269-9407-fb66f4917d34 admin admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:17.792287 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-19c302a7-d4ab-413c-8ace-dfd8ce1e9b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:17.792874 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94345647-cc71-4269-9407-fb66f4917d34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:17.795184 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94345647-cc71-4269-9407-fb66f4917d34 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:17.801775 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 789/1571] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:49:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:49:17.801775 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c302a7-d4ab-413c-8ace-dfd8ce1e9b6f None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:17.812074 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c302a7-d4ab-413c-8ace-dfd8ce1e9b6f None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:17.816676 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19699d25-4f59-42df-a256-a4fc99559ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:17.817310 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19699d25-4f59-42df-a256-a4fc99559ad2 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:17.817594 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19699d25-4f59-42df-a256-a4fc99559ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:17.817871 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19699d25-4f59-42df-a256-a4fc99559ad2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:17.818620 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19699d25-4f59-42df-a256-a4fc99559ad2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:49:17.818932 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19699d25-4f59-42df-a256-a4fc99559ad2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:17.820549 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19699d25-4f59-42df-a256-a4fc99559ad2 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:17.832606 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 790/1572] 10.222.0.15 () {58 vars in 1152 bytes} [Tue May 31 14:49:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:49:17.833389 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19699d25-4f59-42df-a256-a4fc99559ad2 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:17.843131 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19699d25-4f59-42df-a256-a4fc99559ad2 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:17.847748 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556b05f4-0c50-4597-addd-d3e4f07133e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:17.848366 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556b05f4-0c50-4597-addd-d3e4f07133e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:17.848652 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556b05f4-0c50-4597-addd-d3e4f07133e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:17.848933 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556b05f4-0c50-4597-addd-d3e4f07133e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:17.849633 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556b05f4-0c50-4597-addd-d3e4f07133e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:49:17.849940 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556b05f4-0c50-4597-addd-d3e4f07133e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:17.851521 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556b05f4-0c50-4597-addd-d3e4f07133e1 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:17.863294 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 791/1573] 10.222.0.15 () {58 vars in 1152 bytes} [Tue May 31 14:49:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:49:17.864036 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556b05f4-0c50-4597-addd-d3e4f07133e1 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:17.873589 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556b05f4-0c50-4597-addd-d3e4f07133e1 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:17.878653 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c049ed-308f-4b10-805f-b090b402f3f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:17.879258 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c049ed-308f-4b10-805f-b090b402f3f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:17.879758 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c049ed-308f-4b10-805f-b090b402f3f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:17.880047 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c049ed-308f-4b10-805f-b090b402f3f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:17.880828 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c049ed-308f-4b10-805f-b090b402f3f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:17.885310 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 783/1574] 10.222.0.15 () {60 vars in 1152 bytes} [Tue May 31 14:49:17 2022] POST /identity/v3/projects => generated 363 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:49:17.885448 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c049ed-308f-4b10-805f-b090b402f3f9 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:17.885559 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94345647-cc71-4269-9407-fb66f4917d34 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:17.945457 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94345647-cc71-4269-9407-fb66f4917d34 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:17.950660 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fc331e-b9b5-4b2f-bec5-010ebeee421a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:17.951320 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fc331e-b9b5-4b2f-bec5-010ebeee421a admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:17.951602 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fc331e-b9b5-4b2f-bec5-010ebeee421a admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:17.951872 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fc331e-b9b5-4b2f-bec5-010ebeee421a admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:17.952584 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fc331e-b9b5-4b2f-bec5-010ebeee421a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:17.954205 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fc331e-b9b5-4b2f-bec5-010ebeee421a admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:17.963886 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 784/1575] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:49:17 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:49:17.964675 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fc331e-b9b5-4b2f-bec5-010ebeee421a admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:17.972133 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 792/1576] 10.222.0.15 () {60 vars in 1152 bytes} [Tue May 31 14:49:17 2022] POST /identity/v3/projects => generated 381 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:49:17.972950 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c049ed-308f-4b10-805f-b090b402f3f9 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:17.975365 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fc331e-b9b5-4b2f-bec5-010ebeee421a admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:18.026371 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:49:18.032311 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e7196a-b2ef-46bc-b663-a4f60896e1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:18.032983 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e7196a-b2ef-46bc-b663-a4f60896e1a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:18.033267 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e7196a-b2ef-46bc-b663-a4f60896e1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:18.033545 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e7196a-b2ef-46bc-b663-a4f60896e1a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:18.034313 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e7196a-b2ef-46bc-b663-a4f60896e1a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:18.035993 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e7196a-b2ef-46bc-b663-a4f60896e1a8 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:18.039851 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c049ed-308f-4b10-805f-b090b402f3f9 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:18.041805 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30c34b3-4b74-4bf6-8222-2643e35f176d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:18.042455 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c34b3-4b74-4bf6-8222-2643e35f176d admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:18.042772 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c34b3-4b74-4bf6-8222-2643e35f176d admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:18.043047 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c34b3-4b74-4bf6-8222-2643e35f176d admin admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:18.043754 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30c34b3-4b74-4bf6-8222-2643e35f176d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:18.045977 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30c34b3-4b74-4bf6-8222-2643e35f176d admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:18.046261 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 785/1577] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:49:17 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:49:18.047212 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e7196a-b2ef-46bc-b663-a4f60896e1a8 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:18.050444 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-25e7196a-b2ef-46bc-b663-a4f60896e1a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:18.061277 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:49:18.106122 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e7196a-b2ef-46bc-b663-a4f60896e1a8 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:18.110347 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77623cec-d071-4102-96b6-4d8b5860ab7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:18.111009 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77623cec-d071-4102-96b6-4d8b5860ab7a service neutron] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:18.111293 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77623cec-d071-4102-96b6-4d8b5860ab7a service neutron] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:18.111567 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77623cec-d071-4102-96b6-4d8b5860ab7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:18.120442 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77623cec-d071-4102-96b6-4d8b5860ab7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:18.121835 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 793/1578] 10.222.0.15 () {60 vars in 1152 bytes} [Tue May 31 14:49:17 2022] POST /identity/v3/projects => generated 387 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:49:18.122069 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77623cec-d071-4102-96b6-4d8b5860ab7a service neutron] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:18.122730 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30c34b3-4b74-4bf6-8222-2643e35f176d admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:18.132336 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 786/1579] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:49:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:49:18.133172 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77623cec-d071-4102-96b6-4d8b5860ab7a service neutron] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:18.142079 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77623cec-d071-4102-96b6-4d8b5860ab7a service neutron] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:18.195374 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30c34b3-4b74-4bf6-8222-2643e35f176d admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:18.200142 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699c5a59-ff1c-4af2-b827-24d4ac4dbbc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:18.200800 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699c5a59-ff1c-4af2-b827-24d4ac4dbbc3 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:18.201084 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699c5a59-ff1c-4af2-b827-24d4ac4dbbc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:18.201364 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699c5a59-ff1c-4af2-b827-24d4ac4dbbc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:18.202053 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699c5a59-ff1c-4af2-b827-24d4ac4dbbc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:18.202188 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9e0e2a-bec0-4b13-ac48-c5e26ae43eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:18.202947 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e0e2a-bec0-4b13-ac48-c5e26ae43eb4 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:18.203229 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e0e2a-bec0-4b13-ac48-c5e26ae43eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:18.203534 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e0e2a-bec0-4b13-ac48-c5e26ae43eb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:18.204001 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699c5a59-ff1c-4af2-b827-24d4ac4dbbc3 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:18.204208 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9e0e2a-bec0-4b13-ac48-c5e26ae43eb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:18.206127 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9e0e2a-bec0-4b13-ac48-c5e26ae43eb4 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:18.328166 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 794/1580] 10.222.0.15 () {60 vars in 1152 bytes} [Tue May 31 14:49:18 2022] POST /identity/v3/projects => generated 393 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:49:18.330250 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699c5a59-ff1c-4af2-b827-24d4ac4dbbc3 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:18.358409 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 787/1581] 10.222.0.15 () {60 vars in 1152 bytes} [Tue May 31 14:49:18 2022] POST /identity/v3/projects => generated 373 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:49:18.358409 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9e0e2a-bec0-4b13-ac48-c5e26ae43eb4 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:18.394832 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699c5a59-ff1c-4af2-b827-24d4ac4dbbc3 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:18.420717 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9e0e2a-bec0-4b13-ac48-c5e26ae43eb4 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:18.425334 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c606a002-8059-492b-8bba-4b9eb6720a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:18.426002 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c606a002-8059-492b-8bba-4b9eb6720a1e admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:18.426284 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c606a002-8059-492b-8bba-4b9eb6720a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:18.426575 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c606a002-8059-492b-8bba-4b9eb6720a1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:18.427315 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c606a002-8059-492b-8bba-4b9eb6720a1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:18.428940 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c606a002-8059-492b-8bba-4b9eb6720a1e admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:18.439241 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 788/1582] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:49:18 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:49:18.439882 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c606a002-8059-492b-8bba-4b9eb6720a1e admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:18.449345 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c606a002-8059-492b-8bba-4b9eb6720a1e admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:18.454858 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad84847-f2f4-4086-96b3-72a552910c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:18.455526 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad84847-f2f4-4086-96b3-72a552910c1e admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:18.455807 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad84847-f2f4-4086-96b3-72a552910c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:18.456090 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad84847-f2f4-4086-96b3-72a552910c1e admin admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:18.456781 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad84847-f2f4-4086-96b3-72a552910c1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:18.458987 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad84847-f2f4-4086-96b3-72a552910c1e admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:18.464581 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03864fee-b4b5-47e2-be5c-da965a8a672f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:18.467203 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03864fee-b4b5-47e2-be5c-da965a8a672f admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:18.467929 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03864fee-b4b5-47e2-be5c-da965a8a672f admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:18.468405 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03864fee-b4b5-47e2-be5c-da965a8a672f admin admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:18.469317 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03864fee-b4b5-47e2-be5c-da965a8a672f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:18.471738 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03864fee-b4b5-47e2-be5c-da965a8a672f admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:18.556314 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 789/1583] 10.222.0.15 () {60 vars in 1143 bytes} [Tue May 31 14:49:18 2022] POST /identity/v3/users => generated 291 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:49:18.557798 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad84847-f2f4-4086-96b3-72a552910c1e admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:18.567285 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad84847-f2f4-4086-96b3-72a552910c1e admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:18.572028 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af41726-225d-4de9-8097-a59085e1b6a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:18.572686 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af41726-225d-4de9-8097-a59085e1b6a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:18.572975 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af41726-225d-4de9-8097-a59085e1b6a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:18.573256 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af41726-225d-4de9-8097-a59085e1b6a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:18.573973 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af41726-225d-4de9-8097-a59085e1b6a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:18.576230 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af41726-225d-4de9-8097-a59085e1b6a9 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:18.586721 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 790/1584] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:49:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:49:18.587483 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af41726-225d-4de9-8097-a59085e1b6a9 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:18.594238 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:49:18.597739 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af41726-225d-4de9-8097-a59085e1b6a9 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:18.602337 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d11e4a-c4e3-4e61-bea8-85587bbe3526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:18.602991 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d11e4a-c4e3-4e61-bea8-85587bbe3526 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:18.603272 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d11e4a-c4e3-4e61-bea8-85587bbe3526 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:18.603649 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d11e4a-c4e3-4e61-bea8-85587bbe3526 admin admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:18.604313 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d11e4a-c4e3-4e61-bea8-85587bbe3526 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:18.606913 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d11e4a-c4e3-4e61-bea8-85587bbe3526 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:18.608757 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:49:18.614106 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 795/1585] 10.222.0.15 () {60 vars in 1143 bytes} [Tue May 31 14:49:18 2022] POST /identity/v3/users => generated 282 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:49:18.615120 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03864fee-b4b5-47e2-be5c-da965a8a672f admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:18.626204 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03864fee-b4b5-47e2-be5c-da965a8a672f admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:18.630933 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b4f51d-c9e2-4cd2-8362-5dc59e09aaa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:18.631581 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b4f51d-c9e2-4cd2-8362-5dc59e09aaa0 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:18.631866 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b4f51d-c9e2-4cd2-8362-5dc59e09aaa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:18.632140 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b4f51d-c9e2-4cd2-8362-5dc59e09aaa0 admin admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:18.632814 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b4f51d-c9e2-4cd2-8362-5dc59e09aaa0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:18.634782 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b4f51d-c9e2-4cd2-8362-5dc59e09aaa0 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:18.734738 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 791/1586] 10.222.0.15 () {60 vars in 1143 bytes} [Tue May 31 14:49:18 2022] POST /identity/v3/users => generated 294 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:49:18.735825 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d11e4a-c4e3-4e61-bea8-85587bbe3526 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:18.748075 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d11e4a-c4e3-4e61-bea8-85587bbe3526 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:18.753395 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e9f0cd-7586-4871-b668-12ba6fe2c5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:18.754403 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e9f0cd-7586-4871-b668-12ba6fe2c5bf admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:18.754888 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e9f0cd-7586-4871-b668-12ba6fe2c5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:18.755315 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e9f0cd-7586-4871-b668-12ba6fe2c5bf admin admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:18.757811 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e9f0cd-7586-4871-b668-12ba6fe2c5bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:18.761431 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e9f0cd-7586-4871-b668-12ba6fe2c5bf admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:18.769949 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 796/1587] 10.222.0.15 () {60 vars in 1143 bytes} [Tue May 31 14:49:18 2022] POST /identity/v3/users => generated 297 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:49:18.771452 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b4f51d-c9e2-4cd2-8362-5dc59e09aaa0 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:18.786741 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b4f51d-c9e2-4cd2-8362-5dc59e09aaa0 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:18.793034 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78934f78-10a8-4153-90a7-ad8aecf5ed88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:18.795173 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78934f78-10a8-4153-90a7-ad8aecf5ed88 admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:18.795520 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78934f78-10a8-4153-90a7-ad8aecf5ed88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:18.796694 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78934f78-10a8-4153-90a7-ad8aecf5ed88 admin admin] PATH_INFO: `/v3/projects/d1e1ac97164c4da8a2b08f8411456401/users/c7b4644c7fb74ed88c83d348a32c015c/roles/317f725e26bf43648d8235bb1f7c4cb3` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:18.817608 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78934f78-10a8-4153-90a7-ad8aecf5ed88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1e1ac97164c4da8a2b08f8411456401, user_id=c7b4644c7fb74ed88c83d348a32c015c, role_id=317f725e26bf43648d8235bb1f7c4cb3)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:18.818704 dv-cinder-839793-14-smb devstack@keystone.service[80503]: WARNING py.warnings [None req-78934f78-10a8-4153-90a7-ad8aecf5ed88 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 31 14:49:18.818704 dv-cinder-839793-14-smb devstack@keystone.service[80503]: warnings.warn(msg) May 31 14:49:18.818704 dv-cinder-839793-14-smb devstack@keystone.service[80503]: May 31 14:49:18.820690 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78934f78-10a8-4153-90a7-ad8aecf5ed88 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:18.877378 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 792/1588] 10.222.0.15 () {60 vars in 1143 bytes} [Tue May 31 14:49:18 2022] POST /identity/v3/users => generated 287 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:49:18.878265 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e9f0cd-7586-4871-b668-12ba6fe2c5bf admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:18.889599 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e9f0cd-7586-4871-b668-12ba6fe2c5bf admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:18.896172 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3010f9-27d5-488f-af54-89912e18cd6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:18.896750 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3010f9-27d5-488f-af54-89912e18cd6f admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:18.897043 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3010f9-27d5-488f-af54-89912e18cd6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:18.897315 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3010f9-27d5-488f-af54-89912e18cd6f admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:18.898057 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3010f9-27d5-488f-af54-89912e18cd6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:18.899765 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3010f9-27d5-488f-af54-89912e18cd6f admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:18.900684 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 797/1589] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:49:18 2022] PUT /identity/v3/projects/d1e1ac97164c4da8a2b08f8411456401/users/c7b4644c7fb74ed88c83d348a32c015c/roles/317f725e26bf43648d8235bb1f7c4cb3 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:49:18.904646 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78934f78-10a8-4153-90a7-ad8aecf5ed88 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:18.915819 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 793/1590] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:49:18 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:49:18.915819 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3010f9-27d5-488f-af54-89912e18cd6f admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:18.926512 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3010f9-27d5-488f-af54-89912e18cd6f admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:18.973027 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78934f78-10a8-4153-90a7-ad8aecf5ed88 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:18.979237 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb393bf-b825-439b-aaf9-0ae658ed7a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:18.980180 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb393bf-b825-439b-aaf9-0ae658ed7a48 admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:18.980464 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb393bf-b825-439b-aaf9-0ae658ed7a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:18.980749 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb393bf-b825-439b-aaf9-0ae658ed7a48 admin admin] PATH_INFO: `/v3/projects/0cf02eb3ab3844fba9b24195be70892c/users/b1cb585384884aa58a6afe2269280d5c/roles/317f725e26bf43648d8235bb1f7c4cb3` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:18.986680 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41758222-323b-4f62-82a1-1c77c6c0d60a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:18.987423 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41758222-323b-4f62-82a1-1c77c6c0d60a admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:18.987777 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41758222-323b-4f62-82a1-1c77c6c0d60a admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:18.988122 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41758222-323b-4f62-82a1-1c77c6c0d60a admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:18.988911 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41758222-323b-4f62-82a1-1c77c6c0d60a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:18.990635 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41758222-323b-4f62-82a1-1c77c6c0d60a admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:18.997877 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb393bf-b825-439b-aaf9-0ae658ed7a48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cf02eb3ab3844fba9b24195be70892c, user_id=b1cb585384884aa58a6afe2269280d5c, role_id=317f725e26bf43648d8235bb1f7c4cb3)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:19.000566 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb393bf-b825-439b-aaf9-0ae658ed7a48 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:19.001214 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 794/1591] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:49:18 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:49:19.002029 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41758222-323b-4f62-82a1-1c77c6c0d60a admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:19.011969 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41758222-323b-4f62-82a1-1c77c6c0d60a admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:19.017528 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1080b07c-700c-4202-9389-cb25574a92e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:19.017528 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1080b07c-700c-4202-9389-cb25574a92e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:19.017770 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1080b07c-700c-4202-9389-cb25574a92e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:19.018020 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1080b07c-700c-4202-9389-cb25574a92e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:19.018768 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1080b07c-700c-4202-9389-cb25574a92e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:19.020391 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1080b07c-700c-4202-9389-cb25574a92e2 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:19.031292 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 795/1592] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:49:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:49:19.032108 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1080b07c-700c-4202-9389-cb25574a92e2 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:19.041976 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1080b07c-700c-4202-9389-cb25574a92e2 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:19.047341 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b51d736-32aa-4432-b062-54fe72542b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:19.050263 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b51d736-32aa-4432-b062-54fe72542b89 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:19.050263 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b51d736-32aa-4432-b062-54fe72542b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:19.050263 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b51d736-32aa-4432-b062-54fe72542b89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:19.050263 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b51d736-32aa-4432-b062-54fe72542b89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:19.050930 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b51d736-32aa-4432-b062-54fe72542b89 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:19.061389 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 796/1593] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:49:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:49:19.062348 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b51d736-32aa-4432-b062-54fe72542b89 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:19.072692 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b51d736-32aa-4432-b062-54fe72542b89 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:19.077267 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b08e1e-7a35-410e-8f2a-edb63b5d8a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:19.079013 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b08e1e-7a35-410e-8f2a-edb63b5d8a6c admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:19.079013 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b08e1e-7a35-410e-8f2a-edb63b5d8a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:19.079013 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b08e1e-7a35-410e-8f2a-edb63b5d8a6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:19.079505 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b08e1e-7a35-410e-8f2a-edb63b5d8a6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:19.081080 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b08e1e-7a35-410e-8f2a-edb63b5d8a6c admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:19.092112 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 797/1594] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:49:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:49:19.093292 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415aad87-d8c2-4224-b6f3-5a1e9f172d8a None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:19.093584 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415aad87-d8c2-4224-b6f3-5a1e9f172d8a None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:19.094098 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415aad87-d8c2-4224-b6f3-5a1e9f172d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:19.108047 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 798/1595] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:49:18 2022] PUT /identity/v3/projects/0cf02eb3ab3844fba9b24195be70892c/users/b1cb585384884aa58a6afe2269280d5c/roles/317f725e26bf43648d8235bb1f7c4cb3 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:49:19.116379 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb393bf-b825-439b-aaf9-0ae658ed7a48 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:19.116528 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-415aad87-d8c2-4224-b6f3-5a1e9f172d8a None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:49:19.116528 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-415aad87-d8c2-4224-b6f3-5a1e9f172d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:19.176744 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb393bf-b825-439b-aaf9-0ae658ed7a48 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:19.178897 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 798/1596] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:49:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:49:19.179940 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415aad87-d8c2-4224-b6f3-5a1e9f172d8a None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:19.181762 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dbfd00-4142-4818-8941-12d8526ff9d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:19.182606 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dbfd00-4142-4818-8941-12d8526ff9d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:19.182858 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dbfd00-4142-4818-8941-12d8526ff9d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:19.183140 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dbfd00-4142-4818-8941-12d8526ff9d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:19.183873 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dbfd00-4142-4818-8941-12d8526ff9d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:19.185511 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dbfd00-4142-4818-8941-12d8526ff9d0 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:19.193586 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415aad87-d8c2-4224-b6f3-5a1e9f172d8a None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:19.199327 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 799/1597] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:49:19 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:49:19.199327 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dbfd00-4142-4818-8941-12d8526ff9d0 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:19.201969 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f62390-bffd-49e7-9b9e-6f0d31a5dd8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:19.202735 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f62390-bffd-49e7-9b9e-6f0d31a5dd8d admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:19.206813 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f62390-bffd-49e7-9b9e-6f0d31a5dd8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:19.206813 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f62390-bffd-49e7-9b9e-6f0d31a5dd8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:19.206813 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f62390-bffd-49e7-9b9e-6f0d31a5dd8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:19.206813 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f62390-bffd-49e7-9b9e-6f0d31a5dd8d admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:19.208643 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dbfd00-4142-4818-8941-12d8526ff9d0 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:19.213529 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba08844c-2927-4270-927d-1a193012e703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:19.214261 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba08844c-2927-4270-927d-1a193012e703 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:19.214652 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba08844c-2927-4270-927d-1a193012e703 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:19.215003 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba08844c-2927-4270-927d-1a193012e703 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:19.216354 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba08844c-2927-4270-927d-1a193012e703 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:19.217475 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 799/1598] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:49:19 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:49:19.218408 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba08844c-2927-4270-927d-1a193012e703 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:19.221174 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f62390-bffd-49e7-9b9e-6f0d31a5dd8d admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:19.232536 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 800/1599] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:49:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:49:19.232536 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba08844c-2927-4270-927d-1a193012e703 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:19.232824 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f62390-bffd-49e7-9b9e-6f0d31a5dd8d admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:19.237203 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f06cc97-7b6b-43fb-9d42-83f9039affc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:19.237976 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f06cc97-7b6b-43fb-9d42-83f9039affc4 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:19.238336 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f06cc97-7b6b-43fb-9d42-83f9039affc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:19.238709 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f06cc97-7b6b-43fb-9d42-83f9039affc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:19.239550 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f06cc97-7b6b-43fb-9d42-83f9039affc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:19.241205 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f06cc97-7b6b-43fb-9d42-83f9039affc4 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:19.243273 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba08844c-2927-4270-927d-1a193012e703 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:19.247072 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:49:19.249269 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97149c2e-cdbe-4e3f-a42a-451b46f56cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:19.250012 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97149c2e-cdbe-4e3f-a42a-451b46f56cc5 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:19.250373 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97149c2e-cdbe-4e3f-a42a-451b46f56cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:19.250748 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97149c2e-cdbe-4e3f-a42a-451b46f56cc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:19.251549 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97149c2e-cdbe-4e3f-a42a-451b46f56cc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:19.252334 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 800/1600] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:49:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:49:19.253640 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36be968-426a-460a-9795-a580285797bd None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:19.253902 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36be968-426a-460a-9795-a580285797bd None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:19.254200 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36be968-426a-460a-9795-a580285797bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:19.254687 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97149c2e-cdbe-4e3f-a42a-451b46f56cc5 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:19.272495 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-e36be968-426a-460a-9795-a580285797bd None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:49:19.273801 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-e36be968-426a-460a-9795-a580285797bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:19.275615 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 801/1601] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:49:19 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:49:19.276656 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97149c2e-cdbe-4e3f-a42a-451b46f56cc5 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:19.286926 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 801/1602] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:49:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:49:19.287765 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36be968-426a-460a-9795-a580285797bd None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:19.301496 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36be968-426a-460a-9795-a580285797bd None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:19.303609 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:49:19.307600 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c85bfd9-14b9-407e-9a9c-6b06ce806c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:19.308548 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c85bfd9-14b9-407e-9a9c-6b06ce806c26 admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:19.309143 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c85bfd9-14b9-407e-9a9c-6b06ce806c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:19.309143 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c85bfd9-14b9-407e-9a9c-6b06ce806c26 admin admin] PATH_INFO: `/v3/projects/dd5f72540cf645cda209062bf9d1e875/users/5ceaec2573d747deaa5f2f074854b35d/roles/317f725e26bf43648d8235bb1f7c4cb3` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:19.324552 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c85bfd9-14b9-407e-9a9c-6b06ce806c26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd5f72540cf645cda209062bf9d1e875, user_id=5ceaec2573d747deaa5f2f074854b35d, role_id=317f725e26bf43648d8235bb1f7c4cb3)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:19.327890 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c85bfd9-14b9-407e-9a9c-6b06ce806c26 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:19.343661 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97149c2e-cdbe-4e3f-a42a-451b46f56cc5 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:19.347234 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4553665-2c0b-4da3-b47b-1beeea1f5f80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:19.347870 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4553665-2c0b-4da3-b47b-1beeea1f5f80 service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:19.348150 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4553665-2c0b-4da3-b47b-1beeea1f5f80 service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:19.348425 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4553665-2c0b-4da3-b47b-1beeea1f5f80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:19.357303 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4553665-2c0b-4da3-b47b-1beeea1f5f80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:19.358745 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4553665-2c0b-4da3-b47b-1beeea1f5f80 service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:19.368034 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 802/1603] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:49:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:49:19.368785 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4553665-2c0b-4da3-b47b-1beeea1f5f80 service neutron] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:19.377538 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4553665-2c0b-4da3-b47b-1beeea1f5f80 service neutron] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:19.382448 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aac64e1-05e3-42cb-8242-d18c7c8c11cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:19.383343 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aac64e1-05e3-42cb-8242-d18c7c8c11cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:19.383956 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aac64e1-05e3-42cb-8242-d18c7c8c11cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:19.383956 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aac64e1-05e3-42cb-8242-d18c7c8c11cd admin admin] PATH_INFO: `/v3/projects/a5b9dae5a65c497d9dc4e6ba2bafe501/users/a6860138191e4623988309aeeb60ce07/roles/317f725e26bf43648d8235bb1f7c4cb3` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:19.398977 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aac64e1-05e3-42cb-8242-d18c7c8c11cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5b9dae5a65c497d9dc4e6ba2bafe501, user_id=a6860138191e4623988309aeeb60ce07, role_id=317f725e26bf43648d8235bb1f7c4cb3)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:19.401676 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aac64e1-05e3-42cb-8242-d18c7c8c11cd admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:19.441255 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 802/1604] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:49:19 2022] PUT /identity/v3/projects/dd5f72540cf645cda209062bf9d1e875/users/5ceaec2573d747deaa5f2f074854b35d/roles/317f725e26bf43648d8235bb1f7c4cb3 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:49:19.442140 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c85bfd9-14b9-407e-9a9c-6b06ce806c26 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:19.499699 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 803/1605] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:49:19 2022] PUT /identity/v3/projects/a5b9dae5a65c497d9dc4e6ba2bafe501/users/a6860138191e4623988309aeeb60ce07/roles/317f725e26bf43648d8235bb1f7c4cb3 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:49:19.502497 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aac64e1-05e3-42cb-8242-d18c7c8c11cd admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:19.516687 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c85bfd9-14b9-407e-9a9c-6b06ce806c26 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:19.584113 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d986fd52-c4e9-44e8-b5ce-454f702872d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:19.585115 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d986fd52-c4e9-44e8-b5ce-454f702872d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:19.590519 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d986fd52-c4e9-44e8-b5ce-454f702872d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:19.590519 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d986fd52-c4e9-44e8-b5ce-454f702872d3 admin admin] PATH_INFO: `/v3/projects/0503c5c3583140358334771a93bf9572/users/3ba53ede9ae9426f9f89c885aea9e32e/roles/317f725e26bf43648d8235bb1f7c4cb3` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:19.603830 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d986fd52-c4e9-44e8-b5ce-454f702872d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0503c5c3583140358334771a93bf9572, user_id=3ba53ede9ae9426f9f89c885aea9e32e, role_id=317f725e26bf43648d8235bb1f7c4cb3)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:19.606595 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d986fd52-c4e9-44e8-b5ce-454f702872d3 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:19.628576 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aac64e1-05e3-42cb-8242-d18c7c8c11cd admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:19.633873 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5875979-1d1d-43a0-bc32-eca182db6c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:19.635063 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5875979-1d1d-43a0-bc32-eca182db6c60 admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:19.635496 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5875979-1d1d-43a0-bc32-eca182db6c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:19.635953 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5875979-1d1d-43a0-bc32-eca182db6c60 admin admin] PATH_INFO: `/v3/projects/3b9a03a0a28c424cbf4a7592bbb35fe7/users/001117ac48b544f1adbc64f0acb988f7/roles/317f725e26bf43648d8235bb1f7c4cb3` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:19.656549 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5875979-1d1d-43a0-bc32-eca182db6c60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b9a03a0a28c424cbf4a7592bbb35fe7, user_id=001117ac48b544f1adbc64f0acb988f7, role_id=317f725e26bf43648d8235bb1f7c4cb3)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:19.659263 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5875979-1d1d-43a0-bc32-eca182db6c60 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:19.722332 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 803/1606] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:49:19 2022] PUT /identity/v3/projects/0503c5c3583140358334771a93bf9572/users/3ba53ede9ae9426f9f89c885aea9e32e/roles/317f725e26bf43648d8235bb1f7c4cb3 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:49:19.723583 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d986fd52-c4e9-44e8-b5ce-454f702872d3 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:19.751951 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 804/1607] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:49:19 2022] PUT /identity/v3/projects/3b9a03a0a28c424cbf4a7592bbb35fe7/users/001117ac48b544f1adbc64f0acb988f7/roles/317f725e26bf43648d8235bb1f7c4cb3 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:49:19.751951 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5875979-1d1d-43a0-bc32-eca182db6c60 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:19.845871 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5875979-1d1d-43a0-bc32-eca182db6c60 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:19.849734 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac51a81d-96ea-41a6-b4c7-589594aaa9e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:19.850467 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d986fd52-c4e9-44e8-b5ce-454f702872d3 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:19.850626 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac51a81d-96ea-41a6-b4c7-589594aaa9e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:19.851011 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac51a81d-96ea-41a6-b4c7-589594aaa9e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:19.851726 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac51a81d-96ea-41a6-b4c7-589594aaa9e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:19.854832 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:49:19.887479 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:49:19.923112 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac51a81d-96ea-41a6-b4c7-589594aaa9e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:19.924693 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac51a81d-96ea-41a6-b4c7-589594aaa9e5 service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:19.931529 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dcf47c-2050-44bf-ba91-d537c4ad3bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:19.932474 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dcf47c-2050-44bf-ba91-d537c4ad3bee admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:19.932762 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dcf47c-2050-44bf-ba91-d537c4ad3bee admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:19.938762 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dcf47c-2050-44bf-ba91-d537c4ad3bee admin admin] PATH_INFO: `/v3/projects/b05bd702841941728aaa8f41662658c2/users/13cc1d39a7474eb0a490e89d01b3e03d/roles/317f725e26bf43648d8235bb1f7c4cb3` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:19.938898 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 805/1608] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:49:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:49:19.938898 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c476a5-830a-4d91-af40-ba72439b41b6 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:19.938898 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c476a5-830a-4d91-af40-ba72439b41b6 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:19.938898 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c476a5-830a-4d91-af40-ba72439b41b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:19.958205 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dcf47c-2050-44bf-ba91-d537c4ad3bee admin admin] RBAC: Authorizing `identity:create_grant(project_id=b05bd702841941728aaa8f41662658c2, user_id=13cc1d39a7474eb0a490e89d01b3e03d, role_id=317f725e26bf43648d8235bb1f7c4cb3)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:19.961037 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dcf47c-2050-44bf-ba91-d537c4ad3bee admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:19.967598 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-01c476a5-830a-4d91-af40-ba72439b41b6 None None] MFA Rules not processed for user `5ceaec2573d747deaa5f2f074854b35d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:49:19.968707 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-01c476a5-830a-4d91-af40-ba72439b41b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:20.034214 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 806/1609] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:49:19 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:49:20.035664 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88631be-8fce-4fd3-8671-2207604f1529 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:20.035956 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88631be-8fce-4fd3-8671-2207604f1529 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:20.036234 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88631be-8fce-4fd3-8671-2207604f1529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:20.077147 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 804/1610] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:49:19 2022] PUT /identity/v3/projects/b05bd702841941728aaa8f41662658c2/users/13cc1d39a7474eb0a490e89d01b3e03d/roles/317f725e26bf43648d8235bb1f7c4cb3 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:49:20.078533 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ac7e79-0690-4cf3-92c7-ac634fdf6d19 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:20.078969 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ac7e79-0690-4cf3-92c7-ac634fdf6d19 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:20.079257 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ac7e79-0690-4cf3-92c7-ac634fdf6d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:20.098660 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-e88631be-8fce-4fd3-8671-2207604f1529 None None] MFA Rules not processed for user `a6860138191e4623988309aeeb60ce07`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:49:20.100039 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-e88631be-8fce-4fd3-8671-2207604f1529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:20.107395 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-51ac7e79-0690-4cf3-92c7-ac634fdf6d19 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:49:20.108995 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-51ac7e79-0690-4cf3-92c7-ac634fdf6d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:20.204892 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 807/1611] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:49:20 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:49:20.206510 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f51193-6b02-45d3-97e8-8ddbe229ee84 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:20.206834 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f51193-6b02-45d3-97e8-8ddbe229ee84 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:20.207157 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f51193-6b02-45d3-97e8-8ddbe229ee84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:20.212352 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 805/1612] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:49:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:49:20.214285 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ac7e79-0690-4cf3-92c7-ac634fdf6d19 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:20.229321 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ac7e79-0690-4cf3-92c7-ac634fdf6d19 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:20.235068 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63acf504-d8b8-4ef5-b457-442a0f01d9be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:20.240205 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63acf504-d8b8-4ef5-b457-442a0f01d9be admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:20.240347 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-10f51193-6b02-45d3-97e8-8ddbe229ee84 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:49:20.240613 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63acf504-d8b8-4ef5-b457-442a0f01d9be admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:20.240613 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63acf504-d8b8-4ef5-b457-442a0f01d9be admin admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:20.240613 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63acf504-d8b8-4ef5-b457-442a0f01d9be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:20.240853 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-10f51193-6b02-45d3-97e8-8ddbe229ee84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:20.240930 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63acf504-d8b8-4ef5-b457-442a0f01d9be admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:20.251200 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 808/1613] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:49:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:49:20.253463 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544ddcde-8969-47b6-9912-ebbe7684a24f None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:20.253756 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544ddcde-8969-47b6-9912-ebbe7684a24f None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:20.254040 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544ddcde-8969-47b6-9912-ebbe7684a24f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:20.291735 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-544ddcde-8969-47b6-9912-ebbe7684a24f None None] MFA Rules not processed for user `13cc1d39a7474eb0a490e89d01b3e03d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:49:20.292995 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-544ddcde-8969-47b6-9912-ebbe7684a24f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:20.337456 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:49:20.396331 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 806/1614] 10.222.0.15 () {60 vars in 1152 bytes} [Tue May 31 14:49:20 2022] POST /identity/v3/projects => generated 381 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:49:20.397607 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63acf504-d8b8-4ef5-b457-442a0f01d9be admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:20.406271 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 809/1615] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:49:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:49:20.408317 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544ddcde-8969-47b6-9912-ebbe7684a24f None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:20.484412 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63acf504-d8b8-4ef5-b457-442a0f01d9be admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:20.490437 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a23b81-651c-438c-b54a-3803755e36cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:20.491193 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a23b81-651c-438c-b54a-3803755e36cb admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:20.491491 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a23b81-651c-438c-b54a-3803755e36cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:20.491782 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a23b81-651c-438c-b54a-3803755e36cb admin admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:20.492488 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a23b81-651c-438c-b54a-3803755e36cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:20.493287 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544ddcde-8969-47b6-9912-ebbe7684a24f None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:20.494433 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a23b81-651c-438c-b54a-3803755e36cb admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:20.510453 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:49:20.554636 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78191d76-766c-47d0-98df-9a4df1ee73fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:20.555221 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78191d76-766c-47d0-98df-9a4df1ee73fe service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:20.559904 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78191d76-766c-47d0-98df-9a4df1ee73fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:20.559904 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78191d76-766c-47d0-98df-9a4df1ee73fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:20.570698 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78191d76-766c-47d0-98df-9a4df1ee73fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:20.572522 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78191d76-766c-47d0-98df-9a4df1ee73fe service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:20.592054 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 807/1616] 10.222.0.15 () {60 vars in 1152 bytes} [Tue May 31 14:49:20 2022] POST /identity/v3/projects => generated 365 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:49:20.593595 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a23b81-651c-438c-b54a-3803755e36cb admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:20.594720 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 810/1617] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:49:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:49:20.595554 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78191d76-766c-47d0-98df-9a4df1ee73fe service neutron] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:20.624920 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78191d76-766c-47d0-98df-9a4df1ee73fe service neutron] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:20.692446 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a23b81-651c-438c-b54a-3803755e36cb admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:20.697481 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe4f21b-5f77-4553-a9f6-3b14f8846a82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:20.698806 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe4f21b-5f77-4553-a9f6-3b14f8846a82 service neutron] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:20.698806 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe4f21b-5f77-4553-a9f6-3b14f8846a82 service neutron] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:20.698806 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe4f21b-5f77-4553-a9f6-3b14f8846a82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:20.735691 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8d4c4b-b8b3-4d9e-a3f6-4ff186a241b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:20.737233 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d4c4b-b8b3-4d9e-a3f6-4ff186a241b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:20.737705 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d4c4b-b8b3-4d9e-a3f6-4ff186a241b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:20.738135 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d4c4b-b8b3-4d9e-a3f6-4ff186a241b5 admin admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:20.739124 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8d4c4b-b8b3-4d9e-a3f6-4ff186a241b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:20.741707 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8d4c4b-b8b3-4d9e-a3f6-4ff186a241b5 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:20.802118 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe4f21b-5f77-4553-a9f6-3b14f8846a82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:20.803704 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe4f21b-5f77-4553-a9f6-3b14f8846a82 service neutron] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:20.815590 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 808/1618] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:49:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:49:20.817011 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149cbeba-367d-491e-9882-dcf1d7090ff3 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:20.817301 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149cbeba-367d-491e-9882-dcf1d7090ff3 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:20.817749 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149cbeba-367d-491e-9882-dcf1d7090ff3 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:20.819262 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 809/1619] 10.222.0.15 () {54 vars in 961 bytes} [Tue May 31 14:49:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:49:20.824514 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149cbeba-367d-491e-9882-dcf1d7090ff3 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:20.840168 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149cbeba-367d-491e-9882-dcf1d7090ff3 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:20.848476 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce663a1-0d69-4bd1-b481-f5737cbf7d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:20.849282 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce663a1-0d69-4bd1-b481-f5737cbf7d2a admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:20.849471 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce663a1-0d69-4bd1-b481-f5737cbf7d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:20.850348 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce663a1-0d69-4bd1-b481-f5737cbf7d2a admin admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:20.851117 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce663a1-0d69-4bd1-b481-f5737cbf7d2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:20.853285 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce663a1-0d69-4bd1-b481-f5737cbf7d2a admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:20.864979 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 811/1620] 10.222.0.15 () {60 vars in 1143 bytes} [Tue May 31 14:49:20 2022] POST /identity/v3/users => generated 297 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:49:20.867853 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60496992-993c-4f39-919e-aa546ccb2353 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:20.867853 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60496992-993c-4f39-919e-aa546ccb2353 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:20.867853 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60496992-993c-4f39-919e-aa546ccb2353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:20.909813 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-60496992-993c-4f39-919e-aa546ccb2353 None None] MFA Rules not processed for user `b57768d448e345ad8879bf29f21b48ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:49:20.949427 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-60496992-993c-4f39-919e-aa546ccb2353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:20.949427 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:49:20.989582 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 810/1621] 10.222.0.15 () {60 vars in 1143 bytes} [Tue May 31 14:49:20 2022] POST /identity/v3/users => generated 289 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:49:20.989582 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce663a1-0d69-4bd1-b481-f5737cbf7d2a admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:21.016227 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce663a1-0d69-4bd1-b481-f5737cbf7d2a admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:21.038884 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ea13bc-d63e-40de-a9cb-ad3416c0e8e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:21.039857 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ea13bc-d63e-40de-a9cb-ad3416c0e8e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:21.041086 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ea13bc-d63e-40de-a9cb-ad3416c0e8e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:21.041530 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ea13bc-d63e-40de-a9cb-ad3416c0e8e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:21.043189 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ea13bc-d63e-40de-a9cb-ad3416c0e8e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:21.048403 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ea13bc-d63e-40de-a9cb-ad3416c0e8e4 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:21.079787 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 811/1622] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:49:20 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:49:21.081756 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ea13bc-d63e-40de-a9cb-ad3416c0e8e4 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:21.088469 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 812/1623] 10.222.0.15 () {58 vars in 1058 bytes} [Tue May 31 14:49:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:49:21.089457 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60496992-993c-4f39-919e-aa546ccb2353 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:21.102352 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60496992-993c-4f39-919e-aa546ccb2353 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:21.108692 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5151339e-0678-4f68-996c-ea94327f4dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:21.109773 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5151339e-0678-4f68-996c-ea94327f4dd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:21.111904 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ea13bc-d63e-40de-a9cb-ad3416c0e8e4 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:21.112037 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5151339e-0678-4f68-996c-ea94327f4dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:21.112037 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5151339e-0678-4f68-996c-ea94327f4dd8 admin admin] PATH_INFO: `/v3/projects/71d5afdc917745e689994e2dcaffdf27/users/30dc38419578438f8f2ef53487062b98/roles/76c53e2c353644f885028a0226c06146` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:21.121949 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc584df2-342c-4529-a433-5d3d5f6e71c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:21.124083 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc584df2-342c-4529-a433-5d3d5f6e71c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:21.124446 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc584df2-342c-4529-a433-5d3d5f6e71c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:21.124830 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc584df2-342c-4529-a433-5d3d5f6e71c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:21.126505 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc584df2-342c-4529-a433-5d3d5f6e71c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:21.132378 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc584df2-342c-4529-a433-5d3d5f6e71c0 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:21.150377 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5151339e-0678-4f68-996c-ea94327f4dd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71d5afdc917745e689994e2dcaffdf27, user_id=30dc38419578438f8f2ef53487062b98, role_id=76c53e2c353644f885028a0226c06146)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:21.155256 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5151339e-0678-4f68-996c-ea94327f4dd8 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:21.160775 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 812/1624] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:49:21 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:49:21.163162 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc584df2-342c-4529-a433-5d3d5f6e71c0 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:21.207875 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc584df2-342c-4529-a433-5d3d5f6e71c0 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:21.219409 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf2f114-39df-48bf-9f6e-c8108216642c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57768d448e345ad8879bf29f21b48ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:21.220745 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf2f114-39df-48bf-9f6e-c8108216642c service nova] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:21.221455 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf2f114-39df-48bf-9f6e-c8108216642c service nova] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:21.227089 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf2f114-39df-48bf-9f6e-c8108216642c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:21.234234 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 813/1625] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:49:21 2022] PUT /identity/v3/projects/71d5afdc917745e689994e2dcaffdf27/users/30dc38419578438f8f2ef53487062b98/roles/76c53e2c353644f885028a0226c06146 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:49:21.236504 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5151339e-0678-4f68-996c-ea94327f4dd8 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:21.396487 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5151339e-0678-4f68-996c-ea94327f4dd8 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:21.406684 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528b4193-2b2a-4d1c-a932-2a969e572da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:21.408115 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b4193-2b2a-4d1c-a932-2a969e572da4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:21.408558 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b4193-2b2a-4d1c-a932-2a969e572da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:21.409026 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b4193-2b2a-4d1c-a932-2a969e572da4 admin admin] PATH_INFO: `/v3/projects/d3e472a34d5640b5bba50f922d498b18/users/035dc3777203453fbcc4d0021b6f794e/roles/76c53e2c353644f885028a0226c06146` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:21.420806 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf2f114-39df-48bf-9f6e-c8108216642c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:21.424660 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf2f114-39df-48bf-9f6e-c8108216642c service nova] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:21.444592 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528b4193-2b2a-4d1c-a932-2a969e572da4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3e472a34d5640b5bba50f922d498b18, user_id=035dc3777203453fbcc4d0021b6f794e, role_id=76c53e2c353644f885028a0226c06146)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:21.448534 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528b4193-2b2a-4d1c-a932-2a969e572da4 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:21.455377 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 813/1626] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:49:21 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:49:21.456343 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf2f114-39df-48bf-9f6e-c8108216642c service nova] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:21.462105 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:49:21.469832 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf2f114-39df-48bf-9f6e-c8108216642c service nova] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:21.476268 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b98f212-a98c-4d7c-955c-77d2d4915e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:21.477068 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b98f212-a98c-4d7c-955c-77d2d4915e90 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:21.477351 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b98f212-a98c-4d7c-955c-77d2d4915e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:21.477629 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b98f212-a98c-4d7c-955c-77d2d4915e90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:21.478467 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b98f212-a98c-4d7c-955c-77d2d4915e90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:21.480280 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b98f212-a98c-4d7c-955c-77d2d4915e90 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:21.492445 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 814/1627] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:49:21 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:49:21.493930 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59343e12-49b9-4c1f-87a3-b83b3ba1b4b8 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:21.494225 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59343e12-49b9-4c1f-87a3-b83b3ba1b4b8 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:21.494506 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59343e12-49b9-4c1f-87a3-b83b3ba1b4b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:21.535764 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-59343e12-49b9-4c1f-87a3-b83b3ba1b4b8 None None] MFA Rules not processed for user `c7b4644c7fb74ed88c83d348a32c015c`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:49:21.550944 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 814/1628] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:49:21 2022] PUT /identity/v3/projects/d3e472a34d5640b5bba50f922d498b18/users/035dc3777203453fbcc4d0021b6f794e/roles/76c53e2c353644f885028a0226c06146 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:49:21.552527 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528b4193-2b2a-4d1c-a932-2a969e572da4 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:21.557504 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-59343e12-49b9-4c1f-87a3-b83b3ba1b4b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:21.711732 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528b4193-2b2a-4d1c-a932-2a969e572da4 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:21.725161 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 815/1629] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:49:21 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:49:21.725161 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59343e12-49b9-4c1f-87a3-b83b3ba1b4b8 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:21.725940 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cece8c-2d48-4e0a-98bd-a3a7eec765dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:21.726462 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cece8c-2d48-4e0a-98bd-a3a7eec765dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:21.726888 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cece8c-2d48-4e0a-98bd-a3a7eec765dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:21.727276 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cece8c-2d48-4e0a-98bd-a3a7eec765dc admin admin] PATH_INFO: `/v3/projects/71d5afdc917745e689994e2dcaffdf27/users/30dc38419578438f8f2ef53487062b98/roles/76c53e2c353644f885028a0226c06146` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:21.730470 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cece8c-2d48-4e0a-98bd-a3a7eec765dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=71d5afdc917745e689994e2dcaffdf27, user_id=30dc38419578438f8f2ef53487062b98, role_id=76c53e2c353644f885028a0226c06146)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:21.733777 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cece8c-2d48-4e0a-98bd-a3a7eec765dc admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:21.737532 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59343e12-49b9-4c1f-87a3-b83b3ba1b4b8 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:21.748234 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642e637b-5fa6-4bb6-a29a-2207225955e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:21.749161 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642e637b-5fa6-4bb6-a29a-2207225955e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:21.760534 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642e637b-5fa6-4bb6-a29a-2207225955e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:21.760534 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642e637b-5fa6-4bb6-a29a-2207225955e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:21.760534 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642e637b-5fa6-4bb6-a29a-2207225955e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:21.761568 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 815/1630] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:49:21 2022] PUT /identity/v3/projects/71d5afdc917745e689994e2dcaffdf27/users/30dc38419578438f8f2ef53487062b98/roles/76c53e2c353644f885028a0226c06146 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:49:21.765095 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0139741-8f12-45a8-935b-63eb0e84edad None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:21.765682 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0139741-8f12-45a8-935b-63eb0e84edad None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:21.766207 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0139741-8f12-45a8-935b-63eb0e84edad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:21.769741 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642e637b-5fa6-4bb6-a29a-2207225955e7 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:21.789600 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-c0139741-8f12-45a8-935b-63eb0e84edad None None] MFA Rules not processed for user `c7b4644c7fb74ed88c83d348a32c015c`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:49:21.791969 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-c0139741-8f12-45a8-935b-63eb0e84edad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:21.792813 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 816/1631] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:49:21 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:49:21.798693 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d271b6b3-32d4-4879-9e67-88537b828374 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:21.799579 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d271b6b3-32d4-4879-9e67-88537b828374 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:21.799579 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d271b6b3-32d4-4879-9e67-88537b828374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:21.833122 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-d271b6b3-32d4-4879-9e67-88537b828374 None None] MFA Rules not processed for user `30dc38419578438f8f2ef53487062b98`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:49:21.842033 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-d271b6b3-32d4-4879-9e67-88537b828374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:21.850207 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:49:21.932985 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 816/1632] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:49:21 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:49:21.934152 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0139741-8f12-45a8-935b-63eb0e84edad None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:21.997629 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 817/1633] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:49:21 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:49:22.000458 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c76f8-7c62-4fe1-b01f-1d9c5a76d14f None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:22.000757 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c76f8-7c62-4fe1-b01f-1d9c5a76d14f None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:22.001040 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c76f8-7c62-4fe1-b01f-1d9c5a76d14f None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:22.006015 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 818/1634] 10.222.0.15 () {54 vars in 961 bytes} [Tue May 31 14:49:21 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:49:22.007574 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7c76f8-7c62-4fe1-b01f-1d9c5a76d14f None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:22.103162 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0139741-8f12-45a8-935b-63eb0e84edad None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:22.120630 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fe9f92-4de8-42f9-9fe4-b820babf3979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:22.127845 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fe9f92-4de8-42f9-9fe4-b820babf3979 admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:22.127845 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fe9f92-4de8-42f9-9fe4-b820babf3979 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:22.127845 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fe9f92-4de8-42f9-9fe4-b820babf3979 admin admin] PATH_INFO: `/v3/projects/d3e472a34d5640b5bba50f922d498b18/users/035dc3777203453fbcc4d0021b6f794e/roles/76c53e2c353644f885028a0226c06146` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:22.127845 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fe9f92-4de8-42f9-9fe4-b820babf3979 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3e472a34d5640b5bba50f922d498b18, user_id=035dc3777203453fbcc4d0021b6f794e, role_id=76c53e2c353644f885028a0226c06146)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:22.132314 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fe9f92-4de8-42f9-9fe4-b820babf3979 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:22.136192 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7c76f8-7c62-4fe1-b01f-1d9c5a76d14f None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:22.143043 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de80f4e-a796-426a-93e0-33f2eff14ca9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afbf718dcd9b4741a926b0a2321bd53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:22.143773 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de80f4e-a796-426a-93e0-33f2eff14ca9 service cinder] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:22.144064 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de80f4e-a796-426a-93e0-33f2eff14ca9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:22.144349 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de80f4e-a796-426a-93e0-33f2eff14ca9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:22.150137 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 817/1635] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:49:21 2022] PUT /identity/v3/projects/d3e472a34d5640b5bba50f922d498b18/users/035dc3777203453fbcc4d0021b6f794e/roles/76c53e2c353644f885028a0226c06146 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:49:22.152073 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f71d007-54e3-41fe-b68d-0df242e4b05d None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:22.152585 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f71d007-54e3-41fe-b68d-0df242e4b05d None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:22.153099 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f71d007-54e3-41fe-b68d-0df242e4b05d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:22.164226 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de80f4e-a796-426a-93e0-33f2eff14ca9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:22.166250 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de80f4e-a796-426a-93e0-33f2eff14ca9 service cinder] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:22.184237 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-2f71d007-54e3-41fe-b68d-0df242e4b05d None None] MFA Rules not processed for user `b57768d448e345ad8879bf29f21b48ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:49:22.185667 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:49:22.187327 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-2f71d007-54e3-41fe-b68d-0df242e4b05d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:22.191290 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 819/1636] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:49:22 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:49:22.193040 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b921d00-9b36-44e8-92b2-0d7b043cc2fd None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:22.193329 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b921d00-9b36-44e8-92b2-0d7b043cc2fd None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:22.193610 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b921d00-9b36-44e8-92b2-0d7b043cc2fd None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:22.195177 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 820/1637] 10.222.0.15 () {54 vars in 912 bytes} [Tue May 31 14:49:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:49:22.196256 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587cd8ae-6c87-45f4-a27c-51cbcc419a45 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:22.196401 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587cd8ae-6c87-45f4-a27c-51cbcc419a45 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:22.196680 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587cd8ae-6c87-45f4-a27c-51cbcc419a45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:22.245713 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-587cd8ae-6c87-45f4-a27c-51cbcc419a45 None None] MFA Rules not processed for user `035dc3777203453fbcc4d0021b6f794e`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:49:22.248322 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-587cd8ae-6c87-45f4-a27c-51cbcc419a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:22.304737 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 818/1638] 10.222.0.15 () {58 vars in 1058 bytes} [Tue May 31 14:49:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:49:22.307439 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4a5351-6f0f-4369-bc9d-02564f04127a None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:22.307835 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4a5351-6f0f-4369-bc9d-02564f04127a None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:22.308183 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4a5351-6f0f-4369-bc9d-02564f04127a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:22.339831 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-8e4a5351-6f0f-4369-bc9d-02564f04127a None None] MFA Rules not processed for user `b57768d448e345ad8879bf29f21b48ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:49:22.344720 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-8e4a5351-6f0f-4369-bc9d-02564f04127a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:22.379270 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 819/1639] 10.222.0.15 () {58 vars in 1009 bytes} [Tue May 31 14:49:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:49:22.380730 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4a5351-6f0f-4369-bc9d-02564f04127a None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:22.406427 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4a5351-6f0f-4369-bc9d-02564f04127a None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:22.412299 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 821/1640] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:49:22 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:49:22.414679 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587cd8ae-6c87-45f4-a27c-51cbcc419a45 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:22.429518 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32deabfb-e6dd-42d2-b2ad-3f1bcfd1f127 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57768d448e345ad8879bf29f21b48ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:22.430626 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32deabfb-e6dd-42d2-b2ad-3f1bcfd1f127 service nova] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:22.431403 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32deabfb-e6dd-42d2-b2ad-3f1bcfd1f127 service nova] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:22.431863 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32deabfb-e6dd-42d2-b2ad-3f1bcfd1f127 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:22.527439 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587cd8ae-6c87-45f4-a27c-51cbcc419a45 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:22.539557 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32deabfb-e6dd-42d2-b2ad-3f1bcfd1f127 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:22.541286 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32deabfb-e6dd-42d2-b2ad-3f1bcfd1f127 service nova] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:22.542897 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b904cae1-d4ef-419b-aaec-0eb837fcae65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afbf718dcd9b4741a926b0a2321bd53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:22.543585 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b904cae1-d4ef-419b-aaec-0eb837fcae65 service cinder] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:22.544400 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b904cae1-d4ef-419b-aaec-0eb837fcae65 service cinder] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:22.547487 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b904cae1-d4ef-419b-aaec-0eb837fcae65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:22.553808 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 820/1641] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:49:22 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:49:22.554879 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32deabfb-e6dd-42d2-b2ad-3f1bcfd1f127 service nova] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:22.567713 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32deabfb-e6dd-42d2-b2ad-3f1bcfd1f127 service nova] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:22.571669 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0d54ab-73d2-4cc0-861d-fad5a7fac856 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afbf718dcd9b4741a926b0a2321bd53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:22.572350 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0d54ab-73d2-4cc0-861d-fad5a7fac856 service cinder] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:22.572749 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0d54ab-73d2-4cc0-861d-fad5a7fac856 service cinder] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:22.573102 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0d54ab-73d2-4cc0-861d-fad5a7fac856 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:22.584954 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0d54ab-73d2-4cc0-861d-fad5a7fac856 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:22.586383 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0d54ab-73d2-4cc0-861d-fad5a7fac856 service cinder] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:22.598493 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 821/1642] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:49:22 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:49:22.603358 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b904cae1-d4ef-419b-aaec-0eb837fcae65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:22.605349 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b904cae1-d4ef-419b-aaec-0eb837fcae65 service cinder] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:22.630384 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 822/1643] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:49:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:49:22.753920 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0d54ab-73d2-4cc0-861d-fad5a7fac856 service cinder] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:22.769915 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0d54ab-73d2-4cc0-861d-fad5a7fac856 service cinder] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:22.773854 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a3264e-cada-45c8-9be7-8961f31bbf59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afbf718dcd9b4741a926b0a2321bd53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:22.774512 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a3264e-cada-45c8-9be7-8961f31bbf59 service cinder] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:22.774825 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a3264e-cada-45c8-9be7-8961f31bbf59 service cinder] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:22.940166 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a3264e-cada-45c8-9be7-8961f31bbf59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:22.940166 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:49:22.940166 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a3264e-cada-45c8-9be7-8961f31bbf59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:22.940166 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a3264e-cada-45c8-9be7-8961f31bbf59 service cinder] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:22.961406 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 822/1644] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:49:22 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:49:22.986630 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca358c91-2cb4-48de-bdef-3bd8fa878394 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:22.987120 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca358c91-2cb4-48de-bdef-3bd8fa878394 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:22.987297 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca358c91-2cb4-48de-bdef-3bd8fa878394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:23.040086 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-ca358c91-2cb4-48de-bdef-3bd8fa878394 None None] MFA Rules not processed for user `b1cb585384884aa58a6afe2269280d5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:49:23.041890 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-ca358c91-2cb4-48de-bdef-3bd8fa878394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:23.080658 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd39412d-90af-4dc2-8bc2-25836330ceb7 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:23.080947 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd39412d-90af-4dc2-8bc2-25836330ceb7 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:23.081238 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd39412d-90af-4dc2-8bc2-25836330ceb7 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:23.083949 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 823/1645] 10.222.0.15 () {54 vars in 912 bytes} [Tue May 31 14:49:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:49:23.089346 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88633eb-d9f7-4816-bf4e-24fcccca570a None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:23.089633 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88633eb-d9f7-4816-bf4e-24fcccca570a None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:23.089911 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88633eb-d9f7-4816-bf4e-24fcccca570a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:23.141354 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-f88633eb-d9f7-4816-bf4e-24fcccca570a None None] MFA Rules not processed for user `b57768d448e345ad8879bf29f21b48ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:49:23.143901 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-f88633eb-d9f7-4816-bf4e-24fcccca570a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:23.151140 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 823/1646] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:49:22 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:49:23.155979 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca358c91-2cb4-48de-bdef-3bd8fa878394 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:23.171726 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 824/1647] 10.222.0.15 () {58 vars in 1009 bytes} [Tue May 31 14:49:23 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 14:49:23.186438 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88633eb-d9f7-4816-bf4e-24fcccca570a None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:23.189702 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-f88633eb-d9f7-4816-bf4e-24fcccca570a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:23.201630 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:49:23.266512 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca358c91-2cb4-48de-bdef-3bd8fa878394 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:23.289778 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88633eb-d9f7-4816-bf4e-24fcccca570a None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:23.299409 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf58156a-413c-4c82-ae3b-eab1d72197e3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ba98b007cc4ae1b20e7f261824b77c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:23.299638 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf58156a-413c-4c82-ae3b-eab1d72197e3 service glance] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:23.300492 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf58156a-413c-4c82-ae3b-eab1d72197e3 service glance] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:23.300785 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf58156a-413c-4c82-ae3b-eab1d72197e3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:23.306840 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af93e62-1e80-4230-be39-f0dd2ab6b953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:23.307982 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af93e62-1e80-4230-be39-f0dd2ab6b953 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:23.309266 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af93e62-1e80-4230-be39-f0dd2ab6b953 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:23.311299 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af93e62-1e80-4230-be39-f0dd2ab6b953 admin admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:23.312573 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af93e62-1e80-4230-be39-f0dd2ab6b953 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:23.314019 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af93e62-1e80-4230-be39-f0dd2ab6b953 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:23.320201 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf58156a-413c-4c82-ae3b-eab1d72197e3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:23.321150 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf58156a-413c-4c82-ae3b-eab1d72197e3 service glance] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:23.346613 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 825/1648] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:49:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:49:23.458819 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 824/1649] 10.222.0.15 () {60 vars in 1152 bytes} [Tue May 31 14:49:23 2022] POST /identity/v3/projects => generated 403 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:49:23.459666 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf58156a-413c-4c82-ae3b-eab1d72197e3 service glance] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:23.474269 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf58156a-413c-4c82-ae3b-eab1d72197e3 service glance] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:23.582648 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81ec446-216f-4127-bc4d-5e4f96424108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:23.583333 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ec446-216f-4127-bc4d-5e4f96424108 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:23.583614 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ec446-216f-4127-bc4d-5e4f96424108 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:23.583970 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ec446-216f-4127-bc4d-5e4f96424108 admin admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:23.584673 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81ec446-216f-4127-bc4d-5e4f96424108 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:23.587439 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81ec446-216f-4127-bc4d-5e4f96424108 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:23.738345 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af93e62-1e80-4230-be39-f0dd2ab6b953 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:23.751081 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 826/1650] 10.222.0.15 () {60 vars in 1143 bytes} [Tue May 31 14:49:23 2022] POST /identity/v3/users => generated 308 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:49:23.758315 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af93e62-1e80-4230-be39-f0dd2ab6b953 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:23.775053 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a618a929-df4f-4d13-96d5-c626e79fdeca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:23.776055 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a618a929-df4f-4d13-96d5-c626e79fdeca admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:23.776735 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a618a929-df4f-4d13-96d5-c626e79fdeca admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:23.778351 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a618a929-df4f-4d13-96d5-c626e79fdeca admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:23.780522 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a618a929-df4f-4d13-96d5-c626e79fdeca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:23.786607 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a618a929-df4f-4d13-96d5-c626e79fdeca admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:23.807967 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b99459-61d6-4ff4-81eb-691a93633230 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:23.808431 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b99459-61d6-4ff4-81eb-691a93633230 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:23.810428 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b99459-61d6-4ff4-81eb-691a93633230 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:23.813456 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 827/1651] 10.222.0.15 () {54 vars in 912 bytes} [Tue May 31 14:49:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:49:23.821215 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7991357b-ca5c-457a-be73-9c73eec3b8b4 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:23.821643 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7991357b-ca5c-457a-be73-9c73eec3b8b4 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:23.822026 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7991357b-ca5c-457a-be73-9c73eec3b8b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:23.841482 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 825/1652] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:49:23 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:49:23.848828 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a618a929-df4f-4d13-96d5-c626e79fdeca admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:23.869334 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a618a929-df4f-4d13-96d5-c626e79fdeca admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:23.879905 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d46b83-a5cf-46af-bbe8-3066195be983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:23.882179 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d46b83-a5cf-46af-bbe8-3066195be983 admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:23.883781 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d46b83-a5cf-46af-bbe8-3066195be983 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:23.884851 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d46b83-a5cf-46af-bbe8-3066195be983 admin admin] PATH_INFO: `/v3/projects/47a2c3ae46c94033a24d782997df6c30/users/fcbd0156473a4bd58caa3273f8365821/roles/76c53e2c353644f885028a0226c06146` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:23.922533 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d46b83-a5cf-46af-bbe8-3066195be983 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47a2c3ae46c94033a24d782997df6c30, user_id=fcbd0156473a4bd58caa3273f8365821, role_id=76c53e2c353644f885028a0226c06146)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:23.928064 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d46b83-a5cf-46af-bbe8-3066195be983 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:23.933465 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-7991357b-ca5c-457a-be73-9c73eec3b8b4 None None] MFA Rules not processed for user `c5262f4b9b2948fdb3b4ab504311453b`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:49:23.935661 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-7991357b-ca5c-457a-be73-9c73eec3b8b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:24.047853 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 826/1653] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:49:23 2022] PUT /identity/v3/projects/47a2c3ae46c94033a24d782997df6c30/users/fcbd0156473a4bd58caa3273f8365821/roles/76c53e2c353644f885028a0226c06146 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:49:24.049133 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d46b83-a5cf-46af-bbe8-3066195be983 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:24.085104 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 828/1654] 10.222.0.15 () {58 vars in 1009 bytes} [Tue May 31 14:49:23 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:49:24.086396 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7991357b-ca5c-457a-be73-9c73eec3b8b4 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:24.116122 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7991357b-ca5c-457a-be73-9c73eec3b8b4 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:24.176683 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d46b83-a5cf-46af-bbe8-3066195be983 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:24.188632 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64b6eb1-b444-4d57-b4a9-7a273ff10072 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afbf718dcd9b4741a926b0a2321bd53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:24.189465 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64b6eb1-b444-4d57-b4a9-7a273ff10072 service cinder] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:24.190837 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64b6eb1-b444-4d57-b4a9-7a273ff10072 service cinder] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:24.191273 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64b6eb1-b444-4d57-b4a9-7a273ff10072 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:24.242597 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:49:24.245730 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313be454-ed4f-44b4-88e3-a86b98cbf25a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:24.246572 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313be454-ed4f-44b4-88e3-a86b98cbf25a admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:24.248053 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313be454-ed4f-44b4-88e3-a86b98cbf25a admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:24.248445 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313be454-ed4f-44b4-88e3-a86b98cbf25a admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:24.249310 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313be454-ed4f-44b4-88e3-a86b98cbf25a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:24.252377 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313be454-ed4f-44b4-88e3-a86b98cbf25a admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:24.280829 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 829/1655] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:49:24 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:49:24.287173 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313be454-ed4f-44b4-88e3-a86b98cbf25a admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:24.321872 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64b6eb1-b444-4d57-b4a9-7a273ff10072 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:24.327779 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64b6eb1-b444-4d57-b4a9-7a273ff10072 service cinder] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:24.343931 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 827/1656] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:49:24 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:49:24.345227 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64b6eb1-b444-4d57-b4a9-7a273ff10072 service cinder] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:24.366463 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64b6eb1-b444-4d57-b4a9-7a273ff10072 service cinder] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:24.385943 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f80bd3-5437-4c97-b75f-017b081a8aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:24.387058 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f80bd3-5437-4c97-b75f-017b081a8aaa admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:24.387493 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f80bd3-5437-4c97-b75f-017b081a8aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:24.388477 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f80bd3-5437-4c97-b75f-017b081a8aaa admin admin] PATH_INFO: `/v3/projects/47a2c3ae46c94033a24d782997df6c30/users/fcbd0156473a4bd58caa3273f8365821/roles/76c53e2c353644f885028a0226c06146` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:24.390615 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f80bd3-5437-4c97-b75f-017b081a8aaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=47a2c3ae46c94033a24d782997df6c30, user_id=fcbd0156473a4bd58caa3273f8365821, role_id=76c53e2c353644f885028a0226c06146)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:24.393935 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f80bd3-5437-4c97-b75f-017b081a8aaa admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:24.412953 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313be454-ed4f-44b4-88e3-a86b98cbf25a admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:24.419397 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9464a0e-b0d1-41c9-9fac-9bb057bf8898 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:24.421463 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9464a0e-b0d1-41c9-9fac-9bb057bf8898 service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:24.422007 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9464a0e-b0d1-41c9-9fac-9bb057bf8898 service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:24.422650 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9464a0e-b0d1-41c9-9fac-9bb057bf8898 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:24.438820 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 828/1657] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:49:24 2022] PUT /identity/v3/projects/47a2c3ae46c94033a24d782997df6c30/users/fcbd0156473a4bd58caa3273f8365821/roles/76c53e2c353644f885028a0226c06146 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:49:24.454281 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9464a0e-b0d1-41c9-9fac-9bb057bf8898 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:24.457527 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9464a0e-b0d1-41c9-9fac-9bb057bf8898 service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:24.474969 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 830/1658] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:49:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:49:25.965965 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83345e1f-a630-47d7-92a8-0bc48c9a4d55 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:25.967108 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83345e1f-a630-47d7-92a8-0bc48c9a4d55 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:25.967822 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83345e1f-a630-47d7-92a8-0bc48c9a4d55 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:25.969833 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 829/1659] 10.222.0.15 () {54 vars in 960 bytes} [Tue May 31 14:49:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:49:25.987776 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad5f81-96c9-44eb-a834-e90297880034 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:25.988337 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad5f81-96c9-44eb-a834-e90297880034 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:25.988675 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad5f81-96c9-44eb-a834-e90297880034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:26.039044 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-6aad5f81-96c9-44eb-a834-e90297880034 None None] MFA Rules not processed for user `efc959ca520c4816b5ff7f95655e53e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:49:26.051155 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-6aad5f81-96c9-44eb-a834-e90297880034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:26.080191 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:49:26.218611 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 831/1660] 10.222.0.15 () {58 vars in 1057 bytes} [Tue May 31 14:49:25 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 14:49:26.227007 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83345e1f-a630-47d7-92a8-0bc48c9a4d55 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:26.264269 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83345e1f-a630-47d7-92a8-0bc48c9a4d55 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:26.282820 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64636b0-8af3-4101-8186-3418c417815d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc959ca520c4816b5ff7f95655e53e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:26.295342 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64636b0-8af3-4101-8186-3418c417815d service placement] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:26.295342 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64636b0-8af3-4101-8186-3418c417815d service placement] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:26.295342 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64636b0-8af3-4101-8186-3418c417815d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:26.296923 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-b64636b0-8af3-4101-8186-3418c417815d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:26.316438 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:49:26.326869 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64636b0-8af3-4101-8186-3418c417815d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:26.330153 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64636b0-8af3-4101-8186-3418c417815d service placement] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:26.354443 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 830/1661] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:49:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:49:28.484279 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee54d08-519d-4e34-8fb3-837f064e2a9e None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:28.485820 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee54d08-519d-4e34-8fb3-837f064e2a9e None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:28.486307 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee54d08-519d-4e34-8fb3-837f064e2a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:28.551180 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-6ee54d08-519d-4e34-8fb3-837f064e2a9e None None] MFA Rules not processed for user `fcbd0156473a4bd58caa3273f8365821`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:49:28.552798 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-6ee54d08-519d-4e34-8fb3-837f064e2a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:28.673825 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64636b0-8af3-4101-8186-3418c417815d service placement] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:28.703077 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 832/1662] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:49:28 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:49:28.842709 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64636b0-8af3-4101-8186-3418c417815d service placement] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:28.854538 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57f0625-1884-4a5e-a9e1-e95c1a5d671f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:28.855795 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f0625-1884-4a5e-a9e1-e95c1a5d671f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:28.856253 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f0625-1884-4a5e-a9e1-e95c1a5d671f admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:28.857315 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f0625-1884-4a5e-a9e1-e95c1a5d671f admin admin] PATH_INFO: `/v3/users/13cc1d39a7474eb0a490e89d01b3e03d` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:28.865280 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57f0625-1884-4a5e-a9e1-e95c1a5d671f admin admin] RBAC: Authorizing `identity:delete_user(user_id=13cc1d39a7474eb0a490e89d01b3e03d)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:28.868649 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57f0625-1884-4a5e-a9e1-e95c1a5d671f admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:29.138723 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-e57f0625-1884-4a5e-a9e1-e95c1a5d671f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13cc1d39a7474eb0a490e89d01b3e03d'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:29.161156 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-e57f0625-1884-4a5e-a9e1-e95c1a5d671f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13cc1d39a7474eb0a490e89d01b3e03d'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:29.167094 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-e57f0625-1884-4a5e-a9e1-e95c1a5d671f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13cc1d39a7474eb0a490e89d01b3e03d'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:29.171411 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-e57f0625-1884-4a5e-a9e1-e95c1a5d671f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13cc1d39a7474eb0a490e89d01b3e03d'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:29.219049 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-e57f0625-1884-4a5e-a9e1-e95c1a5d671f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13cc1d39a7474eb0a490e89d01b3e03d'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:29.333707 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 831/1663] 10.222.0.15 () {58 vars in 1223 bytes} [Tue May 31 14:49:28 2022] DELETE /identity/v3/users/13cc1d39a7474eb0a490e89d01b3e03d => generated 0 bytes in 661 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 14:49:29.341815 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f835111f-a807-48cc-8885-7939aec476e9 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:29.342455 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f835111f-a807-48cc-8885-7939aec476e9 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:29.342940 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f835111f-a807-48cc-8885-7939aec476e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:29.367219 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-f835111f-a807-48cc-8885-7939aec476e9 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:49:29.368719 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-f835111f-a807-48cc-8885-7939aec476e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:29.469699 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 833/1664] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:49:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:49:29.488302 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57f0625-1884-4a5e-a9e1-e95c1a5d671f admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:29.489868 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-e57f0625-1884-4a5e-a9e1-e95c1a5d671f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:29.515100 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57f0625-1884-4a5e-a9e1-e95c1a5d671f admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:29.531439 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f39631-da83-4746-a1b0-2a416c8de250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:29.532375 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f39631-da83-4746-a1b0-2a416c8de250 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:29.532667 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f39631-da83-4746-a1b0-2a416c8de250 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:29.532950 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f39631-da83-4746-a1b0-2a416c8de250 admin admin] PATH_INFO: `/v3/users/a6860138191e4623988309aeeb60ce07` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:29.534268 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f39631-da83-4746-a1b0-2a416c8de250 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6860138191e4623988309aeeb60ce07)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:29.536406 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f39631-da83-4746-a1b0-2a416c8de250 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:29.668036 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f835111f-a807-48cc-8885-7939aec476e9 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:29.670546 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-f835111f-a807-48cc-8885-7939aec476e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:29.751295 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:49:29.779539 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-99f39631-da83-4746-a1b0-2a416c8de250 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6860138191e4623988309aeeb60ce07'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:29.794502 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-99f39631-da83-4746-a1b0-2a416c8de250 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6860138191e4623988309aeeb60ce07'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:29.797553 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-99f39631-da83-4746-a1b0-2a416c8de250 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6860138191e4623988309aeeb60ce07'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:29.800351 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-99f39631-da83-4746-a1b0-2a416c8de250 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6860138191e4623988309aeeb60ce07'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:29.807554 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f835111f-a807-48cc-8885-7939aec476e9 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:29.818992 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:49:29.820572 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7614842a-62db-4d4b-9ffd-535746fd498e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:29.821440 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7614842a-62db-4d4b-9ffd-535746fd498e service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:29.822268 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7614842a-62db-4d4b-9ffd-535746fd498e service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:29.822610 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7614842a-62db-4d4b-9ffd-535746fd498e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:29.827311 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-99f39631-da83-4746-a1b0-2a416c8de250 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6860138191e4623988309aeeb60ce07'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:29.827514 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-7614842a-62db-4d4b-9ffd-535746fd498e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:29.865163 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7614842a-62db-4d4b-9ffd-535746fd498e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:29.870880 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7614842a-62db-4d4b-9ffd-535746fd498e service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:29.899906 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 834/1665] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:49:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 14:49:29.903123 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de217fe-4263-40ad-b864-801daea981ee None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:29.906299 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de217fe-4263-40ad-b864-801daea981ee None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:29.906639 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de217fe-4263-40ad-b864-801daea981ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:29.914199 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 832/1666] 10.222.0.15 () {58 vars in 1223 bytes} [Tue May 31 14:49:29 2022] DELETE /identity/v3/users/a6860138191e4623988309aeeb60ce07 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:49:29.923620 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5960b27-0c63-44ab-b581-e21e1b6acea2 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:29.924294 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5960b27-0c63-44ab-b581-e21e1b6acea2 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:29.924593 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5960b27-0c63-44ab-b581-e21e1b6acea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:29.952956 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-4de217fe-4263-40ad-b864-801daea981ee None None] MFA Rules not processed for user `ec0bc78fb2d849cb89fec3420844d738`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:49:29.956937 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-4de217fe-4263-40ad-b864-801daea981ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:30.001172 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-e5960b27-0c63-44ab-b581-e21e1b6acea2 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:49:30.002401 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-e5960b27-0c63-44ab-b581-e21e1b6acea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:30.147558 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 835/1667] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:49:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:49:30.155137 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de217fe-4263-40ad-b864-801daea981ee None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:30.157132 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-4de217fe-4263-40ad-b864-801daea981ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:30.226777 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 833/1668] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:49:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:49:30.255585 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5960b27-0c63-44ab-b581-e21e1b6acea2 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:30.257565 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-e5960b27-0c63-44ab-b581-e21e1b6acea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:30.315858 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de217fe-4263-40ad-b864-801daea981ee None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:30.323073 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90dc7d2-e7c5-49cf-b321-3cda3595b8f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57768d448e345ad8879bf29f21b48ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:30.323999 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90dc7d2-e7c5-49cf-b321-3cda3595b8f2 service nova] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:30.324482 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90dc7d2-e7c5-49cf-b321-3cda3595b8f2 service nova] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:30.324914 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90dc7d2-e7c5-49cf-b321-3cda3595b8f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:30.335492 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90dc7d2-e7c5-49cf-b321-3cda3595b8f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:30.337700 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90dc7d2-e7c5-49cf-b321-3cda3595b8f2 service nova] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:30.350402 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 836/1669] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:49:30 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 14:49:30.428888 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5960b27-0c63-44ab-b581-e21e1b6acea2 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:30.438385 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed41f0b4-c69a-4443-bdf5-b584a6ce9e0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:30.439344 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed41f0b4-c69a-4443-bdf5-b584a6ce9e0e service neutron] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:30.439775 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed41f0b4-c69a-4443-bdf5-b584a6ce9e0e service neutron] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:30.440197 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed41f0b4-c69a-4443-bdf5-b584a6ce9e0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:30.464009 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed41f0b4-c69a-4443-bdf5-b584a6ce9e0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:30.465590 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed41f0b4-c69a-4443-bdf5-b584a6ce9e0e service neutron] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:30.491558 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 834/1670] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:49:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 14:49:30.626165 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc47ff4-3460-41cb-9e7d-b4b632a489ea None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:30.626513 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc47ff4-3460-41cb-9e7d-b4b632a489ea None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:30.626777 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc47ff4-3460-41cb-9e7d-b4b632a489ea None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:30.629912 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 837/1671] 10.222.0.15 () {54 vars in 921 bytes} [Tue May 31 14:49:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:49:30.729708 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f83a27-6e19-4d90-91b5-f89b24137d31 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:30.729940 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f83a27-6e19-4d90-91b5-f89b24137d31 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:30.730222 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f83a27-6e19-4d90-91b5-f89b24137d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:30.764229 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-57f83a27-6e19-4d90-91b5-f89b24137d31 None None] MFA Rules not processed for user `efc959ca520c4816b5ff7f95655e53e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:49:30.765477 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-57f83a27-6e19-4d90-91b5-f89b24137d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:30.921907 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 835/1672] 10.222.0.15 () {58 vars in 1018 bytes} [Tue May 31 14:49:30 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:49:30.956923 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc47ff4-3460-41cb-9e7d-b4b632a489ea None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:30.959083 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-9fc47ff4-3460-41cb-9e7d-b4b632a489ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:31.011688 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc47ff4-3460-41cb-9e7d-b4b632a489ea None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:31.023572 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a6a628-fe0b-4b7e-9a23-0163a11d5f24 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc959ca520c4816b5ff7f95655e53e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:31.024864 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a6a628-fe0b-4b7e-9a23-0163a11d5f24 service placement] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:31.026042 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a6a628-fe0b-4b7e-9a23-0163a11d5f24 service placement] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:31.026389 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a6a628-fe0b-4b7e-9a23-0163a11d5f24 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:31.039142 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a6a628-fe0b-4b7e-9a23-0163a11d5f24 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:31.041043 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a6a628-fe0b-4b7e-9a23-0163a11d5f24 service placement] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:31.055717 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 838/1673] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:49:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:49:31.375492 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05977485-e86f-4c28-a73d-b345d38fd940 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:31.375789 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05977485-e86f-4c28-a73d-b345d38fd940 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:31.376073 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05977485-e86f-4c28-a73d-b345d38fd940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:31.427832 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-05977485-e86f-4c28-a73d-b345d38fd940 None None] MFA Rules not processed for user `735d2518c8404bd991acee533b314039`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:49:31.429324 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-05977485-e86f-4c28-a73d-b345d38fd940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:31.466876 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:49:31.549245 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 836/1674] 10.222.0.15 () {58 vars in 1009 bytes} [Tue May 31 14:49:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:49:31.987615 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a6a628-fe0b-4b7e-9a23-0163a11d5f24 service placement] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:31.988370 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-c6a6a628-fe0b-4b7e-9a23-0163a11d5f24 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:32.119431 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:49:32.256014 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a6a628-fe0b-4b7e-9a23-0163a11d5f24 service placement] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:32.266209 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736f033d-a620-4218-9294-868151701347 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e158f461c66e4d779f23fb7760672897', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:32.269003 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736f033d-a620-4218-9294-868151701347 service swift] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:32.287185 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736f033d-a620-4218-9294-868151701347 service swift] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:32.287791 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736f033d-a620-4218-9294-868151701347 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:32.303098 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736f033d-a620-4218-9294-868151701347 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:32.305717 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736f033d-a620-4218-9294-868151701347 service swift] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:32.326842 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 839/1675] 10.222.0.15 () {60 vars in 1384 bytes} [Tue May 31 14:49:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 31 14:49:32.498518 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05977485-e86f-4c28-a73d-b345d38fd940 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:32.501463 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-05977485-e86f-4c28-a73d-b345d38fd940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:32.566226 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05977485-e86f-4c28-a73d-b345d38fd940 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:32.586828 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b2adcd-90a7-4c6e-9bf6-4f874907da86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:32.592225 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b2adcd-90a7-4c6e-9bf6-4f874907da86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:32.595310 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b2adcd-90a7-4c6e-9bf6-4f874907da86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:32.597123 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b2adcd-90a7-4c6e-9bf6-4f874907da86 admin admin] PATH_INFO: `/v3/projects/a5b9dae5a65c497d9dc4e6ba2bafe501` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:32.600937 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b2adcd-90a7-4c6e-9bf6-4f874907da86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5b9dae5a65c497d9dc4e6ba2bafe501)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:32.603802 dv-cinder-839793-14-smb devstack@keystone.service[80502]: WARNING py.warnings [None req-66b2adcd-90a7-4c6e-9bf6-4f874907da86 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 31 14:49:32.603802 dv-cinder-839793-14-smb devstack@keystone.service[80502]: warnings.warn(msg) May 31 14:49:32.603802 dv-cinder-839793-14-smb devstack@keystone.service[80502]: May 31 14:49:32.612246 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b2adcd-90a7-4c6e-9bf6-4f874907da86 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:32.884185 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-66b2adcd-90a7-4c6e-9bf6-4f874907da86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5b9dae5a65c497d9dc4e6ba2bafe501', 'request_id': 'req-66b2adcd-90a7-4c6e-9bf6-4f874907da86'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:32.925173 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-66b2adcd-90a7-4c6e-9bf6-4f874907da86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5b9dae5a65c497d9dc4e6ba2bafe501', 'request_id': 'req-66b2adcd-90a7-4c6e-9bf6-4f874907da86'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:33.041800 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-66b2adcd-90a7-4c6e-9bf6-4f874907da86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5b9dae5a65c497d9dc4e6ba2bafe501', 'request_id': 'req-66b2adcd-90a7-4c6e-9bf6-4f874907da86'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:33.074412 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-66b2adcd-90a7-4c6e-9bf6-4f874907da86 admin admin] The token cache is being invalidate because project a5b9dae5a65c497d9dc4e6ba2bafe501 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 14:49:33.074826 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-66b2adcd-90a7-4c6e-9bf6-4f874907da86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:33.086537 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-66b2adcd-90a7-4c6e-9bf6-4f874907da86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:33.088930 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 837/1676] 10.222.0.15 () {58 vars in 1232 bytes} [Tue May 31 14:49:32 2022] DELETE /identity/v3/projects/a5b9dae5a65c497d9dc4e6ba2bafe501 => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:49:33.093956 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736f033d-a620-4218-9294-868151701347 service swift] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:33.115745 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736f033d-a620-4218-9294-868151701347 service swift] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:33.422476 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b31b17a-3881-47c8-81b4-8c24dbcddee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:33.423940 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b31b17a-3881-47c8-81b4-8c24dbcddee4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:33.424535 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b31b17a-3881-47c8-81b4-8c24dbcddee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:33.425114 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b31b17a-3881-47c8-81b4-8c24dbcddee4 admin admin] PATH_INFO: `/v3/users/035dc3777203453fbcc4d0021b6f794e` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:33.432233 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b31b17a-3881-47c8-81b4-8c24dbcddee4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=035dc3777203453fbcc4d0021b6f794e)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:33.433927 dv-cinder-839793-14-smb devstack@keystone.service[80503]: WARNING py.warnings [None req-1b31b17a-3881-47c8-81b4-8c24dbcddee4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 31 14:49:33.433927 dv-cinder-839793-14-smb devstack@keystone.service[80503]: warnings.warn(msg) May 31 14:49:33.433927 dv-cinder-839793-14-smb devstack@keystone.service[80503]: May 31 14:49:33.435884 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b31b17a-3881-47c8-81b4-8c24dbcddee4 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:33.826030 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375adb92-6288-446e-a4b5-555d4603f209 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:33.827118 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375adb92-6288-446e-a4b5-555d4603f209 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:33.830593 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375adb92-6288-446e-a4b5-555d4603f209 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:33.832691 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 838/1677] 10.222.0.15 () {54 vars in 921 bytes} [Tue May 31 14:49:33 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:49:33.886118 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e1acf1-00bf-401d-9fda-28f686c61561 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:33.886430 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e1acf1-00bf-401d-9fda-28f686c61561 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:33.886779 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e1acf1-00bf-401d-9fda-28f686c61561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:33.923361 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-70e1acf1-00bf-401d-9fda-28f686c61561 None None] MFA Rules not processed for user `efc959ca520c4816b5ff7f95655e53e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:49:33.924615 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-70e1acf1-00bf-401d-9fda-28f686c61561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:34.068496 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-1b31b17a-3881-47c8-81b4-8c24dbcddee4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '035dc3777203453fbcc4d0021b6f794e'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:34.144553 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 839/1678] 10.222.0.15 () {58 vars in 1018 bytes} [Tue May 31 14:49:33 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 14:49:34.150376 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e1acf1-00bf-401d-9fda-28f686c61561 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:34.150376 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-70e1acf1-00bf-401d-9fda-28f686c61561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:34.172711 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-1b31b17a-3881-47c8-81b4-8c24dbcddee4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '035dc3777203453fbcc4d0021b6f794e'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:34.173432 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-1b31b17a-3881-47c8-81b4-8c24dbcddee4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '035dc3777203453fbcc4d0021b6f794e'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:34.198579 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-1b31b17a-3881-47c8-81b4-8c24dbcddee4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '035dc3777203453fbcc4d0021b6f794e'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:34.201226 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-1b31b17a-3881-47c8-81b4-8c24dbcddee4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '035dc3777203453fbcc4d0021b6f794e'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:34.213579 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e1acf1-00bf-401d-9fda-28f686c61561 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:34.229453 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dda6c8-037c-411e-b9e0-46ead3bddd19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:34.230901 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dda6c8-037c-411e-b9e0-46ead3bddd19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:34.231793 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dda6c8-037c-411e-b9e0-46ead3bddd19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:34.235823 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dda6c8-037c-411e-b9e0-46ead3bddd19 admin admin] PATH_INFO: `/v3/projects/b05bd702841941728aaa8f41662658c2` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:34.238587 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dda6c8-037c-411e-b9e0-46ead3bddd19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b05bd702841941728aaa8f41662658c2)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:34.246540 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dda6c8-037c-411e-b9e0-46ead3bddd19 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:34.300489 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 840/1679] 10.222.0.15 () {58 vars in 1223 bytes} [Tue May 31 14:49:33 2022] DELETE /identity/v3/users/035dc3777203453fbcc4d0021b6f794e => generated 0 bytes in 1207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:49:34.302338 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b164f8-d59d-41cb-8f45-5db06cd4fa94 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:34.302838 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b164f8-d59d-41cb-8f45-5db06cd4fa94 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:34.303389 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b164f8-d59d-41cb-8f45-5db06cd4fa94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:34.355072 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-41b164f8-d59d-41cb-8f45-5db06cd4fa94 None None] MFA Rules not processed for user `c5262f4b9b2948fdb3b4ab504311453b`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:49:34.356643 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-41b164f8-d59d-41cb-8f45-5db06cd4fa94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:34.472971 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:49:34.485505 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:49:34.496178 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 841/1680] 10.222.0.73 () {58 vars in 1015 bytes} [Tue May 31 14:49:34 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:49:34.497085 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b164f8-d59d-41cb-8f45-5db06cd4fa94 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:34.502315 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-c1dda6c8-037c-411e-b9e0-46ead3bddd19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b05bd702841941728aaa8f41662658c2', 'request_id': 'req-c1dda6c8-037c-411e-b9e0-46ead3bddd19'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:34.503092 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-41b164f8-d59d-41cb-8f45-5db06cd4fa94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:34.540798 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-c1dda6c8-037c-411e-b9e0-46ead3bddd19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b05bd702841941728aaa8f41662658c2', 'request_id': 'req-c1dda6c8-037c-411e-b9e0-46ead3bddd19'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:34.648007 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-c1dda6c8-037c-411e-b9e0-46ead3bddd19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b05bd702841941728aaa8f41662658c2', 'request_id': 'req-c1dda6c8-037c-411e-b9e0-46ead3bddd19'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:34.666275 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-c1dda6c8-037c-411e-b9e0-46ead3bddd19 admin admin] The token cache is being invalidate because project b05bd702841941728aaa8f41662658c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 14:49:34.666633 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-c1dda6c8-037c-411e-b9e0-46ead3bddd19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:34.667316 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-c1dda6c8-037c-411e-b9e0-46ead3bddd19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:34.671165 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 840/1681] 10.222.0.15 () {58 vars in 1232 bytes} [Tue May 31 14:49:34 2022] DELETE /identity/v3/projects/b05bd702841941728aaa8f41662658c2 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:49:34.672920 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dda6c8-037c-411e-b9e0-46ead3bddd19 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:34.676528 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-c1dda6c8-037c-411e-b9e0-46ead3bddd19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:34.693452 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b164f8-d59d-41cb-8f45-5db06cd4fa94 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:34.860725 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4608ab52-7caf-4ab8-a264-cb8b8d78e2b3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc959ca520c4816b5ff7f95655e53e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:34.861404 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4608ab52-7caf-4ab8-a264-cb8b8d78e2b3 service placement] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:34.861694 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4608ab52-7caf-4ab8-a264-cb8b8d78e2b3 service placement] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:34.861976 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4608ab52-7caf-4ab8-a264-cb8b8d78e2b3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:34.875225 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-4608ab52-7caf-4ab8-a264-cb8b8d78e2b3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:34.923547 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4608ab52-7caf-4ab8-a264-cb8b8d78e2b3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:34.925525 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4608ab52-7caf-4ab8-a264-cb8b8d78e2b3 service placement] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:34.926629 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dda6c8-037c-411e-b9e0-46ead3bddd19 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:34.936431 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5789f5b0-f7a1-419c-9fe2-d60a0ccb88c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:34.942597 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5789f5b0-f7a1-419c-9fe2-d60a0ccb88c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:34.942597 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5789f5b0-f7a1-419c-9fe2-d60a0ccb88c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:34.942597 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5789f5b0-f7a1-419c-9fe2-d60a0ccb88c9 admin admin] PATH_INFO: `/v3/users/b1cb585384884aa58a6afe2269280d5c` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:34.942597 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5789f5b0-f7a1-419c-9fe2-d60a0ccb88c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1cb585384884aa58a6afe2269280d5c)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:34.948703 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5789f5b0-f7a1-419c-9fe2-d60a0ccb88c9 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:34.977229 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 842/1682] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:49:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:49:34.977229 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4608ab52-7caf-4ab8-a264-cb8b8d78e2b3 service placement] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:34.980961 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-4608ab52-7caf-4ab8-a264-cb8b8d78e2b3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:35.175913 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4608ab52-7caf-4ab8-a264-cb8b8d78e2b3 service placement] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:35.188041 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b99b2c3-82e6-4b39-a518-74ac6aae727a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:35.192085 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b99b2c3-82e6-4b39-a518-74ac6aae727a service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:35.192085 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b99b2c3-82e6-4b39-a518-74ac6aae727a service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:35.192085 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b99b2c3-82e6-4b39-a518-74ac6aae727a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:35.194172 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-0b99b2c3-82e6-4b39-a518-74ac6aae727a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:35.217768 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-5789f5b0-f7a1-419c-9fe2-d60a0ccb88c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1cb585384884aa58a6afe2269280d5c'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:35.232810 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-5789f5b0-f7a1-419c-9fe2-d60a0ccb88c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1cb585384884aa58a6afe2269280d5c'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:35.235114 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-5789f5b0-f7a1-419c-9fe2-d60a0ccb88c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1cb585384884aa58a6afe2269280d5c'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:35.237221 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-5789f5b0-f7a1-419c-9fe2-d60a0ccb88c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1cb585384884aa58a6afe2269280d5c'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:35.242122 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b99b2c3-82e6-4b39-a518-74ac6aae727a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:35.249775 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b99b2c3-82e6-4b39-a518-74ac6aae727a service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:35.274692 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 843/1683] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:49:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:49:35.279046 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce64a0c5-fec0-471f-b7ce-869f2247ac83 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:35.284371 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce64a0c5-fec0-471f-b7ce-869f2247ac83 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:35.284371 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce64a0c5-fec0-471f-b7ce-869f2247ac83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:35.284728 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-5789f5b0-f7a1-419c-9fe2-d60a0ccb88c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1cb585384884aa58a6afe2269280d5c'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:35.348106 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-ce64a0c5-fec0-471f-b7ce-869f2247ac83 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:49:35.350486 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-ce64a0c5-fec0-471f-b7ce-869f2247ac83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:35.362773 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 844/1684] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:49:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:49:35.364045 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce64a0c5-fec0-471f-b7ce-869f2247ac83 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:35.370878 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-ce64a0c5-fec0-471f-b7ce-869f2247ac83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:35.382181 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 841/1685] 10.222.0.15 () {58 vars in 1223 bytes} [Tue May 31 14:49:34 2022] DELETE /identity/v3/users/b1cb585384884aa58a6afe2269280d5c => generated 0 bytes in 710 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:49:35.383664 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e81956-23e0-4d2b-9ae2-a8747c368737 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:35.383991 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e81956-23e0-4d2b-9ae2-a8747c368737 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:35.384293 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e81956-23e0-4d2b-9ae2-a8747c368737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:35.413814 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce64a0c5-fec0-471f-b7ce-869f2247ac83 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:35.423683 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-78e81956-23e0-4d2b-9ae2-a8747c368737 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:49:35.429475 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-78e81956-23e0-4d2b-9ae2-a8747c368737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:35.533241 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 842/1686] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:49:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:49:35.538322 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e81956-23e0-4d2b-9ae2-a8747c368737 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:35.552561 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a88a113-8234-428b-9c7b-6050cdffe520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:35.553456 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a88a113-8234-428b-9c7b-6050cdffe520 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:35.553736 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a88a113-8234-428b-9c7b-6050cdffe520 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:35.554040 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a88a113-8234-428b-9c7b-6050cdffe520 admin admin] PATH_INFO: `/v3/users/5ceaec2573d747deaa5f2f074854b35d` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:35.563856 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e81956-23e0-4d2b-9ae2-a8747c368737 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:35.563987 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a88a113-8234-428b-9c7b-6050cdffe520 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ceaec2573d747deaa5f2f074854b35d)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:35.564430 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a88a113-8234-428b-9c7b-6050cdffe520 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:35.570147 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f9bbd3-de23-4596-9a4b-7dfdc66721f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:35.571143 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f9bbd3-de23-4596-9a4b-7dfdc66721f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:35.571597 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f9bbd3-de23-4596-9a4b-7dfdc66721f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:35.572076 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f9bbd3-de23-4596-9a4b-7dfdc66721f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:35.573179 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f9bbd3-de23-4596-9a4b-7dfdc66721f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:49:35.573633 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f9bbd3-de23-4596-9a4b-7dfdc66721f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:35.577333 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f9bbd3-de23-4596-9a4b-7dfdc66721f9 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:35.596346 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 843/1687] 10.222.0.15 () {58 vars in 1152 bytes} [Tue May 31 14:49:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:49:35.604505 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f9bbd3-de23-4596-9a4b-7dfdc66721f9 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:35.624801 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f9bbd3-de23-4596-9a4b-7dfdc66721f9 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:35.640763 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d61c0ce-674a-432e-a4a7-a63eed06ee0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:35.641455 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d61c0ce-674a-432e-a4a7-a63eed06ee0d admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:35.641784 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d61c0ce-674a-432e-a4a7-a63eed06ee0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:35.642069 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d61c0ce-674a-432e-a4a7-a63eed06ee0d admin admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:35.643139 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d61c0ce-674a-432e-a4a7-a63eed06ee0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:35.648468 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d61c0ce-674a-432e-a4a7-a63eed06ee0d admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:35.734674 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:49:35.761340 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 844/1688] 10.222.0.15 () {60 vars in 1152 bytes} [Tue May 31 14:49:35 2022] POST /identity/v3/projects => generated 371 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:49:35.762333 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d61c0ce-674a-432e-a4a7-a63eed06ee0d admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:35.801349 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:49:35.823947 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-7a88a113-8234-428b-9c7b-6050cdffe520 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ceaec2573d747deaa5f2f074854b35d'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:35.909897 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-7a88a113-8234-428b-9c7b-6050cdffe520 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ceaec2573d747deaa5f2f074854b35d'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:35.910647 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-7a88a113-8234-428b-9c7b-6050cdffe520 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ceaec2573d747deaa5f2f074854b35d'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:35.918858 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d61c0ce-674a-432e-a4a7-a63eed06ee0d admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:35.922840 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-7a88a113-8234-428b-9c7b-6050cdffe520 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ceaec2573d747deaa5f2f074854b35d'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:35.924379 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-7a88a113-8234-428b-9c7b-6050cdffe520 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ceaec2573d747deaa5f2f074854b35d'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:35.930347 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b753c3f-fbd1-4cb8-8ffb-97146e3d5fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:35.934137 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b753c3f-fbd1-4cb8-8ffb-97146e3d5fba admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:35.934137 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b753c3f-fbd1-4cb8-8ffb-97146e3d5fba admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:35.934137 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b753c3f-fbd1-4cb8-8ffb-97146e3d5fba admin admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:35.934137 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b753c3f-fbd1-4cb8-8ffb-97146e3d5fba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:35.939335 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b753c3f-fbd1-4cb8-8ffb-97146e3d5fba admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:35.996992 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 845/1689] 10.222.0.15 () {58 vars in 1223 bytes} [Tue May 31 14:49:35 2022] DELETE /identity/v3/users/5ceaec2573d747deaa5f2f074854b35d => generated 0 bytes in 633 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:49:36.001736 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df20a3-2309-40e1-8f70-dad443dc07d5 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:36.002111 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df20a3-2309-40e1-8f70-dad443dc07d5 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:36.002320 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df20a3-2309-40e1-8f70-dad443dc07d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:36.038113 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 845/1690] 10.222.0.15 () {60 vars in 1143 bytes} [Tue May 31 14:49:35 2022] POST /identity/v3/users => generated 286 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:49:36.042357 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b753c3f-fbd1-4cb8-8ffb-97146e3d5fba admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:36.048723 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-2b753c3f-fbd1-4cb8-8ffb-97146e3d5fba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:36.054639 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-88df20a3-2309-40e1-8f70-dad443dc07d5 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:49:36.075837 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-88df20a3-2309-40e1-8f70-dad443dc07d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:36.083400 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b753c3f-fbd1-4cb8-8ffb-97146e3d5fba admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:36.234219 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa6511d-4271-4ee2-9db6-a347211a6f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:36.236853 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa6511d-4271-4ee2-9db6-a347211a6f06 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:36.238030 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa6511d-4271-4ee2-9db6-a347211a6f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:36.238030 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa6511d-4271-4ee2-9db6-a347211a6f06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:36.241926 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa6511d-4271-4ee2-9db6-a347211a6f06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:36.250145 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa6511d-4271-4ee2-9db6-a347211a6f06 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:36.277922 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 846/1691] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:49:36 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:49:36.279173 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa6511d-4271-4ee2-9db6-a347211a6f06 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:36.289158 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-bfa6511d-4271-4ee2-9db6-a347211a6f06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:36.302280 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 846/1692] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:49:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 14:49:36.303723 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88df20a3-2309-40e1-8f70-dad443dc07d5 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:36.327352 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa6511d-4271-4ee2-9db6-a347211a6f06 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:36.341374 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88df20a3-2309-40e1-8f70-dad443dc07d5 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:36.341752 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be201eb-46d0-4f9e-b8be-f96aa04e764a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:36.342973 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be201eb-46d0-4f9e-b8be-f96aa04e764a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:36.345228 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be201eb-46d0-4f9e-b8be-f96aa04e764a admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:36.345633 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be201eb-46d0-4f9e-b8be-f96aa04e764a admin admin] PATH_INFO: `/v3/projects/d3e472a34d5640b5bba50f922d498b18` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:36.349857 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be201eb-46d0-4f9e-b8be-f96aa04e764a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3e472a34d5640b5bba50f922d498b18)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:36.351936 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be201eb-46d0-4f9e-b8be-f96aa04e764a admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:36.358357 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90bc71b-484e-4a7c-b9ce-5f4b20469f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:36.359187 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90bc71b-484e-4a7c-b9ce-5f4b20469f20 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:36.359595 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90bc71b-484e-4a7c-b9ce-5f4b20469f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:36.359953 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90bc71b-484e-4a7c-b9ce-5f4b20469f20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:36.361647 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90bc71b-484e-4a7c-b9ce-5f4b20469f20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:36.364440 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90bc71b-484e-4a7c-b9ce-5f4b20469f20 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:36.401534 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 847/1693] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:49:36 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:49:36.403078 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90bc71b-484e-4a7c-b9ce-5f4b20469f20 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:36.415378 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-b90bc71b-484e-4a7c-b9ce-5f4b20469f20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:36.523313 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:49:36.556273 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:49:36.575803 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-1be201eb-46d0-4f9e-b8be-f96aa04e764a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3e472a34d5640b5bba50f922d498b18', 'request_id': 'req-1be201eb-46d0-4f9e-b8be-f96aa04e764a'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:36.582716 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-1be201eb-46d0-4f9e-b8be-f96aa04e764a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3e472a34d5640b5bba50f922d498b18', 'request_id': 'req-1be201eb-46d0-4f9e-b8be-f96aa04e764a'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:36.608350 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90bc71b-484e-4a7c-b9ce-5f4b20469f20 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:36.672410 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-1be201eb-46d0-4f9e-b8be-f96aa04e764a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3e472a34d5640b5bba50f922d498b18', 'request_id': 'req-1be201eb-46d0-4f9e-b8be-f96aa04e764a'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:36.690873 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-1be201eb-46d0-4f9e-b8be-f96aa04e764a admin admin] The token cache is being invalidate because project d3e472a34d5640b5bba50f922d498b18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 14:49:36.691174 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-1be201eb-46d0-4f9e-b8be-f96aa04e764a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:36.692320 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-1be201eb-46d0-4f9e-b8be-f96aa04e764a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:36.696842 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 847/1694] 10.222.0.15 () {58 vars in 1232 bytes} [Tue May 31 14:49:36 2022] DELETE /identity/v3/projects/d3e472a34d5640b5bba50f922d498b18 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:49:36.698135 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be201eb-46d0-4f9e-b8be-f96aa04e764a admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:36.703607 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-1be201eb-46d0-4f9e-b8be-f96aa04e764a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:36.731142 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481ce952-b2eb-48ea-ba50-9ed13efc571b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:36.733337 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481ce952-b2eb-48ea-ba50-9ed13efc571b service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:36.733700 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481ce952-b2eb-48ea-ba50-9ed13efc571b service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:36.733999 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481ce952-b2eb-48ea-ba50-9ed13efc571b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:36.742910 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-481ce952-b2eb-48ea-ba50-9ed13efc571b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:36.914878 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be201eb-46d0-4f9e-b8be-f96aa04e764a admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:36.943646 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8068898d-8668-4a3c-83f2-7e58182332a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:36.955865 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481ce952-b2eb-48ea-ba50-9ed13efc571b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:36.959436 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481ce952-b2eb-48ea-ba50-9ed13efc571b service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:36.960173 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8068898d-8668-4a3c-83f2-7e58182332a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:36.961667 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8068898d-8668-4a3c-83f2-7e58182332a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:36.962140 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8068898d-8668-4a3c-83f2-7e58182332a7 admin admin] PATH_INFO: `/v3/projects/9a9e9e78b8f94d5a94cac7de2bff3d31/users/88451ae0d01b4fdc9b70bb36fda2ef3c/roles/317f725e26bf43648d8235bb1f7c4cb3` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:36.980218 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 848/1695] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:49:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 577 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:49:36.982262 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8950205a-9765-4c2a-af3c-9f8db911c3cb None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:36.982715 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8950205a-9765-4c2a-af3c-9f8db911c3cb None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:36.990323 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8950205a-9765-4c2a-af3c-9f8db911c3cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:37.035140 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-8950205a-9765-4c2a-af3c-9f8db911c3cb None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:49:37.037284 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-8950205a-9765-4c2a-af3c-9f8db911c3cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:37.041965 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8068898d-8668-4a3c-83f2-7e58182332a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a9e9e78b8f94d5a94cac7de2bff3d31, user_id=88451ae0d01b4fdc9b70bb36fda2ef3c, role_id=317f725e26bf43648d8235bb1f7c4cb3)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:37.048438 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8068898d-8668-4a3c-83f2-7e58182332a7 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:37.071675 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 849/1696] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:49:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:49:37.071675 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76575a14-cd68-4f1e-82bf-101f205b96d3 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:37.071675 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76575a14-cd68-4f1e-82bf-101f205b96d3 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:37.071675 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76575a14-cd68-4f1e-82bf-101f205b96d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:37.156493 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 848/1697] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:49:36 2022] PUT /identity/v3/projects/9a9e9e78b8f94d5a94cac7de2bff3d31/users/88451ae0d01b4fdc9b70bb36fda2ef3c/roles/317f725e26bf43648d8235bb1f7c4cb3 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:49:37.156493 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e96c20e-cb8f-4d7e-8040-520078e085fc None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:37.156493 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e96c20e-cb8f-4d7e-8040-520078e085fc None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:37.156493 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e96c20e-cb8f-4d7e-8040-520078e085fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:37.171647 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-76575a14-cd68-4f1e-82bf-101f205b96d3 None None] MFA Rules not processed for user `001117ac48b544f1adbc64f0acb988f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:49:37.177174 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-76575a14-cd68-4f1e-82bf-101f205b96d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:37.205864 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-4e96c20e-cb8f-4d7e-8040-520078e085fc None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:49:37.207469 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-4e96c20e-cb8f-4d7e-8040-520078e085fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:37.404887 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 849/1698] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:49:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:49:37.408390 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed50362-7851-4ff5-9e51-6e35451ba207 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:37.409588 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed50362-7851-4ff5-9e51-6e35451ba207 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:37.409971 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed50362-7851-4ff5-9e51-6e35451ba207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:37.419403 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 850/1699] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:49:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:49:37.421204 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76575a14-cd68-4f1e-82bf-101f205b96d3 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:37.464287 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76575a14-cd68-4f1e-82bf-101f205b96d3 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:37.483730 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130e8e12-f63c-490f-a530-804f7964e926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:37.487453 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e8e12-f63c-490f-a530-804f7964e926 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:37.487453 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e8e12-f63c-490f-a530-804f7964e926 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:37.487453 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e8e12-f63c-490f-a530-804f7964e926 admin admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:37.487453 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130e8e12-f63c-490f-a530-804f7964e926 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:49:37.487453 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130e8e12-f63c-490f-a530-804f7964e926 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:37.491736 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130e8e12-f63c-490f-a530-804f7964e926 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:37.507311 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 851/1700] 10.222.0.15 () {58 vars in 1152 bytes} [Tue May 31 14:49:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:49:37.512924 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5723df-3446-4b52-8055-2eef7fb970a7 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:37.513300 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5723df-3446-4b52-8055-2eef7fb970a7 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:37.513921 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5723df-3446-4b52-8055-2eef7fb970a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:37.534817 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-1ed50362-7851-4ff5-9e51-6e35451ba207 None None] MFA Rules not processed for user `88451ae0d01b4fdc9b70bb36fda2ef3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:49:37.542187 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-1ed50362-7851-4ff5-9e51-6e35451ba207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:37.567312 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-be5723df-3446-4b52-8055-2eef7fb970a7 None None] MFA Rules not processed for user `001117ac48b544f1adbc64f0acb988f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:49:37.569945 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-be5723df-3446-4b52-8055-2eef7fb970a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:37.605898 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 852/1701] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:49:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:49:37.608692 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5723df-3446-4b52-8055-2eef7fb970a7 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:37.626993 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:49:37.647299 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5723df-3446-4b52-8055-2eef7fb970a7 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:37.667434 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ad2efa-cbd5-486c-889f-8e8e90096bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:37.668388 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ad2efa-cbd5-486c-889f-8e8e90096bf7 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:37.668981 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ad2efa-cbd5-486c-889f-8e8e90096bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:37.670226 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ad2efa-cbd5-486c-889f-8e8e90096bf7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:37.671462 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ad2efa-cbd5-486c-889f-8e8e90096bf7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:37.676488 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ad2efa-cbd5-486c-889f-8e8e90096bf7 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:37.761044 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:49:37.810589 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 853/1702] 10.222.0.15 () {60 vars in 1152 bytes} [Tue May 31 14:49:37 2022] POST /identity/v3/projects => generated 385 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:49:37.810589 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ad2efa-cbd5-486c-889f-8e8e90096bf7 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:37.835701 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-60ad2efa-cbd5-486c-889f-8e8e90096bf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:37.953743 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 850/1703] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:49:37 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 548 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:49:37.960089 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed50362-7851-4ff5-9e51-6e35451ba207 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:38.015315 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed50362-7851-4ff5-9e51-6e35451ba207 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:38.174596 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ad2efa-cbd5-486c-889f-8e8e90096bf7 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:38.184818 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25de682-c43f-4352-b7b8-63b448508419 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57768d448e345ad8879bf29f21b48ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:38.185830 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25de682-c43f-4352-b7b8-63b448508419 service nova] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:38.186324 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25de682-c43f-4352-b7b8-63b448508419 service nova] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:38.186826 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25de682-c43f-4352-b7b8-63b448508419 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:38.254781 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de418d4f-20b9-4365-a6e5-693a974d3301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:38.255681 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de418d4f-20b9-4365-a6e5-693a974d3301 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:38.256357 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de418d4f-20b9-4365-a6e5-693a974d3301 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:38.256504 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de418d4f-20b9-4365-a6e5-693a974d3301 admin admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:38.257985 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de418d4f-20b9-4365-a6e5-693a974d3301 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:38.263691 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de418d4f-20b9-4365-a6e5-693a974d3301 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:38.349477 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25de682-c43f-4352-b7b8-63b448508419 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:38.355817 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25de682-c43f-4352-b7b8-63b448508419 service nova] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:38.374941 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 854/1704] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:49:37 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 567 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:49:38.377125 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25de682-c43f-4352-b7b8-63b448508419 service nova] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:38.381687 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-d25de682-c43f-4352-b7b8-63b448508419 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:38.411927 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25de682-c43f-4352-b7b8-63b448508419 service nova] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:38.427509 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7becc4-252f-4b58-bdcc-d3ad66b738d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57768d448e345ad8879bf29f21b48ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:38.428263 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7becc4-252f-4b58-bdcc-d3ad66b738d6 service nova] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:38.428621 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7becc4-252f-4b58-bdcc-d3ad66b738d6 service nova] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:38.428907 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7becc4-252f-4b58-bdcc-d3ad66b738d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:38.657069 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7becc4-252f-4b58-bdcc-d3ad66b738d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:38.659710 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7becc4-252f-4b58-bdcc-d3ad66b738d6 service nova] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:38.696361 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 855/1705] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:49:38 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:49:38.706659 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 851/1706] 10.222.0.15 () {60 vars in 1143 bytes} [Tue May 31 14:49:37 2022] POST /identity/v3/users => generated 293 bytes in 751 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:49:38.708185 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7becc4-252f-4b58-bdcc-d3ad66b738d6 service nova] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:38.777803 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7becc4-252f-4b58-bdcc-d3ad66b738d6 service nova] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:38.784597 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f11640-eb67-4d95-a80a-061a0361e4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:38.785912 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f11640-eb67-4d95-a80a-061a0361e4fe admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:38.785912 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f11640-eb67-4d95-a80a-061a0361e4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:38.804064 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f11640-eb67-4d95-a80a-061a0361e4fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:38.804064 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f11640-eb67-4d95-a80a-061a0361e4fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:38.806013 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f11640-eb67-4d95-a80a-061a0361e4fe admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:38.852705 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de418d4f-20b9-4365-a6e5-693a974d3301 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:38.855065 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-de418d4f-20b9-4365-a6e5-693a974d3301 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:38.870008 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 856/1707] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:49:38 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:49:38.871310 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f11640-eb67-4d95-a80a-061a0361e4fe admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:38.883890 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de418d4f-20b9-4365-a6e5-693a974d3301 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:38.912749 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:49:38.915622 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b4be8-cd76-444f-8801-df503c554fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:38.917014 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b4be8-cd76-444f-8801-df503c554fa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:38.917313 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b4be8-cd76-444f-8801-df503c554fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:38.917599 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b4be8-cd76-444f-8801-df503c554fa2 admin admin] PATH_INFO: `/v3/projects/dd5f72540cf645cda209062bf9d1e875` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:38.921366 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f11640-eb67-4d95-a80a-061a0361e4fe admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:38.924363 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371b4be8-cd76-444f-8801-df503c554fa2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd5f72540cf645cda209062bf9d1e875)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:38.931612 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371b4be8-cd76-444f-8801-df503c554fa2 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:38.943858 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35502eb4-59de-4ec4-824e-07adee758d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:38.944912 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35502eb4-59de-4ec4-824e-07adee758d30 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:38.946466 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35502eb4-59de-4ec4-824e-07adee758d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:38.951969 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35502eb4-59de-4ec4-824e-07adee758d30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:38.967609 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35502eb4-59de-4ec4-824e-07adee758d30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:38.969292 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35502eb4-59de-4ec4-824e-07adee758d30 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:39.011568 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 857/1708] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:49:38 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:49:39.014971 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35502eb4-59de-4ec4-824e-07adee758d30 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:39.017675 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-35502eb4-59de-4ec4-824e-07adee758d30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:39.055003 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35502eb4-59de-4ec4-824e-07adee758d30 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:39.083280 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127df2dd-76a7-4e38-bdf3-7169d0f0e4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:39.087834 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127df2dd-76a7-4e38-bdf3-7169d0f0e4c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:39.090981 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127df2dd-76a7-4e38-bdf3-7169d0f0e4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:39.092255 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127df2dd-76a7-4e38-bdf3-7169d0f0e4c6 admin admin] PATH_INFO: `/v3/projects/0cf02eb3ab3844fba9b24195be70892c` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:39.095999 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127df2dd-76a7-4e38-bdf3-7169d0f0e4c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cf02eb3ab3844fba9b24195be70892c)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:39.106522 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127df2dd-76a7-4e38-bdf3-7169d0f0e4c6 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:39.240177 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-371b4be8-cd76-444f-8801-df503c554fa2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd5f72540cf645cda209062bf9d1e875', 'request_id': 'req-371b4be8-cd76-444f-8801-df503c554fa2'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:39.287399 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-371b4be8-cd76-444f-8801-df503c554fa2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd5f72540cf645cda209062bf9d1e875', 'request_id': 'req-371b4be8-cd76-444f-8801-df503c554fa2'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:39.305590 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-127df2dd-76a7-4e38-bdf3-7169d0f0e4c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cf02eb3ab3844fba9b24195be70892c', 'request_id': 'req-127df2dd-76a7-4e38-bdf3-7169d0f0e4c6'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:39.344583 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-371b4be8-cd76-444f-8801-df503c554fa2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd5f72540cf645cda209062bf9d1e875', 'request_id': 'req-371b4be8-cd76-444f-8801-df503c554fa2'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:39.373979 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-371b4be8-cd76-444f-8801-df503c554fa2 admin admin] The token cache is being invalidate because project dd5f72540cf645cda209062bf9d1e875 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 14:49:39.374387 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-371b4be8-cd76-444f-8801-df503c554fa2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:39.377571 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-371b4be8-cd76-444f-8801-df503c554fa2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:39.384412 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 852/1709] 10.222.0.15 () {58 vars in 1232 bytes} [Tue May 31 14:49:38 2022] DELETE /identity/v3/projects/dd5f72540cf645cda209062bf9d1e875 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:49:39.385475 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b4be8-cd76-444f-8801-df503c554fa2 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:39.390067 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-127df2dd-76a7-4e38-bdf3-7169d0f0e4c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cf02eb3ab3844fba9b24195be70892c', 'request_id': 'req-127df2dd-76a7-4e38-bdf3-7169d0f0e4c6'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:39.399118 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-371b4be8-cd76-444f-8801-df503c554fa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:39.402564 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-127df2dd-76a7-4e38-bdf3-7169d0f0e4c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cf02eb3ab3844fba9b24195be70892c', 'request_id': 'req-127df2dd-76a7-4e38-bdf3-7169d0f0e4c6'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:39.455444 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-127df2dd-76a7-4e38-bdf3-7169d0f0e4c6 admin admin] The token cache is being invalidate because project 0cf02eb3ab3844fba9b24195be70892c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80503) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 14:49:39.456107 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-127df2dd-76a7-4e38-bdf3-7169d0f0e4c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:39.463533 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-127df2dd-76a7-4e38-bdf3-7169d0f0e4c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:39.469704 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 858/1710] 10.222.0.15 () {58 vars in 1232 bytes} [Tue May 31 14:49:39 2022] DELETE /identity/v3/projects/0cf02eb3ab3844fba9b24195be70892c => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:49:39.477061 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127df2dd-76a7-4e38-bdf3-7169d0f0e4c6 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:39.477061 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-127df2dd-76a7-4e38-bdf3-7169d0f0e4c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:39.654832 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:49:39.710404 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b4be8-cd76-444f-8801-df503c554fa2 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:39.775438 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127df2dd-76a7-4e38-bdf3-7169d0f0e4c6 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:39.797373 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0c33fb-c0de-4c22-bb53-407ec9842808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:39.805367 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c33fb-c0de-4c22-bb53-407ec9842808 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:39.805752 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c33fb-c0de-4c22-bb53-407ec9842808 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:39.806049 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c33fb-c0de-4c22-bb53-407ec9842808 admin admin] PATH_INFO: `/v3/users/30dc38419578438f8f2ef53487062b98` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:39.815993 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0c33fb-c0de-4c22-bb53-407ec9842808 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30dc38419578438f8f2ef53487062b98)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:39.818084 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0c33fb-c0de-4c22-bb53-407ec9842808 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:39.884964 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed25234-07bb-403c-869c-ac42ab6d7ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:39.886503 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed25234-07bb-403c-869c-ac42ab6d7ab5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:39.887030 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed25234-07bb-403c-869c-ac42ab6d7ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:39.887938 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed25234-07bb-403c-869c-ac42ab6d7ab5 admin admin] PATH_INFO: `/v3/projects/2f03c77f2cbd43d48f163d2b7c5c1818/users/2ed36f3574044b9780fdb803dd29fdb1/roles/317f725e26bf43648d8235bb1f7c4cb3` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:39.953033 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed25234-07bb-403c-869c-ac42ab6d7ab5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f03c77f2cbd43d48f163d2b7c5c1818, user_id=2ed36f3574044b9780fdb803dd29fdb1, role_id=317f725e26bf43648d8235bb1f7c4cb3)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:39.968689 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed25234-07bb-403c-869c-ac42ab6d7ab5 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:40.069987 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 853/1711] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:49:39 2022] PUT /identity/v3/projects/2f03c77f2cbd43d48f163d2b7c5c1818/users/2ed36f3574044b9780fdb803dd29fdb1/roles/317f725e26bf43648d8235bb1f7c4cb3 => generated 0 bytes in 672 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:49:40.071658 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed25234-07bb-403c-869c-ac42ab6d7ab5 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:40.077763 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-fed25234-07bb-403c-869c-ac42ab6d7ab5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:40.174780 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-6f0c33fb-c0de-4c22-bb53-407ec9842808 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30dc38419578438f8f2ef53487062b98'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:40.281778 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-6f0c33fb-c0de-4c22-bb53-407ec9842808 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30dc38419578438f8f2ef53487062b98'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:40.282831 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-6f0c33fb-c0de-4c22-bb53-407ec9842808 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30dc38419578438f8f2ef53487062b98'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:40.291558 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-6f0c33fb-c0de-4c22-bb53-407ec9842808 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30dc38419578438f8f2ef53487062b98'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:40.295232 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-6f0c33fb-c0de-4c22-bb53-407ec9842808 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30dc38419578438f8f2ef53487062b98'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:40.369294 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:49:40.379902 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed25234-07bb-403c-869c-ac42ab6d7ab5 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:40.384779 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 859/1712] 10.222.0.15 () {58 vars in 1223 bytes} [Tue May 31 14:49:39 2022] DELETE /identity/v3/users/30dc38419578438f8f2ef53487062b98 => generated 0 bytes in 913 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:49:40.384779 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ff923-40e6-438b-a2bc-460bf88031af None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:40.393947 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ff923-40e6-438b-a2bc-460bf88031af None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:40.394299 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0ff923-40e6-438b-a2bc-460bf88031af None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:40.395833 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 860/1713] 10.222.0.15 () {54 vars in 921 bytes} [Tue May 31 14:49:40 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:49:40.410942 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f9e9c1-a877-41eb-a6dc-229ccc3e8f33 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:40.411291 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f9e9c1-a877-41eb-a6dc-229ccc3e8f33 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:40.411513 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f9e9c1-a877-41eb-a6dc-229ccc3e8f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:40.575047 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-f7f9e9c1-a877-41eb-a6dc-229ccc3e8f33 None None] MFA Rules not processed for user `2ed36f3574044b9780fdb803dd29fdb1`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:49:40.576699 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-f7f9e9c1-a877-41eb-a6dc-229ccc3e8f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:40.666388 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f195db-5145-486a-8ac1-87fa4c76c3ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:40.667928 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f195db-5145-486a-8ac1-87fa4c76c3ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:40.668376 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f195db-5145-486a-8ac1-87fa4c76c3ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:40.668811 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f195db-5145-486a-8ac1-87fa4c76c3ca admin admin] PATH_INFO: `/v3/users/fcbd0156473a4bd58caa3273f8365821` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:40.671150 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f195db-5145-486a-8ac1-87fa4c76c3ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcbd0156473a4bd58caa3273f8365821)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:40.677120 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f195db-5145-486a-8ac1-87fa4c76c3ca admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:40.833494 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 861/1714] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:49:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 437 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:49:40.836936 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d4b4e4-a60b-4745-929c-13e412d01972 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:40.837443 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d4b4e4-a60b-4745-929c-13e412d01972 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:40.837947 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d4b4e4-a60b-4745-929c-13e412d01972 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:40.845408 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 862/1715] 10.222.0.15 () {54 vars in 912 bytes} [Tue May 31 14:49:40 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:49:40.847356 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f37df9-af63-473a-9c00-8a9e4c9a4ed7 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:40.847809 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f37df9-af63-473a-9c00-8a9e4c9a4ed7 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:40.848239 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f37df9-af63-473a-9c00-8a9e4c9a4ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:40.887663 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-34f37df9-af63-473a-9c00-8a9e4c9a4ed7 None None] MFA Rules not processed for user `b57768d448e345ad8879bf29f21b48ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:49:40.890017 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-34f37df9-af63-473a-9c00-8a9e4c9a4ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:40.952190 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:49:40.998987 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-86f195db-5145-486a-8ac1-87fa4c76c3ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcbd0156473a4bd58caa3273f8365821'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:41.026121 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-86f195db-5145-486a-8ac1-87fa4c76c3ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcbd0156473a4bd58caa3273f8365821'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:41.026947 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-86f195db-5145-486a-8ac1-87fa4c76c3ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcbd0156473a4bd58caa3273f8365821'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:41.028279 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-86f195db-5145-486a-8ac1-87fa4c76c3ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcbd0156473a4bd58caa3273f8365821'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:41.089282 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-86f195db-5145-486a-8ac1-87fa4c76c3ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcbd0156473a4bd58caa3273f8365821'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:41.142151 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 863/1716] 10.222.0.15 () {58 vars in 1018 bytes} [Tue May 31 14:49:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:49:41.147388 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f37df9-af63-473a-9c00-8a9e4c9a4ed7 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:41.147388 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-34f37df9-af63-473a-9c00-8a9e4c9a4ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:41.175330 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f37df9-af63-473a-9c00-8a9e4c9a4ed7 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:41.192046 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c04a0a7-4b50-4751-b9f3-77a5344506e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:41.192992 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c04a0a7-4b50-4751-b9f3-77a5344506e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:41.193358 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c04a0a7-4b50-4751-b9f3-77a5344506e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:41.193769 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c04a0a7-4b50-4751-b9f3-77a5344506e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:41.194686 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c04a0a7-4b50-4751-b9f3-77a5344506e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:41.196850 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c04a0a7-4b50-4751-b9f3-77a5344506e4 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:41.206688 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 854/1717] 10.222.0.15 () {58 vars in 1223 bytes} [Tue May 31 14:49:40 2022] DELETE /identity/v3/users/fcbd0156473a4bd58caa3273f8365821 => generated 0 bytes in 1133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:49:41.208457 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ece148-0963-498b-8b68-54a098d43fc9 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:41.208934 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ece148-0963-498b-8b68-54a098d43fc9 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:41.210567 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ece148-0963-498b-8b68-54a098d43fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:41.288046 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-25ece148-0963-498b-8b68-54a098d43fc9 None None] MFA Rules not processed for user `c5262f4b9b2948fdb3b4ab504311453b`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:49:41.290173 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-25ece148-0963-498b-8b68-54a098d43fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:41.320825 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 864/1718] 10.222.0.15 () {60 vars in 1152 bytes} [Tue May 31 14:49:41 2022] POST /identity/v3/projects => generated 385 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:49:41.322279 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c04a0a7-4b50-4751-b9f3-77a5344506e4 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:41.325663 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-1c04a0a7-4b50-4751-b9f3-77a5344506e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:41.488224 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:49:41.493553 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 855/1719] 10.222.0.15 () {58 vars in 1009 bytes} [Tue May 31 14:49:41 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:49:41.495451 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ece148-0963-498b-8b68-54a098d43fc9 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:41.501575 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c04a0a7-4b50-4751-b9f3-77a5344506e4 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:41.510176 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d94e96a-bbe8-4d82-832b-e570e90a83af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:41.511366 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d94e96a-bbe8-4d82-832b-e570e90a83af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:41.511723 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d94e96a-bbe8-4d82-832b-e570e90a83af admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:41.512133 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d94e96a-bbe8-4d82-832b-e570e90a83af admin admin] PATH_INFO: `/v3/users/88451ae0d01b4fdc9b70bb36fda2ef3c` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:41.513768 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d94e96a-bbe8-4d82-832b-e570e90a83af admin admin] RBAC: Authorizing `identity:delete_user(user_id=88451ae0d01b4fdc9b70bb36fda2ef3c)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:41.516266 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d94e96a-bbe8-4d82-832b-e570e90a83af admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:41.765273 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ece148-0963-498b-8b68-54a098d43fc9 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:41.765273 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6948eb-60a0-44a9-ad4d-78249b1bdf9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:41.765273 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6948eb-60a0-44a9-ad4d-78249b1bdf9f admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:41.765273 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6948eb-60a0-44a9-ad4d-78249b1bdf9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:41.766325 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6948eb-60a0-44a9-ad4d-78249b1bdf9f admin admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:41.766325 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6948eb-60a0-44a9-ad4d-78249b1bdf9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:41.766325 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6948eb-60a0-44a9-ad4d-78249b1bdf9f admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:41.938841 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-9d94e96a-bbe8-4d82-832b-e570e90a83af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88451ae0d01b4fdc9b70bb36fda2ef3c'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:41.957918 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 856/1720] 10.222.0.15 () {60 vars in 1143 bytes} [Tue May 31 14:49:41 2022] POST /identity/v3/users => generated 299 bytes in 453 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:49:41.957918 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6948eb-60a0-44a9-ad4d-78249b1bdf9f admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:41.960213 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-4b6948eb-60a0-44a9-ad4d-78249b1bdf9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:42.064388 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-9d94e96a-bbe8-4d82-832b-e570e90a83af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88451ae0d01b4fdc9b70bb36fda2ef3c'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:42.065168 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-9d94e96a-bbe8-4d82-832b-e570e90a83af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88451ae0d01b4fdc9b70bb36fda2ef3c'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:42.078767 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:49:42.080643 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-9d94e96a-bbe8-4d82-832b-e570e90a83af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88451ae0d01b4fdc9b70bb36fda2ef3c'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:42.081540 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-9d94e96a-bbe8-4d82-832b-e570e90a83af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88451ae0d01b4fdc9b70bb36fda2ef3c'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:42.123531 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 865/1721] 10.222.0.15 () {58 vars in 1223 bytes} [Tue May 31 14:49:41 2022] DELETE /identity/v3/users/88451ae0d01b4fdc9b70bb36fda2ef3c => generated 0 bytes in 802 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:49:42.126338 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d94e96a-bbe8-4d82-832b-e570e90a83af admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:42.132610 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-9d94e96a-bbe8-4d82-832b-e570e90a83af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:42.179658 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6948eb-60a0-44a9-ad4d-78249b1bdf9f admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:42.312481 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d94e96a-bbe8-4d82-832b-e570e90a83af admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:42.318690 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7193352d-5eb1-48fa-b4de-a8905b9f7367 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:42.319465 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7193352d-5eb1-48fa-b4de-a8905b9f7367 service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:42.319828 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7193352d-5eb1-48fa-b4de-a8905b9f7367 service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:42.320296 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7193352d-5eb1-48fa-b4de-a8905b9f7367 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:42.326178 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-7193352d-5eb1-48fa-b4de-a8905b9f7367 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:42.345320 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff1e374-bef3-4823-986e-ea6134e73588 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57768d448e345ad8879bf29f21b48ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:42.346212 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff1e374-bef3-4823-986e-ea6134e73588 service nova] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:42.347973 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff1e374-bef3-4823-986e-ea6134e73588 service nova] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:42.348422 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff1e374-bef3-4823-986e-ea6134e73588 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:42.355306 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-4ff1e374-bef3-4823-986e-ea6134e73588 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:42.364279 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7193352d-5eb1-48fa-b4de-a8905b9f7367 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:42.365887 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7193352d-5eb1-48fa-b4de-a8905b9f7367 service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:42.373630 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff1e374-bef3-4823-986e-ea6134e73588 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:42.375919 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff1e374-bef3-4823-986e-ea6134e73588 service nova] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:42.379717 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 866/1722] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:49:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:49:42.381902 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b1b41-7daf-4fd5-b2fd-c7e67aab325b None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:42.382683 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b1b41-7daf-4fd5-b2fd-c7e67aab325b None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:42.385819 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b1b41-7daf-4fd5-b2fd-c7e67aab325b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:42.413483 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 857/1723] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:49:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:49:42.426110 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff1e374-bef3-4823-986e-ea6134e73588 service nova] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:42.432117 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-4ff1e374-bef3-4823-986e-ea6134e73588 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:42.434161 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-ce4b1b41-7daf-4fd5-b2fd-c7e67aab325b None None] MFA Rules not processed for user `3ba53ede9ae9426f9f89c885aea9e32e`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:49:42.452184 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-ce4b1b41-7daf-4fd5-b2fd-c7e67aab325b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:42.585602 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff1e374-bef3-4823-986e-ea6134e73588 service nova] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:42.592707 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bca7bcb-8613-45d9-a06d-d33e723fa468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:42.593540 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bca7bcb-8613-45d9-a06d-d33e723fa468 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:42.593917 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bca7bcb-8613-45d9-a06d-d33e723fa468 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:42.594212 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bca7bcb-8613-45d9-a06d-d33e723fa468 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:42.596522 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bca7bcb-8613-45d9-a06d-d33e723fa468 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:42.598845 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bca7bcb-8613-45d9-a06d-d33e723fa468 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:42.619094 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 858/1724] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:49:42 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:49:42.620729 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11040361-5735-49fd-8ba4-44269af860f3 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:42.621191 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11040361-5735-49fd-8ba4-44269af860f3 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:42.621622 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11040361-5735-49fd-8ba4-44269af860f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:42.641594 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-11040361-5735-49fd-8ba4-44269af860f3 None None] MFA Rules not processed for user `ec0bc78fb2d849cb89fec3420844d738`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:49:42.643266 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-11040361-5735-49fd-8ba4-44269af860f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:42.686044 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 867/1725] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:49:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:49:42.687063 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4b1b41-7daf-4fd5-b2fd-c7e67aab325b None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:42.693585 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-ce4b1b41-7daf-4fd5-b2fd-c7e67aab325b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:42.742101 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 859/1726] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:49:42 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:49:42.743776 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5106e9a3-07ea-40b6-9f3a-f73fb58863b8 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:42.745818 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4b1b41-7daf-4fd5-b2fd-c7e67aab325b None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:42.746871 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5106e9a3-07ea-40b6-9f3a-f73fb58863b8 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:42.748172 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5106e9a3-07ea-40b6-9f3a-f73fb58863b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:42.757058 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3cc3a8-594c-4bdd-b8d8-adc14a79d2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:42.757981 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3cc3a8-594c-4bdd-b8d8-adc14a79d2e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:42.758885 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3cc3a8-594c-4bdd-b8d8-adc14a79d2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:42.759172 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3cc3a8-594c-4bdd-b8d8-adc14a79d2e7 admin admin] PATH_INFO: `/v3/projects/47a2c3ae46c94033a24d782997df6c30` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:42.765687 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3cc3a8-594c-4bdd-b8d8-adc14a79d2e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47a2c3ae46c94033a24d782997df6c30)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:42.767656 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3cc3a8-594c-4bdd-b8d8-adc14a79d2e7 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:42.769910 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:49:42.795128 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-5106e9a3-07ea-40b6-9f3a-f73fb58863b8 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:49:42.796789 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-5106e9a3-07ea-40b6-9f3a-f73fb58863b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:42.824007 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 860/1727] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:49:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:49:42.824007 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5106e9a3-07ea-40b6-9f3a-f73fb58863b8 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:42.834048 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-5106e9a3-07ea-40b6-9f3a-f73fb58863b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:42.850957 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:49:42.858462 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5106e9a3-07ea-40b6-9f3a-f73fb58863b8 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:42.873714 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0132b98-b798-4763-8831-a67c9f1b8453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:42.874925 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0132b98-b798-4763-8831-a67c9f1b8453 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:42.879780 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0132b98-b798-4763-8831-a67c9f1b8453 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:42.879780 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0132b98-b798-4763-8831-a67c9f1b8453 admin admin] PATH_INFO: `/v3/projects/71d5afdc917745e689994e2dcaffdf27` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:42.879780 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0132b98-b798-4763-8831-a67c9f1b8453 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71d5afdc917745e689994e2dcaffdf27)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:42.886447 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0132b98-b798-4763-8831-a67c9f1b8453 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:42.908434 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-aa3cc3a8-594c-4bdd-b8d8-adc14a79d2e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47a2c3ae46c94033a24d782997df6c30', 'request_id': 'req-aa3cc3a8-594c-4bdd-b8d8-adc14a79d2e7'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:42.993921 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-aa3cc3a8-594c-4bdd-b8d8-adc14a79d2e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47a2c3ae46c94033a24d782997df6c30', 'request_id': 'req-aa3cc3a8-594c-4bdd-b8d8-adc14a79d2e7'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:43.007304 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-aa3cc3a8-594c-4bdd-b8d8-adc14a79d2e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47a2c3ae46c94033a24d782997df6c30', 'request_id': 'req-aa3cc3a8-594c-4bdd-b8d8-adc14a79d2e7'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:43.078463 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-aa3cc3a8-594c-4bdd-b8d8-adc14a79d2e7 admin admin] The token cache is being invalidate because project 47a2c3ae46c94033a24d782997df6c30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80503) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 14:49:43.082170 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-aa3cc3a8-594c-4bdd-b8d8-adc14a79d2e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:43.085618 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-aa3cc3a8-594c-4bdd-b8d8-adc14a79d2e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:43.085994 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-b0132b98-b798-4763-8831-a67c9f1b8453 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71d5afdc917745e689994e2dcaffdf27', 'request_id': 'req-b0132b98-b798-4763-8831-a67c9f1b8453'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:43.094100 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 868/1728] 10.222.0.15 () {58 vars in 1232 bytes} [Tue May 31 14:49:42 2022] DELETE /identity/v3/projects/47a2c3ae46c94033a24d782997df6c30 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:49:43.096792 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3cc3a8-594c-4bdd-b8d8-adc14a79d2e7 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:43.104114 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-aa3cc3a8-594c-4bdd-b8d8-adc14a79d2e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:43.115559 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-b0132b98-b798-4763-8831-a67c9f1b8453 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71d5afdc917745e689994e2dcaffdf27', 'request_id': 'req-b0132b98-b798-4763-8831-a67c9f1b8453'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:43.197134 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-b0132b98-b798-4763-8831-a67c9f1b8453 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71d5afdc917745e689994e2dcaffdf27', 'request_id': 'req-b0132b98-b798-4763-8831-a67c9f1b8453'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:43.228176 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-b0132b98-b798-4763-8831-a67c9f1b8453 admin admin] The token cache is being invalidate because project 71d5afdc917745e689994e2dcaffdf27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 14:49:43.228628 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-b0132b98-b798-4763-8831-a67c9f1b8453 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:43.238428 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-b0132b98-b798-4763-8831-a67c9f1b8453 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:43.240579 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 861/1729] 10.222.0.15 () {58 vars in 1232 bytes} [Tue May 31 14:49:42 2022] DELETE /identity/v3/projects/71d5afdc917745e689994e2dcaffdf27 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:49:43.241568 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0132b98-b798-4763-8831-a67c9f1b8453 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:43.243555 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-b0132b98-b798-4763-8831-a67c9f1b8453 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:43.315254 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3cc3a8-594c-4bdd-b8d8-adc14a79d2e7 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:43.384828 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0132b98-b798-4763-8831-a67c9f1b8453 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:43.397595 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03711153-55c3-49d9-99ab-e008ec2822e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:43.398394 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03711153-55c3-49d9-99ab-e008ec2822e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:43.398781 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03711153-55c3-49d9-99ab-e008ec2822e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:43.399140 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03711153-55c3-49d9-99ab-e008ec2822e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:43.401242 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-03711153-55c3-49d9-99ab-e008ec2822e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:43.500116 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f788b03-7bc5-42b3-90f7-d1cef0e9a2df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:43.502101 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f788b03-7bc5-42b3-90f7-d1cef0e9a2df admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:43.506603 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f788b03-7bc5-42b3-90f7-d1cef0e9a2df admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:43.506603 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f788b03-7bc5-42b3-90f7-d1cef0e9a2df admin admin] PATH_INFO: `/v3/projects/a1bc4be8e46a4006a7ab97190592a3ab/users/4daee4540b2a4024bcd798225c74d581/roles/76c53e2c353644f885028a0226c06146` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:43.535606 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f788b03-7bc5-42b3-90f7-d1cef0e9a2df admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1bc4be8e46a4006a7ab97190592a3ab, user_id=4daee4540b2a4024bcd798225c74d581, role_id=76c53e2c353644f885028a0226c06146)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:43.559190 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f788b03-7bc5-42b3-90f7-d1cef0e9a2df admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:43.566723 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03711153-55c3-49d9-99ab-e008ec2822e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:43.569546 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03711153-55c3-49d9-99ab-e008ec2822e6 service neutron] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:43.598845 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 862/1730] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:49:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:49:43.602281 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03711153-55c3-49d9-99ab-e008ec2822e6 service neutron] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:43.621761 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-03711153-55c3-49d9-99ab-e008ec2822e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:43.648326 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 869/1731] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:49:43 2022] PUT /identity/v3/projects/a1bc4be8e46a4006a7ab97190592a3ab/users/4daee4540b2a4024bcd798225c74d581/roles/76c53e2c353644f885028a0226c06146 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:49:43.650194 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb8c301-5f3a-41a1-b1b5-9d9807ac3b89 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:43.650682 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb8c301-5f3a-41a1-b1b5-9d9807ac3b89 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:43.651244 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb8c301-5f3a-41a1-b1b5-9d9807ac3b89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:43.705302 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-feb8c301-5f3a-41a1-b1b5-9d9807ac3b89 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:49:43.706754 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-feb8c301-5f3a-41a1-b1b5-9d9807ac3b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:43.736182 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:49:43.804402 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:49:43.821318 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 870/1732] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:49:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:49:43.822677 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8696b83b-1cd1-4f5f-b167-1be757e457a4 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:43.822976 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8696b83b-1cd1-4f5f-b167-1be757e457a4 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:43.823260 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8696b83b-1cd1-4f5f-b167-1be757e457a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:43.874199 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-8696b83b-1cd1-4f5f-b167-1be757e457a4 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:49:43.875408 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-8696b83b-1cd1-4f5f-b167-1be757e457a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:43.891951 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 871/1733] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:49:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:49:43.900036 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8696b83b-1cd1-4f5f-b167-1be757e457a4 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:43.902399 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-8696b83b-1cd1-4f5f-b167-1be757e457a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:43.910275 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03711153-55c3-49d9-99ab-e008ec2822e6 service neutron] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:43.949148 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8696b83b-1cd1-4f5f-b167-1be757e457a4 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:43.979747 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56c3b40-cf10-44ee-bbf0-0ca46c968ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:43.980381 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c3b40-cf10-44ee-bbf0-0ca46c968ebf admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:43.980750 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c3b40-cf10-44ee-bbf0-0ca46c968ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:43.981053 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c3b40-cf10-44ee-bbf0-0ca46c968ebf admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:43.982466 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56c3b40-cf10-44ee-bbf0-0ca46c968ebf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:43.984703 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56c3b40-cf10-44ee-bbf0-0ca46c968ebf admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:44.000769 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 872/1734] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:49:43 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:49:44.002891 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d6ac90-e10e-4dd0-885e-0456af168a8a None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:44.003363 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d6ac90-e10e-4dd0-885e-0456af168a8a None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:44.004020 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d6ac90-e10e-4dd0-885e-0456af168a8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:44.063783 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07bd141-02aa-4271-97c9-8cfbd203e2d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57768d448e345ad8879bf29f21b48ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:44.064798 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07bd141-02aa-4271-97c9-8cfbd203e2d9 service nova] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:44.065277 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07bd141-02aa-4271-97c9-8cfbd203e2d9 service nova] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:44.065738 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07bd141-02aa-4271-97c9-8cfbd203e2d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:44.066762 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-98d6ac90-e10e-4dd0-885e-0456af168a8a None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:49:44.067981 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-98d6ac90-e10e-4dd0-885e-0456af168a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:44.068801 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-c07bd141-02aa-4271-97c9-8cfbd203e2d9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:44.098714 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 873/1735] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:49:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:49:44.104956 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a8aaf0-e514-4b59-8a15-cb6ab0d1b0ec None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:44.105758 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a8aaf0-e514-4b59-8a15-cb6ab0d1b0ec None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:44.105864 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a8aaf0-e514-4b59-8a15-cb6ab0d1b0ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:44.144377 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-e7a8aaf0-e514-4b59-8a15-cb6ab0d1b0ec None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:49:44.144868 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-e7a8aaf0-e514-4b59-8a15-cb6ab0d1b0ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:44.175950 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 874/1736] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:49:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:49:44.177919 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a8aaf0-e514-4b59-8a15-cb6ab0d1b0ec None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:44.191837 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07bd141-02aa-4271-97c9-8cfbd203e2d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:44.194693 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07bd141-02aa-4271-97c9-8cfbd203e2d9 service nova] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:44.207282 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 863/1737] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:49:43 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 608 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:49:44.208559 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07bd141-02aa-4271-97c9-8cfbd203e2d9 service nova] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:44.229267 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a8aaf0-e514-4b59-8a15-cb6ab0d1b0ec None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:44.235400 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07bd141-02aa-4271-97c9-8cfbd203e2d9 service nova] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:44.237024 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d84621-dd99-43b3-a7ea-b9d5949abb06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:44.238107 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d84621-dd99-43b3-a7ea-b9d5949abb06 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:44.238648 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d84621-dd99-43b3-a7ea-b9d5949abb06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:44.239264 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d84621-dd99-43b3-a7ea-b9d5949abb06 admin admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:44.240356 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d84621-dd99-43b3-a7ea-b9d5949abb06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:49:44.241006 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d84621-dd99-43b3-a7ea-b9d5949abb06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:44.241673 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d22e76-ff2e-4266-8149-04f76fbcdbd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:44.243469 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d84621-dd99-43b3-a7ea-b9d5949abb06 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:44.244506 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d22e76-ff2e-4266-8149-04f76fbcdbd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:44.244865 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d22e76-ff2e-4266-8149-04f76fbcdbd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:44.246889 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d22e76-ff2e-4266-8149-04f76fbcdbd4 admin admin] PATH_INFO: `/v3/projects/a1bc4be8e46a4006a7ab97190592a3ab/users/4daee4540b2a4024bcd798225c74d581/roles/76c53e2c353644f885028a0226c06146` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:44.256400 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d22e76-ff2e-4266-8149-04f76fbcdbd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1bc4be8e46a4006a7ab97190592a3ab, user_id=4daee4540b2a4024bcd798225c74d581, role_id=76c53e2c353644f885028a0226c06146)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:44.264189 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 864/1738] 10.222.0.15 () {58 vars in 1152 bytes} [Tue May 31 14:49:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:49:44.264878 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d22e76-ff2e-4266-8149-04f76fbcdbd4 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:44.265574 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d84621-dd99-43b3-a7ea-b9d5949abb06 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:44.281195 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d84621-dd99-43b3-a7ea-b9d5949abb06 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:44.301247 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 875/1739] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:49:44 2022] PUT /identity/v3/projects/a1bc4be8e46a4006a7ab97190592a3ab/users/4daee4540b2a4024bcd798225c74d581/roles/76c53e2c353644f885028a0226c06146 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:49:44.302606 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d22e76-ff2e-4266-8149-04f76fbcdbd4 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:44.428800 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e649ca-afa2-4722-ab21-e87cccde06b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:44.431539 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e649ca-afa2-4722-ab21-e87cccde06b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:44.432173 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e649ca-afa2-4722-ab21-e87cccde06b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:44.432650 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e649ca-afa2-4722-ab21-e87cccde06b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:44.435519 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e649ca-afa2-4722-ab21-e87cccde06b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:49:44.441084 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e649ca-afa2-4722-ab21-e87cccde06b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:44.441084 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e649ca-afa2-4722-ab21-e87cccde06b1 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:44.441798 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:49:44.501725 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d22e76-ff2e-4266-8149-04f76fbcdbd4 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:44.510197 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 865/1740] 10.222.0.15 () {58 vars in 1152 bytes} [Tue May 31 14:49:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:49:44.512433 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef79d6b4-da42-47c4-991f-2911f8806718 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:44.513412 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef79d6b4-da42-47c4-991f-2911f8806718 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:44.514222 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef79d6b4-da42-47c4-991f-2911f8806718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:44.516870 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af66ed21-6b8d-4f1f-af49-c3beef68f81f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:44.519116 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af66ed21-6b8d-4f1f-af49-c3beef68f81f admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:44.519631 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af66ed21-6b8d-4f1f-af49-c3beef68f81f admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:44.522334 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af66ed21-6b8d-4f1f-af49-c3beef68f81f admin admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:44.525178 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af66ed21-6b8d-4f1f-af49-c3beef68f81f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:44.529518 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af66ed21-6b8d-4f1f-af49-c3beef68f81f admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:44.582718 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-ef79d6b4-da42-47c4-991f-2911f8806718 None None] MFA Rules not processed for user `4daee4540b2a4024bcd798225c74d581`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:49:44.588992 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-ef79d6b4-da42-47c4-991f-2911f8806718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:44.717511 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 876/1741] 10.222.0.15 () {60 vars in 1152 bytes} [Tue May 31 14:49:44 2022] POST /identity/v3/projects => generated 371 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:49:44.720703 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af66ed21-6b8d-4f1f-af49-c3beef68f81f admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:44.907645 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 866/1742] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:49:44 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 393 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:49:44.907645 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef79d6b4-da42-47c4-991f-2911f8806718 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:44.914961 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af66ed21-6b8d-4f1f-af49-c3beef68f81f admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:44.934253 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec06e2ed-2da4-4f4b-9c47-2b975fd07c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:44.935567 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec06e2ed-2da4-4f4b-9c47-2b975fd07c72 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:44.937720 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec06e2ed-2da4-4f4b-9c47-2b975fd07c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:44.940205 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec06e2ed-2da4-4f4b-9c47-2b975fd07c72 admin admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:44.943023 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec06e2ed-2da4-4f4b-9c47-2b975fd07c72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:44.948590 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef79d6b4-da42-47c4-991f-2911f8806718 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:44.959304 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec06e2ed-2da4-4f4b-9c47-2b975fd07c72 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:44.968746 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:49:45.018108 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796f142e-bf81-4ed9-bc99-f06f50d67d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:45.025973 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796f142e-bf81-4ed9-bc99-f06f50d67d1a admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:45.027365 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796f142e-bf81-4ed9-bc99-f06f50d67d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:45.027654 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796f142e-bf81-4ed9-bc99-f06f50d67d1a admin admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:45.028541 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796f142e-bf81-4ed9-bc99-f06f50d67d1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:45.038930 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796f142e-bf81-4ed9-bc99-f06f50d67d1a admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:45.076897 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 877/1743] 10.222.0.15 () {60 vars in 1152 bytes} [Tue May 31 14:49:44 2022] POST /identity/v3/projects => generated 357 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:49:45.078363 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29281a49-53c6-40ae-ab7c-724f5847e4ab None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:45.078713 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29281a49-53c6-40ae-ab7c-724f5847e4ab None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:45.079002 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29281a49-53c6-40ae-ab7c-724f5847e4ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:45.158111 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-29281a49-53c6-40ae-ab7c-724f5847e4ab None None] MFA Rules not processed for user `001117ac48b544f1adbc64f0acb988f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:49:45.162898 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-29281a49-53c6-40ae-ab7c-724f5847e4ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:45.171862 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 867/1744] 10.222.0.15 () {60 vars in 1143 bytes} [Tue May 31 14:49:44 2022] POST /identity/v3/users => generated 286 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:49:45.172559 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796f142e-bf81-4ed9-bc99-f06f50d67d1a admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:45.177588 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-796f142e-bf81-4ed9-bc99-f06f50d67d1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:45.358376 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796f142e-bf81-4ed9-bc99-f06f50d67d1a admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:45.404353 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 878/1745] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:49:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:49:45.404353 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29281a49-53c6-40ae-ab7c-724f5847e4ab None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:45.549407 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1d1ccc-668e-4a67-a6af-a17be77a4b52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afbf718dcd9b4741a926b0a2321bd53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:45.551528 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d1ccc-668e-4a67-a6af-a17be77a4b52 service cinder] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:45.553186 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d1ccc-668e-4a67-a6af-a17be77a4b52 service cinder] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:45.553959 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d1ccc-668e-4a67-a6af-a17be77a4b52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:45.590294 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29281a49-53c6-40ae-ab7c-724f5847e4ab None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:45.634962 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8b891a-5630-44e9-8826-2b3a73dc94e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:45.636012 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b891a-5630-44e9-8826-2b3a73dc94e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:45.637830 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b891a-5630-44e9-8826-2b3a73dc94e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:45.639693 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b891a-5630-44e9-8826-2b3a73dc94e1 admin admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:45.640667 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8b891a-5630-44e9-8826-2b3a73dc94e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:45.644130 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8b891a-5630-44e9-8826-2b3a73dc94e1 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:45.652233 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:49:45.708855 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1d1ccc-668e-4a67-a6af-a17be77a4b52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:45.716940 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1d1ccc-668e-4a67-a6af-a17be77a4b52 service cinder] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:45.748001 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 868/1746] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:49:45 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 576 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:49:45.766705 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1d1ccc-668e-4a67-a6af-a17be77a4b52 service cinder] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:45.766705 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1d1ccc-668e-4a67-a6af-a17be77a4b52 service cinder] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:45.772084 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dfb9ae-83fe-4c0d-948a-4bdd7b767b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:45.772084 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dfb9ae-83fe-4c0d-948a-4bdd7b767b6c admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:45.772515 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dfb9ae-83fe-4c0d-948a-4bdd7b767b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:45.772887 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dfb9ae-83fe-4c0d-948a-4bdd7b767b6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:45.774287 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dfb9ae-83fe-4c0d-948a-4bdd7b767b6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:45.776921 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dfb9ae-83fe-4c0d-948a-4bdd7b767b6c admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:45.816286 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 869/1747] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:49:45 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:49:45.816857 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dfb9ae-83fe-4c0d-948a-4bdd7b767b6c admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:45.819213 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-64dfb9ae-83fe-4c0d-948a-4bdd7b767b6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:45.836451 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dfb9ae-83fe-4c0d-948a-4bdd7b767b6c admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:45.843350 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b66fdc-4950-484c-8f12-ecd9304d0137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:45.844346 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b66fdc-4950-484c-8f12-ecd9304d0137 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:45.844694 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b66fdc-4950-484c-8f12-ecd9304d0137 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:45.845042 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b66fdc-4950-484c-8f12-ecd9304d0137 admin admin] PATH_INFO: `/v3/projects/9a9e9e78b8f94d5a94cac7de2bff3d31` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:45.847548 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b66fdc-4950-484c-8f12-ecd9304d0137 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a9e9e78b8f94d5a94cac7de2bff3d31)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:45.849603 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b66fdc-4950-484c-8f12-ecd9304d0137 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:46.380640 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 879/1748] 10.222.0.15 () {60 vars in 1143 bytes} [Tue May 31 14:49:45 2022] POST /identity/v3/users => generated 279 bytes in 978 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:49:46.381589 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8b891a-5630-44e9-8826-2b3a73dc94e1 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:46.399030 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8b891a-5630-44e9-8826-2b3a73dc94e1 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:46.408486 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-66b66fdc-4950-484c-8f12-ecd9304d0137 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a9e9e78b8f94d5a94cac7de2bff3d31', 'request_id': 'req-66b66fdc-4950-484c-8f12-ecd9304d0137'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:46.432430 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-66b66fdc-4950-484c-8f12-ecd9304d0137 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a9e9e78b8f94d5a94cac7de2bff3d31', 'request_id': 'req-66b66fdc-4950-484c-8f12-ecd9304d0137'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:46.499707 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-66b66fdc-4950-484c-8f12-ecd9304d0137 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a9e9e78b8f94d5a94cac7de2bff3d31', 'request_id': 'req-66b66fdc-4950-484c-8f12-ecd9304d0137'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:46.521589 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a93103-5694-415a-b19f-39bf502c98b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:46.522318 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a93103-5694-415a-b19f-39bf502c98b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:46.523976 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a93103-5694-415a-b19f-39bf502c98b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:46.524341 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a93103-5694-415a-b19f-39bf502c98b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:46.525428 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a93103-5694-415a-b19f-39bf502c98b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:46.525626 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-66b66fdc-4950-484c-8f12-ecd9304d0137 admin admin] The token cache is being invalidate because project 9a9e9e78b8f94d5a94cac7de2bff3d31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 14:49:46.525876 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-66b66fdc-4950-484c-8f12-ecd9304d0137 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:46.529417 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-66b66fdc-4950-484c-8f12-ecd9304d0137 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:46.532379 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a93103-5694-415a-b19f-39bf502c98b4 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:46.535573 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 870/1749] 10.222.0.15 () {58 vars in 1232 bytes} [Tue May 31 14:49:45 2022] DELETE /identity/v3/projects/9a9e9e78b8f94d5a94cac7de2bff3d31 => generated 0 bytes in 715 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:49:46.535891 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b66fdc-4950-484c-8f12-ecd9304d0137 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:46.537691 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-66b66fdc-4950-484c-8f12-ecd9304d0137 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:46.565172 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 880/1750] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:49:46 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:49:46.565172 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a93103-5694-415a-b19f-39bf502c98b4 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:46.568012 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-03a93103-5694-415a-b19f-39bf502c98b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:46.572875 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b66fdc-4950-484c-8f12-ecd9304d0137 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:46.586386 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a93103-5694-415a-b19f-39bf502c98b4 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:46.587241 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa6a27d-ccd9-4d30-95fc-4fb0b4ac2304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:46.587241 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa6a27d-ccd9-4d30-95fc-4fb0b4ac2304 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:46.587241 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa6a27d-ccd9-4d30-95fc-4fb0b4ac2304 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:46.587241 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa6a27d-ccd9-4d30-95fc-4fb0b4ac2304 admin admin] PATH_INFO: `/v3/users/2ed36f3574044b9780fdb803dd29fdb1` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:46.591152 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1723a4bf-852a-4de9-a580-d8abb0852521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:46.592451 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1723a4bf-852a-4de9-a580-d8abb0852521 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:46.592451 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1723a4bf-852a-4de9-a580-d8abb0852521 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:46.592451 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1723a4bf-852a-4de9-a580-d8abb0852521 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:46.593285 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1723a4bf-852a-4de9-a580-d8abb0852521 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:46.595190 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1723a4bf-852a-4de9-a580-d8abb0852521 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:46.598375 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa6a27d-ccd9-4d30-95fc-4fb0b4ac2304 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ed36f3574044b9780fdb803dd29fdb1)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:46.602966 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa6a27d-ccd9-4d30-95fc-4fb0b4ac2304 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:46.619414 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 881/1751] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:49:46 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:49:46.619414 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f9d85d-c3f6-4699-bede-601bf20d27bd None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:46.619414 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f9d85d-c3f6-4699-bede-601bf20d27bd None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:46.619414 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f9d85d-c3f6-4699-bede-601bf20d27bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:46.646520 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:49:46.658420 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-48f9d85d-c3f6-4699-bede-601bf20d27bd None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:49:46.660694 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-48f9d85d-c3f6-4699-bede-601bf20d27bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:46.692693 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 882/1752] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:49:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:49:46.693813 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f9d85d-c3f6-4699-bede-601bf20d27bd None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:46.696206 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-48f9d85d-c3f6-4699-bede-601bf20d27bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:46.730055 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f9d85d-c3f6-4699-bede-601bf20d27bd None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:46.738532 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a513aa47-afd4-4a5b-bf43-ef58808ecc47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:46.739465 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a513aa47-afd4-4a5b-bf43-ef58808ecc47 admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:46.739801 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a513aa47-afd4-4a5b-bf43-ef58808ecc47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:46.740020 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a513aa47-afd4-4a5b-bf43-ef58808ecc47 admin admin] PATH_INFO: `/v3/projects/4d7a089f11484d9faf9d2731189682af/users/0e144b2ecf4b4e21a7ddaaaac76c4dde/roles/317f725e26bf43648d8235bb1f7c4cb3` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:46.788801 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a513aa47-afd4-4a5b-bf43-ef58808ecc47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d7a089f11484d9faf9d2731189682af, user_id=0e144b2ecf4b4e21a7ddaaaac76c4dde, role_id=317f725e26bf43648d8235bb1f7c4cb3)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:46.794730 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a513aa47-afd4-4a5b-bf43-ef58808ecc47 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:46.835484 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-1fa6a27d-ccd9-4d30-95fc-4fb0b4ac2304 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ed36f3574044b9780fdb803dd29fdb1'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:46.875896 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-1fa6a27d-ccd9-4d30-95fc-4fb0b4ac2304 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ed36f3574044b9780fdb803dd29fdb1'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:46.876891 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-1fa6a27d-ccd9-4d30-95fc-4fb0b4ac2304 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ed36f3574044b9780fdb803dd29fdb1'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:46.878016 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-1fa6a27d-ccd9-4d30-95fc-4fb0b4ac2304 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ed36f3574044b9780fdb803dd29fdb1'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:46.890268 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 883/1753] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:49:46 2022] PUT /identity/v3/projects/4d7a089f11484d9faf9d2731189682af/users/0e144b2ecf4b4e21a7ddaaaac76c4dde/roles/317f725e26bf43648d8235bb1f7c4cb3 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:49:46.891374 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a513aa47-afd4-4a5b-bf43-ef58808ecc47 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:46.894098 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-a513aa47-afd4-4a5b-bf43-ef58808ecc47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:46.926885 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-1fa6a27d-ccd9-4d30-95fc-4fb0b4ac2304 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ed36f3574044b9780fdb803dd29fdb1'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:47.060464 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 871/1754] 10.222.0.15 () {58 vars in 1223 bytes} [Tue May 31 14:49:46 2022] DELETE /identity/v3/users/2ed36f3574044b9780fdb803dd29fdb1 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:49:47.061318 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f801db-bf78-437b-8e9c-44d17047f616 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:47.061617 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f801db-bf78-437b-8e9c-44d17047f616 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:47.061899 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f801db-bf78-437b-8e9c-44d17047f616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:47.082165 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a513aa47-afd4-4a5b-bf43-ef58808ecc47 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:47.117254 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-04f801db-bf78-437b-8e9c-44d17047f616 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:49:47.117254 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-04f801db-bf78-437b-8e9c-44d17047f616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:47.117254 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:49:47.194410 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60243bcc-ca7c-406b-b8f5-d2ded0744b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:47.194410 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60243bcc-ca7c-406b-b8f5-d2ded0744b40 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:47.194410 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60243bcc-ca7c-406b-b8f5-d2ded0744b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:47.194410 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60243bcc-ca7c-406b-b8f5-d2ded0744b40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:47.195543 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60243bcc-ca7c-406b-b8f5-d2ded0744b40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:47.198312 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60243bcc-ca7c-406b-b8f5-d2ded0744b40 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:47.271626 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 884/1755] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:49:46 2022] GET /identity/v3/roles => generated 1420 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:49:47.273274 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18897174-474e-4c33-b888-c2ae03db3929 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:47.301119 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18897174-474e-4c33-b888-c2ae03db3929 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:47.303756 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18897174-474e-4c33-b888-c2ae03db3929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:47.431650 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-18897174-474e-4c33-b888-c2ae03db3929 None None] MFA Rules not processed for user `0e144b2ecf4b4e21a7ddaaaac76c4dde`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:49:47.438385 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-18897174-474e-4c33-b888-c2ae03db3929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:47.483719 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 872/1756] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:49:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 418 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:49:47.485864 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69fdeaa-e83f-4c3c-8fca-ec97fba7e67a None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:47.491297 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69fdeaa-e83f-4c3c-8fca-ec97fba7e67a None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:47.491794 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69fdeaa-e83f-4c3c-8fca-ec97fba7e67a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:47.569392 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-b69fdeaa-e83f-4c3c-8fca-ec97fba7e67a None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:49:47.569578 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-b69fdeaa-e83f-4c3c-8fca-ec97fba7e67a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:47.601772 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 885/1757] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:49:47 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:49:47.602721 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18897174-474e-4c33-b888-c2ae03db3929 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:47.616949 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18897174-474e-4c33-b888-c2ae03db3929 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:47.618763 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 873/1758] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:49:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:49:47.620194 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69fdeaa-e83f-4c3c-8fca-ec97fba7e67a None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:47.646807 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69fdeaa-e83f-4c3c-8fca-ec97fba7e67a None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:47.654000 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd8dc5c-02b1-491f-99ea-36f69b19a70a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:47.654420 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77bb86a-41b8-4cb9-b5ca-b1ebe914987f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:47.655935 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd8dc5c-02b1-491f-99ea-36f69b19a70a admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:47.655935 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd8dc5c-02b1-491f-99ea-36f69b19a70a admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:47.655935 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd8dc5c-02b1-491f-99ea-36f69b19a70a admin admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:47.656789 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77bb86a-41b8-4cb9-b5ca-b1ebe914987f admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:47.657136 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd8dc5c-02b1-491f-99ea-36f69b19a70a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:49:47.657291 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77bb86a-41b8-4cb9-b5ca-b1ebe914987f admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:47.657571 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77bb86a-41b8-4cb9-b5ca-b1ebe914987f admin admin] PATH_INFO: `/v3/projects/c1d5274af3b142dc92637c659d9df43c/users/dff7a4336ffe4cf7b8f9f2a76ddbc2ea/roles/317f725e26bf43648d8235bb1f7c4cb3` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:47.657982 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd8dc5c-02b1-491f-99ea-36f69b19a70a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:47.660146 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd8dc5c-02b1-491f-99ea-36f69b19a70a admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:47.667033 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:49:47.689922 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 874/1759] 10.222.0.15 () {58 vars in 1152 bytes} [Tue May 31 14:49:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:49:47.689922 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd8dc5c-02b1-491f-99ea-36f69b19a70a admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:47.709200 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77bb86a-41b8-4cb9-b5ca-b1ebe914987f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1d5274af3b142dc92637c659d9df43c, user_id=dff7a4336ffe4cf7b8f9f2a76ddbc2ea, role_id=317f725e26bf43648d8235bb1f7c4cb3)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:47.715129 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77bb86a-41b8-4cb9-b5ca-b1ebe914987f admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:47.718513 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-6bd8dc5c-02b1-491f-99ea-36f69b19a70a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:47.771900 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd8dc5c-02b1-491f-99ea-36f69b19a70a admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:47.792472 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d57af7f-4e80-4aaa-9cd5-e9615bd5762e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:47.793125 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d57af7f-4e80-4aaa-9cd5-e9615bd5762e admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:47.793419 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d57af7f-4e80-4aaa-9cd5-e9615bd5762e admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:47.793760 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d57af7f-4e80-4aaa-9cd5-e9615bd5762e admin admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:47.795122 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d57af7f-4e80-4aaa-9cd5-e9615bd5762e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:47.797434 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d57af7f-4e80-4aaa-9cd5-e9615bd5762e admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:47.826154 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 886/1760] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:49:47 2022] PUT /identity/v3/projects/c1d5274af3b142dc92637c659d9df43c/users/dff7a4336ffe4cf7b8f9f2a76ddbc2ea/roles/317f725e26bf43648d8235bb1f7c4cb3 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:49:47.827393 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77bb86a-41b8-4cb9-b5ca-b1ebe914987f admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:47.839961 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-c77bb86a-41b8-4cb9-b5ca-b1ebe914987f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:47.955557 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 875/1761] 10.222.0.15 () {60 vars in 1152 bytes} [Tue May 31 14:49:47 2022] POST /identity/v3/projects => generated 371 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:49:47.955557 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d57af7f-4e80-4aaa-9cd5-e9615bd5762e admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:47.986147 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77bb86a-41b8-4cb9-b5ca-b1ebe914987f admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:48.095561 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d57af7f-4e80-4aaa-9cd5-e9615bd5762e admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:48.102316 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14f4591-e22d-4860-8080-c826f1aa03fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:48.103032 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14f4591-e22d-4860-8080-c826f1aa03fa admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:48.106059 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14f4591-e22d-4860-8080-c826f1aa03fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:48.106059 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14f4591-e22d-4860-8080-c826f1aa03fa admin admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:48.106059 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14f4591-e22d-4860-8080-c826f1aa03fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:48.107941 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14f4591-e22d-4860-8080-c826f1aa03fa admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:48.116304 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c32ef6-b89c-49e6-978e-238c6299610a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:48.117089 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c32ef6-b89c-49e6-978e-238c6299610a service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:48.117820 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c32ef6-b89c-49e6-978e-238c6299610a service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:48.118407 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c32ef6-b89c-49e6-978e-238c6299610a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:48.134843 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c32ef6-b89c-49e6-978e-238c6299610a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:48.136561 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c32ef6-b89c-49e6-978e-238c6299610a service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:48.148773 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 887/1762] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:49:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:49:48.150114 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5a90d0-5a59-472b-b853-f0e36c01d0e8 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:48.150410 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5a90d0-5a59-472b-b853-f0e36c01d0e8 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:48.150722 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5a90d0-5a59-472b-b853-f0e36c01d0e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:48.190436 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-ff5a90d0-5a59-472b-b853-f0e36c01d0e8 None None] MFA Rules not processed for user `dff7a4336ffe4cf7b8f9f2a76ddbc2ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:49:48.191925 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-ff5a90d0-5a59-472b-b853-f0e36c01d0e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:48.217381 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 876/1763] 10.222.0.15 () {60 vars in 1152 bytes} [Tue May 31 14:49:47 2022] POST /identity/v3/projects => generated 405 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:49:48.218644 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14f4591-e22d-4860-8080-c826f1aa03fa admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:48.288822 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:49:48.302003 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14f4591-e22d-4860-8080-c826f1aa03fa admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:48.310843 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83676b7-d952-4db0-89c0-71965be7a716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:48.315666 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 888/1764] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:49:48 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:49:48.315666 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5a90d0-5a59-472b-b853-f0e36c01d0e8 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:48.316376 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83676b7-d952-4db0-89c0-71965be7a716 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:48.316728 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83676b7-d952-4db0-89c0-71965be7a716 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:48.317027 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83676b7-d952-4db0-89c0-71965be7a716 admin admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:48.317750 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83676b7-d952-4db0-89c0-71965be7a716 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:48.320923 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83676b7-d952-4db0-89c0-71965be7a716 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:48.330325 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5a90d0-5a59-472b-b853-f0e36c01d0e8 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:48.337883 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6a7bb4-d3d0-4b68-9c53-7299bb321ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:48.338641 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6a7bb4-d3d0-4b68-9c53-7299bb321ad0 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:48.338942 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6a7bb4-d3d0-4b68-9c53-7299bb321ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:48.339607 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6a7bb4-d3d0-4b68-9c53-7299bb321ad0 admin admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:48.340414 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6a7bb4-d3d0-4b68-9c53-7299bb321ad0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:48.343659 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6a7bb4-d3d0-4b68-9c53-7299bb321ad0 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:48.402398 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 877/1765] 10.222.0.15 () {60 vars in 1143 bytes} [Tue May 31 14:49:48 2022] POST /identity/v3/users => generated 292 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:49:48.402398 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83676b7-d952-4db0-89c0-71965be7a716 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:48.408609 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83676b7-d952-4db0-89c0-71965be7a716 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:48.413499 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94d9a3a-caaa-453b-8a16-054742b7a56c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:48.414148 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d9a3a-caaa-453b-8a16-054742b7a56c admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:48.414429 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d9a3a-caaa-453b-8a16-054742b7a56c admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:48.414775 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d9a3a-caaa-453b-8a16-054742b7a56c admin admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:48.415440 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94d9a3a-caaa-453b-8a16-054742b7a56c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:48.417489 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94d9a3a-caaa-453b-8a16-054742b7a56c admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:48.427136 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 889/1766] 10.222.0.15 () {60 vars in 1143 bytes} [Tue May 31 14:49:48 2022] POST /identity/v3/users => generated 303 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:49:48.435178 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6a7bb4-d3d0-4b68-9c53-7299bb321ad0 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:48.438750 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6a7bb4-d3d0-4b68-9c53-7299bb321ad0 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:48.443980 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3322c4-6fb0-4d0e-b43f-78730e4337cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:48.444865 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3322c4-6fb0-4d0e-b43f-78730e4337cf admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:48.445254 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3322c4-6fb0-4d0e-b43f-78730e4337cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:48.445599 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3322c4-6fb0-4d0e-b43f-78730e4337cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:48.446401 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3322c4-6fb0-4d0e-b43f-78730e4337cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:48.448133 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3322c4-6fb0-4d0e-b43f-78730e4337cf admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:48.469706 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 890/1767] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:49:48 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:49:48.469706 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3322c4-6fb0-4d0e-b43f-78730e4337cf admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:48.472335 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:49:48.476420 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3322c4-6fb0-4d0e-b43f-78730e4337cf admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:48.483150 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7df82a-ac6a-48c9-af7a-38e0451cbf14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:48.484041 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7df82a-ac6a-48c9-af7a-38e0451cbf14 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:48.484406 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7df82a-ac6a-48c9-af7a-38e0451cbf14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:48.484753 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7df82a-ac6a-48c9-af7a-38e0451cbf14 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:48.485619 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7df82a-ac6a-48c9-af7a-38e0451cbf14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:48.487379 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7df82a-ac6a-48c9-af7a-38e0451cbf14 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:48.499621 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 891/1768] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:49:48 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:49:48.500442 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7df82a-ac6a-48c9-af7a-38e0451cbf14 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:48.510405 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7df82a-ac6a-48c9-af7a-38e0451cbf14 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:48.516389 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c423ef-2e2b-4216-a99b-f459719a61ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:48.520630 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c423ef-2e2b-4216-a99b-f459719a61ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:48.520630 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c423ef-2e2b-4216-a99b-f459719a61ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:48.520630 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c423ef-2e2b-4216-a99b-f459719a61ad admin admin] PATH_INFO: `/v3/projects/6075deb1d1e4431ea692bd9e99eab39b/users/b9a51fe8dcdd482a9fe25108ed1f66e2/roles/76c53e2c353644f885028a0226c06146` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:48.542105 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c423ef-2e2b-4216-a99b-f459719a61ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=6075deb1d1e4431ea692bd9e99eab39b, user_id=b9a51fe8dcdd482a9fe25108ed1f66e2, role_id=76c53e2c353644f885028a0226c06146)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:48.545298 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c423ef-2e2b-4216-a99b-f459719a61ad admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:48.568152 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 878/1769] 10.222.0.15 () {60 vars in 1152 bytes} [Tue May 31 14:49:48 2022] POST /identity/v3/projects => generated 355 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:49:48.568152 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94d9a3a-caaa-453b-8a16-054742b7a56c admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:48.650242 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94d9a3a-caaa-453b-8a16-054742b7a56c admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:48.655437 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5b99c9-1334-4c2a-977a-1d93101df912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:48.657350 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b99c9-1334-4c2a-977a-1d93101df912 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:48.657350 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b99c9-1334-4c2a-977a-1d93101df912 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:48.657350 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b99c9-1334-4c2a-977a-1d93101df912 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:48.657350 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5b99c9-1334-4c2a-977a-1d93101df912 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:48.658997 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5b99c9-1334-4c2a-977a-1d93101df912 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:48.669804 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 879/1770] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:49:48 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:49:48.670632 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5b99c9-1334-4c2a-977a-1d93101df912 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:48.681604 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5b99c9-1334-4c2a-977a-1d93101df912 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:48.691291 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 892/1771] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:49:48 2022] PUT /identity/v3/projects/6075deb1d1e4431ea692bd9e99eab39b/users/b9a51fe8dcdd482a9fe25108ed1f66e2/roles/76c53e2c353644f885028a0226c06146 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:49:48.691291 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c423ef-2e2b-4216-a99b-f459719a61ad admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:48.751097 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9645ebc-d930-4253-ae4b-403e95e69ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:48.751869 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9645ebc-d930-4253-ae4b-403e95e69ce3 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:48.751990 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c423ef-2e2b-4216-a99b-f459719a61ad admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:48.752290 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9645ebc-d930-4253-ae4b-403e95e69ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:48.752640 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9645ebc-d930-4253-ae4b-403e95e69ce3 admin admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:48.753401 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9645ebc-d930-4253-ae4b-403e95e69ce3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:48.755571 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9645ebc-d930-4253-ae4b-403e95e69ce3 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:48.756746 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab39b22-ac12-481a-b6b8-4395ab89797a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:48.757770 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab39b22-ac12-481a-b6b8-4395ab89797a admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:48.758060 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab39b22-ac12-481a-b6b8-4395ab89797a admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:48.758336 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab39b22-ac12-481a-b6b8-4395ab89797a admin admin] PATH_INFO: `/v3/projects/0ef4ad5246e24c9a98d5595622c17449/users/8dcd6b2fb10e497790a7c38b44b7d3ca/roles/317f725e26bf43648d8235bb1f7c4cb3` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:48.784070 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab39b22-ac12-481a-b6b8-4395ab89797a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ef4ad5246e24c9a98d5595622c17449, user_id=8dcd6b2fb10e497790a7c38b44b7d3ca, role_id=317f725e26bf43648d8235bb1f7c4cb3)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:48.788152 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab39b22-ac12-481a-b6b8-4395ab89797a admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:48.846373 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 880/1772] 10.222.0.15 () {60 vars in 1143 bytes} [Tue May 31 14:49:48 2022] POST /identity/v3/users => generated 284 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:49:48.847610 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9645ebc-d930-4253-ae4b-403e95e69ce3 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:48.858240 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9645ebc-d930-4253-ae4b-403e95e69ce3 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:48.863344 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f064294f-fd16-45ab-bfa8-370ae7ad1d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:48.864058 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f064294f-fd16-45ab-bfa8-370ae7ad1d3b admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:48.864350 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f064294f-fd16-45ab-bfa8-370ae7ad1d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:48.864629 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f064294f-fd16-45ab-bfa8-370ae7ad1d3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:48.865361 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f064294f-fd16-45ab-bfa8-370ae7ad1d3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:48.867022 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f064294f-fd16-45ab-bfa8-370ae7ad1d3b admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:48.878961 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 881/1773] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:49:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:49:48.879721 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 893/1774] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:49:48 2022] PUT /identity/v3/projects/0ef4ad5246e24c9a98d5595622c17449/users/8dcd6b2fb10e497790a7c38b44b7d3ca/roles/317f725e26bf43648d8235bb1f7c4cb3 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:49:48.879970 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f064294f-fd16-45ab-bfa8-370ae7ad1d3b admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:48.881198 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab39b22-ac12-481a-b6b8-4395ab89797a admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:48.889370 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-f064294f-fd16-45ab-bfa8-370ae7ad1d3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:48.904512 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f064294f-fd16-45ab-bfa8-370ae7ad1d3b admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:48.954249 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:49:49.000149 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44630e2-d67b-461e-af64-682cfe46e66c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:49.004445 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44630e2-d67b-461e-af64-682cfe46e66c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:49.004445 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44630e2-d67b-461e-af64-682cfe46e66c admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:49.004445 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44630e2-d67b-461e-af64-682cfe46e66c admin admin] PATH_INFO: `/v3/projects/2f03c77f2cbd43d48f163d2b7c5c1818` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:49.009157 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44630e2-d67b-461e-af64-682cfe46e66c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f03c77f2cbd43d48f163d2b7c5c1818)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:49.013504 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44630e2-d67b-461e-af64-682cfe46e66c admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:49.028024 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab39b22-ac12-481a-b6b8-4395ab89797a admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:49.043650 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cf642a-5780-44d5-8ed0-950641911009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:49.044912 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cf642a-5780-44d5-8ed0-950641911009 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:49.045194 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cf642a-5780-44d5-8ed0-950641911009 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:49.045475 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cf642a-5780-44d5-8ed0-950641911009 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:49.046472 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cf642a-5780-44d5-8ed0-950641911009 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:49.048374 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cf642a-5780-44d5-8ed0-950641911009 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:49.062861 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 894/1775] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:49:48 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:49:49.063738 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cf642a-5780-44d5-8ed0-950641911009 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:49.077269 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cf642a-5780-44d5-8ed0-950641911009 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:49.082321 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd9a7ce-d864-456a-83a7-1479d353ed56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:49.083366 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd9a7ce-d864-456a-83a7-1479d353ed56 admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:49.083601 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd9a7ce-d864-456a-83a7-1479d353ed56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:49.089201 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd9a7ce-d864-456a-83a7-1479d353ed56 admin admin] PATH_INFO: `/v3/projects/6075deb1d1e4431ea692bd9e99eab39b/users/b9a51fe8dcdd482a9fe25108ed1f66e2/roles/76c53e2c353644f885028a0226c06146` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:49.089201 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd9a7ce-d864-456a-83a7-1479d353ed56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6075deb1d1e4431ea692bd9e99eab39b, user_id=b9a51fe8dcdd482a9fe25108ed1f66e2, role_id=76c53e2c353644f885028a0226c06146)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:49.089201 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd9a7ce-d864-456a-83a7-1479d353ed56 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:49.110037 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 895/1776] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:49:49 2022] PUT /identity/v3/projects/6075deb1d1e4431ea692bd9e99eab39b/users/b9a51fe8dcdd482a9fe25108ed1f66e2/roles/76c53e2c353644f885028a0226c06146 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:49:49.110037 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f6f80a-46b2-4f83-a65d-d157c6ac632a None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:49.110037 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f6f80a-46b2-4f83-a65d-d157c6ac632a None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:49.110037 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f6f80a-46b2-4f83-a65d-d157c6ac632a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:49.158747 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-52f6f80a-46b2-4f83-a65d-d157c6ac632a None None] MFA Rules not processed for user `8dcd6b2fb10e497790a7c38b44b7d3ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:49:49.159986 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-52f6f80a-46b2-4f83-a65d-d157c6ac632a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:49.188532 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-d44630e2-d67b-461e-af64-682cfe46e66c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f03c77f2cbd43d48f163d2b7c5c1818', 'request_id': 'req-d44630e2-d67b-461e-af64-682cfe46e66c'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:49.193227 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:49:49.209572 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-d44630e2-d67b-461e-af64-682cfe46e66c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f03c77f2cbd43d48f163d2b7c5c1818', 'request_id': 'req-d44630e2-d67b-461e-af64-682cfe46e66c'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:49.274128 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 896/1777] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:49:49 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:49:49.275588 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f6f80a-46b2-4f83-a65d-d157c6ac632a None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:49.298571 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-d44630e2-d67b-461e-af64-682cfe46e66c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f03c77f2cbd43d48f163d2b7c5c1818', 'request_id': 'req-d44630e2-d67b-461e-af64-682cfe46e66c'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:49.335157 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-d44630e2-d67b-461e-af64-682cfe46e66c admin admin] The token cache is being invalidate because project 2f03c77f2cbd43d48f163d2b7c5c1818 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 14:49:49.335470 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-d44630e2-d67b-461e-af64-682cfe46e66c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:49.338941 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-d44630e2-d67b-461e-af64-682cfe46e66c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:49.340983 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 882/1778] 10.222.0.15 () {58 vars in 1232 bytes} [Tue May 31 14:49:48 2022] DELETE /identity/v3/projects/2f03c77f2cbd43d48f163d2b7c5c1818 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:49:49.344822 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea4dfe0-8928-41e2-b57f-d60d53b2a3da None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:49.345135 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea4dfe0-8928-41e2-b57f-d60d53b2a3da None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:49.345427 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea4dfe0-8928-41e2-b57f-d60d53b2a3da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:49.393972 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-cea4dfe0-8928-41e2-b57f-d60d53b2a3da None None] MFA Rules not processed for user `b9a51fe8dcdd482a9fe25108ed1f66e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:49:49.397443 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-cea4dfe0-8928-41e2-b57f-d60d53b2a3da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:49.397956 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f6f80a-46b2-4f83-a65d-d157c6ac632a None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:49.404780 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eea2216-cec1-4ada-88fb-c19ece29a2c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:49.405905 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eea2216-cec1-4ada-88fb-c19ece29a2c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:49.406261 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eea2216-cec1-4ada-88fb-c19ece29a2c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:49.406638 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eea2216-cec1-4ada-88fb-c19ece29a2c7 admin admin] PATH_INFO: `/v3/projects/d898b4d9b6ea4be4abd5598a00b93ee2/users/7bf7a7de05bd44f7a94d520011324c71/roles/76c53e2c353644f885028a0226c06146` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:49.430244 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eea2216-cec1-4ada-88fb-c19ece29a2c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d898b4d9b6ea4be4abd5598a00b93ee2, user_id=7bf7a7de05bd44f7a94d520011324c71, role_id=76c53e2c353644f885028a0226c06146)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:49.435547 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eea2216-cec1-4ada-88fb-c19ece29a2c7 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:49.495087 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 883/1779] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:49:49 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:49:49.496069 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea4dfe0-8928-41e2-b57f-d60d53b2a3da None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:49.497625 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-cea4dfe0-8928-41e2-b57f-d60d53b2a3da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:49.514421 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea4dfe0-8928-41e2-b57f-d60d53b2a3da None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:49.548091 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 897/1780] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:49:49 2022] PUT /identity/v3/projects/d898b4d9b6ea4be4abd5598a00b93ee2/users/7bf7a7de05bd44f7a94d520011324c71/roles/76c53e2c353644f885028a0226c06146 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:49:49.548976 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eea2216-cec1-4ada-88fb-c19ece29a2c7 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:49.561383 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-4eea2216-cec1-4ada-88fb-c19ece29a2c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:49.593151 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:49:49.603354 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4721cc0b-7b22-4ef9-b325-7edebf7bb705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:49.603955 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4721cc0b-7b22-4ef9-b325-7edebf7bb705 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:49.604672 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4721cc0b-7b22-4ef9-b325-7edebf7bb705 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:49.604672 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4721cc0b-7b22-4ef9-b325-7edebf7bb705 admin admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:49.606240 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4721cc0b-7b22-4ef9-b325-7edebf7bb705 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:49.608877 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4721cc0b-7b22-4ef9-b325-7edebf7bb705 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:49.704095 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eea2216-cec1-4ada-88fb-c19ece29a2c7 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:49.709157 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d38769f-831c-4fdb-8767-8fbc2725496a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:49.710185 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d38769f-831c-4fdb-8767-8fbc2725496a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:49.710473 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d38769f-831c-4fdb-8767-8fbc2725496a admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:49.710912 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d38769f-831c-4fdb-8767-8fbc2725496a admin admin] PATH_INFO: `/v3/users/4daee4540b2a4024bcd798225c74d581` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:49.712201 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d38769f-831c-4fdb-8767-8fbc2725496a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4daee4540b2a4024bcd798225c74d581)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:49.714175 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d38769f-831c-4fdb-8767-8fbc2725496a admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:49.721645 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 884/1781] 10.222.0.15 () {60 vars in 1152 bytes} [Tue May 31 14:49:49 2022] POST /identity/v3/projects => generated 405 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:49:49.721645 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4721cc0b-7b22-4ef9-b325-7edebf7bb705 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:49.721645 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-4721cc0b-7b22-4ef9-b325-7edebf7bb705 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:49.800813 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4721cc0b-7b22-4ef9-b325-7edebf7bb705 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:49.804794 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4901c083-a936-4e21-bb3b-3c49e3935811 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afbf718dcd9b4741a926b0a2321bd53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:49.805458 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4901c083-a936-4e21-bb3b-3c49e3935811 service cinder] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:49.805815 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4901c083-a936-4e21-bb3b-3c49e3935811 service cinder] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:49.806103 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4901c083-a936-4e21-bb3b-3c49e3935811 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:49.882392 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4901c083-a936-4e21-bb3b-3c49e3935811 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:49.886120 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4901c083-a936-4e21-bb3b-3c49e3935811 service cinder] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:49.896358 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-6d38769f-831c-4fdb-8767-8fbc2725496a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4daee4540b2a4024bcd798225c74d581'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:49.900395 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:49:49.904552 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 885/1782] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:49:49 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:49:49.905630 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4901c083-a936-4e21-bb3b-3c49e3935811 service cinder] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:49.907224 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-4901c083-a936-4e21-bb3b-3c49e3935811 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:49.990375 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-6d38769f-831c-4fdb-8767-8fbc2725496a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4daee4540b2a4024bcd798225c74d581'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:49.991390 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-6d38769f-831c-4fdb-8767-8fbc2725496a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4daee4540b2a4024bcd798225c74d581'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:49.993806 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4901c083-a936-4e21-bb3b-3c49e3935811 service cinder] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:50.005002 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe219d2-14f4-4999-a94c-25f178417fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:50.005002 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe219d2-14f4-4999-a94c-25f178417fe8 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:50.005002 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe219d2-14f4-4999-a94c-25f178417fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:50.005002 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe219d2-14f4-4999-a94c-25f178417fe8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:50.005476 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe219d2-14f4-4999-a94c-25f178417fe8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:50.005560 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-6d38769f-831c-4fdb-8767-8fbc2725496a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4daee4540b2a4024bcd798225c74d581'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:50.005560 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-6d38769f-831c-4fdb-8767-8fbc2725496a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4daee4540b2a4024bcd798225c74d581'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:50.005720 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe219d2-14f4-4999-a94c-25f178417fe8 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:50.014343 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 886/1783] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:49:49 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:49:50.015204 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe219d2-14f4-4999-a94c-25f178417fe8 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:50.016888 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-ffe219d2-14f4-4999-a94c-25f178417fe8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:50.025668 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 898/1784] 10.222.0.15 () {58 vars in 1223 bytes} [Tue May 31 14:49:49 2022] DELETE /identity/v3/users/4daee4540b2a4024bcd798225c74d581 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:49:50.027960 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9099ba8-e150-4739-9778-c94a2ca4927d None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:50.027960 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9099ba8-e150-4739-9778-c94a2ca4927d None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:50.035357 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9099ba8-e150-4739-9778-c94a2ca4927d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:50.036173 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe219d2-14f4-4999-a94c-25f178417fe8 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:50.066434 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:49:50.084485 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-d9099ba8-e150-4739-9778-c94a2ca4927d None None] MFA Rules not processed for user `3ba53ede9ae9426f9f89c885aea9e32e`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:49:50.087556 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-d9099ba8-e150-4739-9778-c94a2ca4927d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:50.168572 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae64f66-ffd3-49ed-9b56-c9eccde393ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:50.169309 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae64f66-ffd3-49ed-9b56-c9eccde393ac admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:50.169786 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae64f66-ffd3-49ed-9b56-c9eccde393ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:50.170128 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae64f66-ffd3-49ed-9b56-c9eccde393ac admin admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:50.171115 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae64f66-ffd3-49ed-9b56-c9eccde393ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:50.174381 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae64f66-ffd3-49ed-9b56-c9eccde393ac admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:50.222774 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 899/1785] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:49:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:49:50.237914 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9099ba8-e150-4739-9778-c94a2ca4927d None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:50.238197 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-d9099ba8-e150-4739-9778-c94a2ca4927d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:50.255894 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9099ba8-e150-4739-9778-c94a2ca4927d None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:50.261929 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a1fcec-7c49-4e20-94d5-192a01c3f97d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:50.262168 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a1fcec-7c49-4e20-94d5-192a01c3f97d admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:50.272091 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a1fcec-7c49-4e20-94d5-192a01c3f97d admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:50.272091 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a1fcec-7c49-4e20-94d5-192a01c3f97d admin admin] PATH_INFO: `/v3/projects/d898b4d9b6ea4be4abd5598a00b93ee2/users/7bf7a7de05bd44f7a94d520011324c71/roles/76c53e2c353644f885028a0226c06146` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:50.272091 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a1fcec-7c49-4e20-94d5-192a01c3f97d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d898b4d9b6ea4be4abd5598a00b93ee2, user_id=7bf7a7de05bd44f7a94d520011324c71, role_id=76c53e2c353644f885028a0226c06146)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:50.272091 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a1fcec-7c49-4e20-94d5-192a01c3f97d admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:50.282382 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 900/1786] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:49:50 2022] PUT /identity/v3/projects/d898b4d9b6ea4be4abd5598a00b93ee2/users/7bf7a7de05bd44f7a94d520011324c71/roles/76c53e2c353644f885028a0226c06146 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:49:50.292609 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7925c310-e398-40c6-ae02-66dffd057270 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:50.301167 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7925c310-e398-40c6-ae02-66dffd057270 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:50.301167 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7925c310-e398-40c6-ae02-66dffd057270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:50.303986 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 887/1787] 10.222.0.15 () {60 vars in 1143 bytes} [Tue May 31 14:49:50 2022] POST /identity/v3/users => generated 309 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:49:50.307732 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae64f66-ffd3-49ed-9b56-c9eccde393ac admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:50.330946 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae64f66-ffd3-49ed-9b56-c9eccde393ac admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:50.343762 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-7925c310-e398-40c6-ae02-66dffd057270 None None] MFA Rules not processed for user `7bf7a7de05bd44f7a94d520011324c71`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:49:50.345081 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-7925c310-e398-40c6-ae02-66dffd057270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:50.453523 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4bd73c-cc55-4169-ad13-8869bd7aec32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:50.454776 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4bd73c-cc55-4169-ad13-8869bd7aec32 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:50.455071 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4bd73c-cc55-4169-ad13-8869bd7aec32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:50.455348 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4bd73c-cc55-4169-ad13-8869bd7aec32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:50.456090 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4bd73c-cc55-4169-ad13-8869bd7aec32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:50.457796 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4bd73c-cc55-4169-ad13-8869bd7aec32 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:50.486391 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 888/1788] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:49:50 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:49:50.489894 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4bd73c-cc55-4169-ad13-8869bd7aec32 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:50.490581 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 901/1789] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:49:50 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:49:50.502470 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4bd73c-cc55-4169-ad13-8869bd7aec32 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:50.509593 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7925c310-e398-40c6-ae02-66dffd057270 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:50.511673 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-7925c310-e398-40c6-ae02-66dffd057270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:50.539826 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ae92d0-778b-4bdc-9b05-b5abc74d5e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:50.541144 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae92d0-778b-4bdc-9b05-b5abc74d5e42 admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:50.541485 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae92d0-778b-4bdc-9b05-b5abc74d5e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:50.541763 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae92d0-778b-4bdc-9b05-b5abc74d5e42 admin admin] PATH_INFO: `/v3/projects/ae8662601bdd4d35b003217e682a7e22/users/094e4b04aab14b978e639a92bc8e0aa0/roles/76c53e2c353644f885028a0226c06146` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:50.573058 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ae92d0-778b-4bdc-9b05-b5abc74d5e42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae8662601bdd4d35b003217e682a7e22, user_id=094e4b04aab14b978e639a92bc8e0aa0, role_id=76c53e2c353644f885028a0226c06146)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:50.584899 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ae92d0-778b-4bdc-9b05-b5abc74d5e42 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:50.598780 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:49:50.617488 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7925c310-e398-40c6-ae02-66dffd057270 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:50.622845 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4353b7f0-5641-42fa-a315-6fce31ab94fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afbf718dcd9b4741a926b0a2321bd53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:50.622845 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4353b7f0-5641-42fa-a315-6fce31ab94fe service cinder] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:50.623246 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4353b7f0-5641-42fa-a315-6fce31ab94fe service cinder] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:50.623804 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4353b7f0-5641-42fa-a315-6fce31ab94fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:50.634978 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4353b7f0-5641-42fa-a315-6fce31ab94fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:50.636801 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4353b7f0-5641-42fa-a315-6fce31ab94fe service cinder] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:50.661889 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 902/1790] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:49:50 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 14:49:50.688613 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 889/1791] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:49:50 2022] PUT /identity/v3/projects/ae8662601bdd4d35b003217e682a7e22/users/094e4b04aab14b978e639a92bc8e0aa0/roles/76c53e2c353644f885028a0226c06146 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:49:50.692493 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4353b7f0-5641-42fa-a315-6fce31ab94fe service cinder] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:50.706460 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4353b7f0-5641-42fa-a315-6fce31ab94fe service cinder] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:50.827075 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6cb3d3-e216-4ceb-95df-a82cc959e178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:50.827760 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6cb3d3-e216-4ceb-95df-a82cc959e178 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:50.828257 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6cb3d3-e216-4ceb-95df-a82cc959e178 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:50.828753 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6cb3d3-e216-4ceb-95df-a82cc959e178 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:50.829716 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6cb3d3-e216-4ceb-95df-a82cc959e178 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:50.831434 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6cb3d3-e216-4ceb-95df-a82cc959e178 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:50.847323 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 903/1792] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:49:50 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:49:50.850897 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ae92d0-778b-4bdc-9b05-b5abc74d5e42 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:50.866883 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ae92d0-778b-4bdc-9b05-b5abc74d5e42 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:50.875165 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6623197a-b583-4609-898d-578bfa1b72bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:50.876098 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6623197a-b583-4609-898d-578bfa1b72bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:50.877381 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6623197a-b583-4609-898d-578bfa1b72bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:50.877490 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6623197a-b583-4609-898d-578bfa1b72bb admin admin] PATH_INFO: `/v3/projects/ae8662601bdd4d35b003217e682a7e22/users/094e4b04aab14b978e639a92bc8e0aa0/roles/76c53e2c353644f885028a0226c06146` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:50.881646 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6623197a-b583-4609-898d-578bfa1b72bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae8662601bdd4d35b003217e682a7e22, user_id=094e4b04aab14b978e639a92bc8e0aa0, role_id=76c53e2c353644f885028a0226c06146)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:50.887513 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6623197a-b583-4609-898d-578bfa1b72bb admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:50.908107 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 890/1793] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:49:50 2022] PUT /identity/v3/projects/ae8662601bdd4d35b003217e682a7e22/users/094e4b04aab14b978e639a92bc8e0aa0/roles/76c53e2c353644f885028a0226c06146 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:49:50.921956 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cf7ced-30ea-49e1-9159-a8ae89bf8174 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:50.922604 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cf7ced-30ea-49e1-9159-a8ae89bf8174 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:50.923807 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cf7ced-30ea-49e1-9159-a8ae89bf8174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:51.006407 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-14cf7ced-30ea-49e1-9159-a8ae89bf8174 None None] MFA Rules not processed for user `094e4b04aab14b978e639a92bc8e0aa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:49:51.007968 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-14cf7ced-30ea-49e1-9159-a8ae89bf8174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:51.024143 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6623197a-b583-4609-898d-578bfa1b72bb admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:51.105297 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6623197a-b583-4609-898d-578bfa1b72bb admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:51.109559 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be1a31b-7f11-484e-9647-36e115e957b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afbf718dcd9b4741a926b0a2321bd53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:51.110323 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be1a31b-7f11-484e-9647-36e115e957b9 service cinder] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:51.110591 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be1a31b-7f11-484e-9647-36e115e957b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:51.116807 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be1a31b-7f11-484e-9647-36e115e957b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:51.116807 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-8be1a31b-7f11-484e-9647-36e115e957b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:51.173552 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:49:51.269313 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be1a31b-7f11-484e-9647-36e115e957b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:51.270799 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be1a31b-7f11-484e-9647-36e115e957b9 service cinder] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:51.282644 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 891/1794] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:49:51 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:49:51.283718 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be1a31b-7f11-484e-9647-36e115e957b9 service cinder] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:51.285091 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-8be1a31b-7f11-484e-9647-36e115e957b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:51.345897 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 904/1795] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:49:50 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 422 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:49:51.359665 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cf7ced-30ea-49e1-9159-a8ae89bf8174 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:51.362098 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-14cf7ced-30ea-49e1-9159-a8ae89bf8174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:51.407990 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cf7ced-30ea-49e1-9159-a8ae89bf8174 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:51.409122 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be1a31b-7f11-484e-9647-36e115e957b9 service cinder] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:51.417372 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f2306d-366a-4230-9307-5aa899bdaa3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:51.418316 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f2306d-366a-4230-9307-5aa899bdaa3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:51.418683 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f2306d-366a-4230-9307-5aa899bdaa3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:51.421609 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f2306d-366a-4230-9307-5aa899bdaa3a admin admin] PATH_INFO: `/v3/projects/a1bc4be8e46a4006a7ab97190592a3ab` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:51.421762 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40a9ef9-6bdb-4502-8e96-e68aa15bc717 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afbf718dcd9b4741a926b0a2321bd53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:51.421856 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f2306d-366a-4230-9307-5aa899bdaa3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1bc4be8e46a4006a7ab97190592a3ab)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:51.422544 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40a9ef9-6bdb-4502-8e96-e68aa15bc717 service cinder] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:51.422873 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40a9ef9-6bdb-4502-8e96-e68aa15bc717 service cinder] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:51.423612 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f2306d-366a-4230-9307-5aa899bdaa3a admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:51.425117 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40a9ef9-6bdb-4502-8e96-e68aa15bc717 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:51.452779 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40a9ef9-6bdb-4502-8e96-e68aa15bc717 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:51.457299 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40a9ef9-6bdb-4502-8e96-e68aa15bc717 service cinder] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:51.472487 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 905/1796] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:49:51 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:49:51.594654 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-83f2306d-366a-4230-9307-5aa899bdaa3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1bc4be8e46a4006a7ab97190592a3ab', 'request_id': 'req-83f2306d-366a-4230-9307-5aa899bdaa3a'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:51.611515 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-83f2306d-366a-4230-9307-5aa899bdaa3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1bc4be8e46a4006a7ab97190592a3ab', 'request_id': 'req-83f2306d-366a-4230-9307-5aa899bdaa3a'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:51.682323 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-83f2306d-366a-4230-9307-5aa899bdaa3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1bc4be8e46a4006a7ab97190592a3ab', 'request_id': 'req-83f2306d-366a-4230-9307-5aa899bdaa3a'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:51.706494 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-83f2306d-366a-4230-9307-5aa899bdaa3a admin admin] The token cache is being invalidate because project a1bc4be8e46a4006a7ab97190592a3ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 14:49:51.707045 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-83f2306d-366a-4230-9307-5aa899bdaa3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:51.708085 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-83f2306d-366a-4230-9307-5aa899bdaa3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:51.712677 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 892/1797] 10.222.0.15 () {58 vars in 1232 bytes} [Tue May 31 14:49:51 2022] DELETE /identity/v3/projects/a1bc4be8e46a4006a7ab97190592a3ab => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:49:51.717861 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5572c4dd-b90b-472d-9dfd-79e47064eccb None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:51.718807 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5572c4dd-b90b-472d-9dfd-79e47064eccb None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:51.719589 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5572c4dd-b90b-472d-9dfd-79e47064eccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:51.750435 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-5572c4dd-b90b-472d-9dfd-79e47064eccb None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:49:51.751922 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-5572c4dd-b90b-472d-9dfd-79e47064eccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:51.779289 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f2306d-366a-4230-9307-5aa899bdaa3a admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:51.782023 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-83f2306d-366a-4230-9307-5aa899bdaa3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:51.888190 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:49:51.913011 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 906/1798] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:49:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:49:51.914236 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5572c4dd-b90b-472d-9dfd-79e47064eccb None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:51.915848 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-5572c4dd-b90b-472d-9dfd-79e47064eccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:51.931536 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5572c4dd-b90b-472d-9dfd-79e47064eccb None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:51.939910 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd594215-614c-4482-9c72-ec9b5b9f52b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:51.941121 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd594215-614c-4482-9c72-ec9b5b9f52b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:51.941121 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd594215-614c-4482-9c72-ec9b5b9f52b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:51.941371 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd594215-614c-4482-9c72-ec9b5b9f52b3 admin admin] PATH_INFO: `/v3/users/8dcd6b2fb10e497790a7c38b44b7d3ca` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:51.942994 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd594215-614c-4482-9c72-ec9b5b9f52b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8dcd6b2fb10e497790a7c38b44b7d3ca)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:51.946667 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:49:51.952553 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd594215-614c-4482-9c72-ec9b5b9f52b3 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:51.955098 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f2306d-366a-4230-9307-5aa899bdaa3a admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:51.962289 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b370bbcf-972d-40d0-9314-2356c477556e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:51.963212 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b370bbcf-972d-40d0-9314-2356c477556e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:51.963546 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b370bbcf-972d-40d0-9314-2356c477556e admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:51.963834 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b370bbcf-972d-40d0-9314-2356c477556e admin admin] PATH_INFO: `/v3/users/0e144b2ecf4b4e21a7ddaaaac76c4dde` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:51.965057 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b370bbcf-972d-40d0-9314-2356c477556e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e144b2ecf4b4e21a7ddaaaac76c4dde)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:51.968598 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b370bbcf-972d-40d0-9314-2356c477556e admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:52.176259 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-b370bbcf-972d-40d0-9314-2356c477556e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e144b2ecf4b4e21a7ddaaaac76c4dde'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:52.177319 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-cd594215-614c-4482-9c72-ec9b5b9f52b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8dcd6b2fb10e497790a7c38b44b7d3ca'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:52.190829 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-b370bbcf-972d-40d0-9314-2356c477556e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e144b2ecf4b4e21a7ddaaaac76c4dde'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:52.191633 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-b370bbcf-972d-40d0-9314-2356c477556e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e144b2ecf4b4e21a7ddaaaac76c4dde'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:52.192391 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-b370bbcf-972d-40d0-9314-2356c477556e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e144b2ecf4b4e21a7ddaaaac76c4dde'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:52.216091 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-b370bbcf-972d-40d0-9314-2356c477556e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e144b2ecf4b4e21a7ddaaaac76c4dde'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:52.259389 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-cd594215-614c-4482-9c72-ec9b5b9f52b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8dcd6b2fb10e497790a7c38b44b7d3ca'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:52.260229 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-cd594215-614c-4482-9c72-ec9b5b9f52b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8dcd6b2fb10e497790a7c38b44b7d3ca'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:52.279442 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-cd594215-614c-4482-9c72-ec9b5b9f52b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8dcd6b2fb10e497790a7c38b44b7d3ca'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:52.285658 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-cd594215-614c-4482-9c72-ec9b5b9f52b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8dcd6b2fb10e497790a7c38b44b7d3ca'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:52.319526 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 907/1799] 10.222.0.15 () {58 vars in 1223 bytes} [Tue May 31 14:49:51 2022] DELETE /identity/v3/users/8dcd6b2fb10e497790a7c38b44b7d3ca => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:49:52.320990 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeedd4a-b7f2-43dd-a37e-27e28fa89296 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:52.321389 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeedd4a-b7f2-43dd-a37e-27e28fa89296 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:52.322523 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeedd4a-b7f2-43dd-a37e-27e28fa89296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:52.350364 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-adeedd4a-b7f2-43dd-a37e-27e28fa89296 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:49:52.351970 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-adeedd4a-b7f2-43dd-a37e-27e28fa89296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:52.396049 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 893/1800] 10.222.0.15 () {58 vars in 1223 bytes} [Tue May 31 14:49:51 2022] DELETE /identity/v3/users/0e144b2ecf4b4e21a7ddaaaac76c4dde => generated 0 bytes in 617 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:49:52.397660 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59633a7-5b95-4fbb-8ff0-b618da97314d None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:52.397758 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59633a7-5b95-4fbb-8ff0-b618da97314d None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:52.402382 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59633a7-5b95-4fbb-8ff0-b618da97314d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:52.455487 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-e59633a7-5b95-4fbb-8ff0-b618da97314d None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:49:52.457399 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-e59633a7-5b95-4fbb-8ff0-b618da97314d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:52.493321 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 908/1801] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:49:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:49:52.494742 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59b5c70-67aa-4b8b-8c54-e19c56d64431 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:52.495236 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59b5c70-67aa-4b8b-8c54-e19c56d64431 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:52.495521 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59b5c70-67aa-4b8b-8c54-e19c56d64431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:52.515189 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-e59b5c70-67aa-4b8b-8c54-e19c56d64431 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:49:52.516635 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-e59b5c70-67aa-4b8b-8c54-e19c56d64431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:52.533005 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 894/1802] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:49:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:49:52.541125 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59633a7-5b95-4fbb-8ff0-b618da97314d None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:52.550919 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59633a7-5b95-4fbb-8ff0-b618da97314d None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:52.557156 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb309c7c-142e-47eb-bc92-73d8c717db0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:52.558114 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb309c7c-142e-47eb-bc92-73d8c717db0c admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:52.558506 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb309c7c-142e-47eb-bc92-73d8c717db0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:52.558916 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb309c7c-142e-47eb-bc92-73d8c717db0c admin admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:52.560393 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb309c7c-142e-47eb-bc92-73d8c717db0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:49:52.560814 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb309c7c-142e-47eb-bc92-73d8c717db0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:52.562561 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb309c7c-142e-47eb-bc92-73d8c717db0c admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:52.581398 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 895/1803] 10.222.0.15 () {58 vars in 1152 bytes} [Tue May 31 14:49:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:49:52.582462 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb309c7c-142e-47eb-bc92-73d8c717db0c admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:52.585003 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-eb309c7c-142e-47eb-bc92-73d8c717db0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:52.626090 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 909/1804] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:49:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:49:52.626982 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59b5c70-67aa-4b8b-8c54-e19c56d64431 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:52.642595 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59b5c70-67aa-4b8b-8c54-e19c56d64431 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:52.646616 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb309c7c-142e-47eb-bc92-73d8c717db0c admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:52.648288 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a319920-5576-4c93-9aaf-c2d0306ec224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:52.648961 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a319920-5576-4c93-9aaf-c2d0306ec224 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:52.649247 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a319920-5576-4c93-9aaf-c2d0306ec224 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:52.649530 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a319920-5576-4c93-9aaf-c2d0306ec224 admin admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:52.650367 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a319920-5576-4c93-9aaf-c2d0306ec224 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:52.651860 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64815d5-c5fc-4c5c-a45d-cf5df32e56c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:52.652317 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a319920-5576-4c93-9aaf-c2d0306ec224 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:52.652505 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64815d5-c5fc-4c5c-a45d-cf5df32e56c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:52.652795 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64815d5-c5fc-4c5c-a45d-cf5df32e56c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:52.655341 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64815d5-c5fc-4c5c-a45d-cf5df32e56c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:52.664681 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:49:52.692219 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64815d5-c5fc-4c5c-a45d-cf5df32e56c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:52.694200 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64815d5-c5fc-4c5c-a45d-cf5df32e56c6 service neutron] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:52.718655 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 896/1805] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:49:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:49:52.721508 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64815d5-c5fc-4c5c-a45d-cf5df32e56c6 service neutron] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:52.733035 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64815d5-c5fc-4c5c-a45d-cf5df32e56c6 service neutron] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:52.737583 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be41bb4f-c1ec-4f5f-a016-8fb68cd24bf1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:52.738347 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be41bb4f-c1ec-4f5f-a016-8fb68cd24bf1 service neutron] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:52.738733 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be41bb4f-c1ec-4f5f-a016-8fb68cd24bf1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:52.739082 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be41bb4f-c1ec-4f5f-a016-8fb68cd24bf1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:52.750002 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be41bb4f-c1ec-4f5f-a016-8fb68cd24bf1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:52.751619 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be41bb4f-c1ec-4f5f-a016-8fb68cd24bf1 service neutron] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:52.763515 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 910/1806] 10.222.0.15 () {60 vars in 1152 bytes} [Tue May 31 14:49:52 2022] POST /identity/v3/projects => generated 401 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:49:52.768369 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a319920-5576-4c93-9aaf-c2d0306ec224 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:52.774138 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 897/1807] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:49:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:49:52.781390 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:49:52.852967 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a319920-5576-4c93-9aaf-c2d0306ec224 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:52.860633 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeba703-34bd-4191-8098-7bd18f095a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:52.861698 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeba703-34bd-4191-8098-7bd18f095a63 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:52.864386 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeba703-34bd-4191-8098-7bd18f095a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:52.864386 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeba703-34bd-4191-8098-7bd18f095a63 admin admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:52.864386 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffeba703-34bd-4191-8098-7bd18f095a63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:52.865624 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffeba703-34bd-4191-8098-7bd18f095a63 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:52.948974 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 911/1808] 10.222.0.15 () {60 vars in 1143 bytes} [Tue May 31 14:49:52 2022] POST /identity/v3/users => generated 301 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:49:52.952769 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be41bb4f-c1ec-4f5f-a016-8fb68cd24bf1 service neutron] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:52.965528 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be41bb4f-c1ec-4f5f-a016-8fb68cd24bf1 service neutron] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:52.971265 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428d1a5a-6fc4-47d8-946e-f41767249be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:52.976281 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428d1a5a-6fc4-47d8-946e-f41767249be0 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:52.976281 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428d1a5a-6fc4-47d8-946e-f41767249be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:52.976281 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428d1a5a-6fc4-47d8-946e-f41767249be0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:52.976281 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428d1a5a-6fc4-47d8-946e-f41767249be0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:52.976281 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428d1a5a-6fc4-47d8-946e-f41767249be0 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:53.001549 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 898/1809] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:49:52 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:49:53.005343 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeba703-34bd-4191-8098-7bd18f095a63 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:53.028186 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeba703-34bd-4191-8098-7bd18f095a63 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:53.039483 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eee9e9d-6d63-43ea-befb-0f6d5433939a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:53.041994 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee9e9d-6d63-43ea-befb-0f6d5433939a admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:53.042142 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee9e9d-6d63-43ea-befb-0f6d5433939a admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:53.042422 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee9e9d-6d63-43ea-befb-0f6d5433939a admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:53.043355 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eee9e9d-6d63-43ea-befb-0f6d5433939a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:53.046683 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eee9e9d-6d63-43ea-befb-0f6d5433939a admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:53.063506 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 912/1810] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:49:53 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 14:49:53.068268 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428d1a5a-6fc4-47d8-946e-f41767249be0 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:53.088242 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428d1a5a-6fc4-47d8-946e-f41767249be0 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:53.095946 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b22ce1-801e-40be-98dc-bcf15858d7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:53.097217 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b22ce1-801e-40be-98dc-bcf15858d7bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:53.099214 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b22ce1-801e-40be-98dc-bcf15858d7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:53.099597 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b22ce1-801e-40be-98dc-bcf15858d7bd admin admin] PATH_INFO: `/v3/projects/909b7ef806294c609f96cb3aaec3f478/users/2de740cbf54f4045ade685cbbb6f86b2/roles/317f725e26bf43648d8235bb1f7c4cb3` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:53.124223 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b22ce1-801e-40be-98dc-bcf15858d7bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=909b7ef806294c609f96cb3aaec3f478, user_id=2de740cbf54f4045ade685cbbb6f86b2, role_id=317f725e26bf43648d8235bb1f7c4cb3)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:53.129511 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b22ce1-801e-40be-98dc-bcf15858d7bd admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:53.245926 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 899/1811] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:49:53 2022] PUT /identity/v3/projects/909b7ef806294c609f96cb3aaec3f478/users/2de740cbf54f4045ade685cbbb6f86b2/roles/317f725e26bf43648d8235bb1f7c4cb3 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:49:53.247866 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87499f50-8ee1-4982-8043-885a7deb7f73 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:53.248161 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87499f50-8ee1-4982-8043-885a7deb7f73 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:53.248442 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87499f50-8ee1-4982-8043-885a7deb7f73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:53.316990 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-87499f50-8ee1-4982-8043-885a7deb7f73 None None] MFA Rules not processed for user `2de740cbf54f4045ade685cbbb6f86b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:49:53.318522 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-87499f50-8ee1-4982-8043-885a7deb7f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:53.561443 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 913/1812] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:49:53 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:49:53.566176 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b22ce1-801e-40be-98dc-bcf15858d7bd admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:53.581110 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87499f50-8ee1-4982-8043-885a7deb7f73 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:53.587610 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-87499f50-8ee1-4982-8043-885a7deb7f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:53.714008 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b22ce1-801e-40be-98dc-bcf15858d7bd admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:53.722118 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfd1f8a-9b33-4348-9a00-0f6392544eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:53.722942 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd1f8a-9b33-4348-9a00-0f6392544eea admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:53.723318 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd1f8a-9b33-4348-9a00-0f6392544eea admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:53.723738 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd1f8a-9b33-4348-9a00-0f6392544eea admin admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:53.724557 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfd1f8a-9b33-4348-9a00-0f6392544eea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:53.731158 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfd1f8a-9b33-4348-9a00-0f6392544eea admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:53.739499 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87499f50-8ee1-4982-8043-885a7deb7f73 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:53.746424 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f741e3-0f60-4860-95e5-476c269d7682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:53.748219 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f741e3-0f60-4860-95e5-476c269d7682 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:53.748219 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f741e3-0f60-4860-95e5-476c269d7682 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:53.748607 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f741e3-0f60-4860-95e5-476c269d7682 admin admin] PATH_INFO: `/v3/projects/0ef4ad5246e24c9a98d5595622c17449` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:53.750021 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f741e3-0f60-4860-95e5-476c269d7682 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ef4ad5246e24c9a98d5595622c17449)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:53.752019 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f741e3-0f60-4860-95e5-476c269d7682 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:53.857842 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 900/1813] 10.222.0.15 () {60 vars in 1152 bytes} [Tue May 31 14:49:53 2022] POST /identity/v3/projects => generated 399 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:49:53.858937 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfd1f8a-9b33-4348-9a00-0f6392544eea admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:53.861405 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-adfd1f8a-9b33-4348-9a00-0f6392544eea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:53.945899 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-44f741e3-0f60-4860-95e5-476c269d7682 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ef4ad5246e24c9a98d5595622c17449', 'request_id': 'req-44f741e3-0f60-4860-95e5-476c269d7682'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:54.009803 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfd1f8a-9b33-4348-9a00-0f6392544eea admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:54.024456 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-44f741e3-0f60-4860-95e5-476c269d7682 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ef4ad5246e24c9a98d5595622c17449', 'request_id': 'req-44f741e3-0f60-4860-95e5-476c269d7682'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:54.033204 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-44f741e3-0f60-4860-95e5-476c269d7682 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ef4ad5246e24c9a98d5595622c17449', 'request_id': 'req-44f741e3-0f60-4860-95e5-476c269d7682'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:54.061381 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-44f741e3-0f60-4860-95e5-476c269d7682 admin admin] The token cache is being invalidate because project 0ef4ad5246e24c9a98d5595622c17449 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80503) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 14:49:54.062331 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-44f741e3-0f60-4860-95e5-476c269d7682 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:54.063998 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-44f741e3-0f60-4860-95e5-476c269d7682 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:54.070866 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 914/1814] 10.222.0.15 () {58 vars in 1232 bytes} [Tue May 31 14:49:53 2022] DELETE /identity/v3/projects/0ef4ad5246e24c9a98d5595622c17449 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:49:54.071837 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f741e3-0f60-4860-95e5-476c269d7682 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:54.076779 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-44f741e3-0f60-4860-95e5-476c269d7682 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:54.163115 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0082da-61f2-457d-8fbd-b6b9633b7c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:54.163115 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0082da-61f2-457d-8fbd-b6b9633b7c5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:54.163115 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0082da-61f2-457d-8fbd-b6b9633b7c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:54.163115 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0082da-61f2-457d-8fbd-b6b9633b7c5a admin admin] PATH_INFO: `/v3/projects/4d7a089f11484d9faf9d2731189682af` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:54.163464 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0082da-61f2-457d-8fbd-b6b9633b7c5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d7a089f11484d9faf9d2731189682af)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:54.165077 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0082da-61f2-457d-8fbd-b6b9633b7c5a admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:54.261723 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f741e3-0f60-4860-95e5-476c269d7682 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:54.267350 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6114cdd-3be4-4c69-83a4-21b1c6289255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:54.269254 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6114cdd-3be4-4c69-83a4-21b1c6289255 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:54.269254 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6114cdd-3be4-4c69-83a4-21b1c6289255 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:54.269254 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6114cdd-3be4-4c69-83a4-21b1c6289255 admin admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:54.269862 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6114cdd-3be4-4c69-83a4-21b1c6289255 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:54.272743 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6114cdd-3be4-4c69-83a4-21b1c6289255 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:54.294808 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-3e0082da-61f2-457d-8fbd-b6b9633b7c5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d7a089f11484d9faf9d2731189682af', 'request_id': 'req-3e0082da-61f2-457d-8fbd-b6b9633b7c5a'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:54.304757 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-3e0082da-61f2-457d-8fbd-b6b9633b7c5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d7a089f11484d9faf9d2731189682af', 'request_id': 'req-3e0082da-61f2-457d-8fbd-b6b9633b7c5a'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:54.375501 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-3e0082da-61f2-457d-8fbd-b6b9633b7c5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d7a089f11484d9faf9d2731189682af', 'request_id': 'req-3e0082da-61f2-457d-8fbd-b6b9633b7c5a'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:54.386460 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 915/1815] 10.222.0.15 () {60 vars in 1143 bytes} [Tue May 31 14:49:54 2022] POST /identity/v3/users => generated 306 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:49:54.387936 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d574445f-1908-4bf4-b0dc-bd05eb509cf4 None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:54.388828 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d574445f-1908-4bf4-b0dc-bd05eb509cf4 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:54.389090 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d574445f-1908-4bf4-b0dc-bd05eb509cf4 None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:54.390622 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 916/1816] 10.222.0.15 () {54 vars in 921 bytes} [Tue May 31 14:49:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:49:54.391264 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d574445f-1908-4bf4-b0dc-bd05eb509cf4 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:54.394766 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-3e0082da-61f2-457d-8fbd-b6b9633b7c5a admin admin] The token cache is being invalidate because project 4d7a089f11484d9faf9d2731189682af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 14:49:54.395120 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-3e0082da-61f2-457d-8fbd-b6b9633b7c5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:54.395853 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-3e0082da-61f2-457d-8fbd-b6b9633b7c5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:54.397820 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-d574445f-1908-4bf4-b0dc-bd05eb509cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:54.398930 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 901/1817] 10.222.0.15 () {58 vars in 1232 bytes} [Tue May 31 14:49:53 2022] DELETE /identity/v3/projects/4d7a089f11484d9faf9d2731189682af => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:49:54.399818 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0082da-61f2-457d-8fbd-b6b9633b7c5a admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:54.401529 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-3e0082da-61f2-457d-8fbd-b6b9633b7c5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:54.480827 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0082da-61f2-457d-8fbd-b6b9633b7c5a admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:54.486039 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17438fc2-dd09-42e1-9c99-04707047544a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:54.486777 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17438fc2-dd09-42e1-9c99-04707047544a admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:54.487063 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17438fc2-dd09-42e1-9c99-04707047544a admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:54.487340 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17438fc2-dd09-42e1-9c99-04707047544a admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:54.488118 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17438fc2-dd09-42e1-9c99-04707047544a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:54.488338 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d574445f-1908-4bf4-b0dc-bd05eb509cf4 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:54.489931 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17438fc2-dd09-42e1-9c99-04707047544a admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:54.493212 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45db3e6c-34f1-4069-9812-dc98fc1983ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:54.494092 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45db3e6c-34f1-4069-9812-dc98fc1983ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:54.494374 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45db3e6c-34f1-4069-9812-dc98fc1983ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:54.494837 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45db3e6c-34f1-4069-9812-dc98fc1983ff admin admin] PATH_INFO: `/v3/users/094e4b04aab14b978e639a92bc8e0aa0` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:54.496030 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45db3e6c-34f1-4069-9812-dc98fc1983ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=094e4b04aab14b978e639a92bc8e0aa0)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:54.498184 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45db3e6c-34f1-4069-9812-dc98fc1983ff admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:54.504197 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 902/1818] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:49:54 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:49:54.504197 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b0651a-a3c4-4ebc-8ff4-d940fa6cf6a4 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:54.504197 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b0651a-a3c4-4ebc-8ff4-d940fa6cf6a4 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:54.504197 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b0651a-a3c4-4ebc-8ff4-d940fa6cf6a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:54.524134 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-e1b0651a-a3c4-4ebc-8ff4-d940fa6cf6a4 None None] MFA Rules not processed for user `b57768d448e345ad8879bf29f21b48ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:49:54.526148 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-e1b0651a-a3c4-4ebc-8ff4-d940fa6cf6a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:54.611186 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 903/1819] 10.222.0.15 () {58 vars in 1018 bytes} [Tue May 31 14:49:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:49:54.612454 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b0651a-a3c4-4ebc-8ff4-d940fa6cf6a4 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:54.613820 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-e1b0651a-a3c4-4ebc-8ff4-d940fa6cf6a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:54.633503 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b0651a-a3c4-4ebc-8ff4-d940fa6cf6a4 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:54.640643 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9117d6-6fac-41d6-ad4a-dd307fd48d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:54.641985 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9117d6-6fac-41d6-ad4a-dd307fd48d2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:54.642466 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9117d6-6fac-41d6-ad4a-dd307fd48d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:54.643013 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9117d6-6fac-41d6-ad4a-dd307fd48d2f admin admin] PATH_INFO: `/v3/users/b9a51fe8dcdd482a9fe25108ed1f66e2` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:54.644570 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9117d6-6fac-41d6-ad4a-dd307fd48d2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9a51fe8dcdd482a9fe25108ed1f66e2)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:54.647909 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9117d6-6fac-41d6-ad4a-dd307fd48d2f admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:54.692316 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-45db3e6c-34f1-4069-9812-dc98fc1983ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '094e4b04aab14b978e639a92bc8e0aa0'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:54.779444 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-45db3e6c-34f1-4069-9812-dc98fc1983ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '094e4b04aab14b978e639a92bc8e0aa0'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:54.780090 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-45db3e6c-34f1-4069-9812-dc98fc1983ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '094e4b04aab14b978e639a92bc8e0aa0'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:54.792556 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-45db3e6c-34f1-4069-9812-dc98fc1983ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '094e4b04aab14b978e639a92bc8e0aa0'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:54.795365 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-45db3e6c-34f1-4069-9812-dc98fc1983ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '094e4b04aab14b978e639a92bc8e0aa0'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:54.818807 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 917/1820] 10.222.0.15 () {58 vars in 1223 bytes} [Tue May 31 14:49:54 2022] DELETE /identity/v3/users/094e4b04aab14b978e639a92bc8e0aa0 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:49:54.819833 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45db3e6c-34f1-4069-9812-dc98fc1983ff admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:54.821163 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-45db3e6c-34f1-4069-9812-dc98fc1983ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:54.900177 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45db3e6c-34f1-4069-9812-dc98fc1983ff admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:54.910360 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f247dcae-30b8-4197-941e-7d5434ea524a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:54.911685 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f247dcae-30b8-4197-941e-7d5434ea524a admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:54.912292 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f247dcae-30b8-4197-941e-7d5434ea524a admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:54.912586 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f247dcae-30b8-4197-941e-7d5434ea524a admin admin] PATH_INFO: `/v3/projects/8755941ead87491ba6998fb95ea573af/users/715e48bbd31f4365b5e4ab2b9eb71967/roles/76c53e2c353644f885028a0226c06146` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:54.918279 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-0d9117d6-6fac-41d6-ad4a-dd307fd48d2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9a51fe8dcdd482a9fe25108ed1f66e2'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:54.927401 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-0d9117d6-6fac-41d6-ad4a-dd307fd48d2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9a51fe8dcdd482a9fe25108ed1f66e2'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:54.932602 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-0d9117d6-6fac-41d6-ad4a-dd307fd48d2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9a51fe8dcdd482a9fe25108ed1f66e2'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:54.932602 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-0d9117d6-6fac-41d6-ad4a-dd307fd48d2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9a51fe8dcdd482a9fe25108ed1f66e2'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:54.945666 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-0d9117d6-6fac-41d6-ad4a-dd307fd48d2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9a51fe8dcdd482a9fe25108ed1f66e2'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:54.963417 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f247dcae-30b8-4197-941e-7d5434ea524a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8755941ead87491ba6998fb95ea573af, user_id=715e48bbd31f4365b5e4ab2b9eb71967, role_id=76c53e2c353644f885028a0226c06146)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:54.968510 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f247dcae-30b8-4197-941e-7d5434ea524a admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:54.978671 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:49:55.090045 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 904/1822] 10.222.0.15 () {58 vars in 1223 bytes} [Tue May 31 14:49:54 2022] DELETE /identity/v3/users/b9a51fe8dcdd482a9fe25108ed1f66e2 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:49:55.090278 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 918/1822] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:49:54 2022] PUT /identity/v3/projects/8755941ead87491ba6998fb95ea573af/users/715e48bbd31f4365b5e4ab2b9eb71967/roles/76c53e2c353644f885028a0226c06146 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:49:55.093155 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9117d6-6fac-41d6-ad4a-dd307fd48d2f admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:55.094620 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f247dcae-30b8-4197-941e-7d5434ea524a admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:55.095959 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-0d9117d6-6fac-41d6-ad4a-dd307fd48d2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:55.097692 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-f247dcae-30b8-4197-941e-7d5434ea524a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:55.238253 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:49:55.242269 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f247dcae-30b8-4197-941e-7d5434ea524a admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:55.309439 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9117d6-6fac-41d6-ad4a-dd307fd48d2f admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:55.316374 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031a1120-4692-4a28-a7ec-237048ff57b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57768d448e345ad8879bf29f21b48ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:55.317114 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a1120-4692-4a28-a7ec-237048ff57b2 service nova] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:55.317409 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a1120-4692-4a28-a7ec-237048ff57b2 service nova] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:55.317946 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a1120-4692-4a28-a7ec-237048ff57b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:55.330973 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-031a1120-4692-4a28-a7ec-237048ff57b2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:55.365208 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031a1120-4692-4a28-a7ec-237048ff57b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:55.373886 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031a1120-4692-4a28-a7ec-237048ff57b2 service nova] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:55.383560 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac39c3d-d7bf-468e-931b-84e2806184ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:55.384262 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac39c3d-d7bf-468e-931b-84e2806184ec admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:55.384608 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac39c3d-d7bf-468e-931b-84e2806184ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:55.384897 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac39c3d-d7bf-468e-931b-84e2806184ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:55.385705 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac39c3d-d7bf-468e-931b-84e2806184ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:55.389410 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac39c3d-d7bf-468e-931b-84e2806184ec admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:55.412509 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 919/1823] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:49:55 2022] GET /identity/v3/roles => generated 1420 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 14:49:55.412815 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 905/1824] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:49:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:49:55.415628 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac39c3d-d7bf-468e-931b-84e2806184ec admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:55.429752 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac39c3d-d7bf-468e-931b-84e2806184ec admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:55.438279 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77ef3d2-c64e-46a7-ac77-1f1e2b773597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:55.438279 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ef3d2-c64e-46a7-ac77-1f1e2b773597 admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:55.438592 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ef3d2-c64e-46a7-ac77-1f1e2b773597 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:55.438980 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ef3d2-c64e-46a7-ac77-1f1e2b773597 admin admin] PATH_INFO: `/v3/projects/8755941ead87491ba6998fb95ea573af/users/715e48bbd31f4365b5e4ab2b9eb71967/roles/76c53e2c353644f885028a0226c06146` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:55.441473 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77ef3d2-c64e-46a7-ac77-1f1e2b773597 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8755941ead87491ba6998fb95ea573af, user_id=715e48bbd31f4365b5e4ab2b9eb71967, role_id=76c53e2c353644f885028a0226c06146)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:55.448482 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77ef3d2-c64e-46a7-ac77-1f1e2b773597 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:55.465197 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 920/1825] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:49:55 2022] PUT /identity/v3/projects/8755941ead87491ba6998fb95ea573af/users/715e48bbd31f4365b5e4ab2b9eb71967/roles/76c53e2c353644f885028a0226c06146 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:49:55.477168 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48f0cef-20dd-49b9-91de-e0d10223d243 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:55.477465 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48f0cef-20dd-49b9-91de-e0d10223d243 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:55.477888 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48f0cef-20dd-49b9-91de-e0d10223d243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:55.520653 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-d48f0cef-20dd-49b9-91de-e0d10223d243 None None] MFA Rules not processed for user `715e48bbd31f4365b5e4ab2b9eb71967`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:49:55.545887 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-d48f0cef-20dd-49b9-91de-e0d10223d243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:55.673302 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 906/1826] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:49:55 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:49:55.690152 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77ef3d2-c64e-46a7-ac77-1f1e2b773597 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:55.696211 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-a77ef3d2-c64e-46a7-ac77-1f1e2b773597 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:55.777620 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77ef3d2-c64e-46a7-ac77-1f1e2b773597 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:55.797565 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c2ee35-6087-4411-92d2-4f6713b67e41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afbf718dcd9b4741a926b0a2321bd53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:55.798435 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c2ee35-6087-4411-92d2-4f6713b67e41 service cinder] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:55.798889 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c2ee35-6087-4411-92d2-4f6713b67e41 service cinder] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:55.799177 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c2ee35-6087-4411-92d2-4f6713b67e41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:55.815720 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c2ee35-6087-4411-92d2-4f6713b67e41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:55.818841 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48f0cef-20dd-49b9-91de-e0d10223d243 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:55.824528 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-d48f0cef-20dd-49b9-91de-e0d10223d243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:55.843620 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c2ee35-6087-4411-92d2-4f6713b67e41 service cinder] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:55.898901 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 921/1827] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:49:55 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:49:55.945036 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=88,keystone:DELETE=8,keystone:INSERT=4 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:49:56.003878 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48f0cef-20dd-49b9-91de-e0d10223d243 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:56.011398 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c70b92-61b0-4464-b873-66a12d143127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:56.012633 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c70b92-61b0-4464-b873-66a12d143127 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:56.013289 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c70b92-61b0-4464-b873-66a12d143127 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:56.013719 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c70b92-61b0-4464-b873-66a12d143127 admin admin] PATH_INFO: `/v3/projects/ae8662601bdd4d35b003217e682a7e22` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:56.022530 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c70b92-61b0-4464-b873-66a12d143127 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae8662601bdd4d35b003217e682a7e22)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:56.024552 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c70b92-61b0-4464-b873-66a12d143127 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:56.145593 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c2ee35-6087-4411-92d2-4f6713b67e41 service cinder] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:56.163065 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c2ee35-6087-4411-92d2-4f6713b67e41 service cinder] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:56.187940 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-c1c70b92-61b0-4464-b873-66a12d143127 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae8662601bdd4d35b003217e682a7e22', 'request_id': 'req-c1c70b92-61b0-4464-b873-66a12d143127'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:56.198989 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-c1c70b92-61b0-4464-b873-66a12d143127 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae8662601bdd4d35b003217e682a7e22', 'request_id': 'req-c1c70b92-61b0-4464-b873-66a12d143127'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:56.263685 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded2b11a-a5c9-4e41-8a6e-9c03a4c66e55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afbf718dcd9b4741a926b0a2321bd53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:56.264407 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded2b11a-a5c9-4e41-8a6e-9c03a4c66e55 service cinder] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:56.265070 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded2b11a-a5c9-4e41-8a6e-9c03a4c66e55 service cinder] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:56.265178 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded2b11a-a5c9-4e41-8a6e-9c03a4c66e55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:56.267086 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-ded2b11a-a5c9-4e41-8a6e-9c03a4c66e55 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:56.299845 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-c1c70b92-61b0-4464-b873-66a12d143127 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae8662601bdd4d35b003217e682a7e22', 'request_id': 'req-c1c70b92-61b0-4464-b873-66a12d143127'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:56.314503 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-c1c70b92-61b0-4464-b873-66a12d143127 admin admin] The token cache is being invalidate because project ae8662601bdd4d35b003217e682a7e22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 14:49:56.315107 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-c1c70b92-61b0-4464-b873-66a12d143127 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:56.316134 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-c1c70b92-61b0-4464-b873-66a12d143127 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:56.318834 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 907/1828] 10.222.0.15 () {58 vars in 1232 bytes} [Tue May 31 14:49:55 2022] DELETE /identity/v3/projects/ae8662601bdd4d35b003217e682a7e22 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 14:49:56.323729 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e659612c-d929-4ced-89af-c784da8867ed None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:56.324188 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e659612c-d929-4ced-89af-c784da8867ed None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:56.324476 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e659612c-d929-4ced-89af-c784da8867ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:56.330152 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:49:56.347559 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-e659612c-d929-4ced-89af-c784da8867ed None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:49:56.348671 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-e659612c-d929-4ced-89af-c784da8867ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:56.349658 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded2b11a-a5c9-4e41-8a6e-9c03a4c66e55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:56.351252 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded2b11a-a5c9-4e41-8a6e-9c03a4c66e55 service cinder] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:56.365869 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 922/1829] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:49:56 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 14:49:56.430604 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 908/1830] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:49:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:49:56.434313 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de83d4e-71bb-4bb6-9c71-8f831b9ead7e None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:56.434313 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de83d4e-71bb-4bb6-9c71-8f831b9ead7e None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:56.434313 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de83d4e-71bb-4bb6-9c71-8f831b9ead7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:56.455788 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-3de83d4e-71bb-4bb6-9c71-8f831b9ead7e None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:49:56.457333 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-3de83d4e-71bb-4bb6-9c71-8f831b9ead7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:56.467938 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 923/1831] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:49:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:49:56.471776 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e659612c-d929-4ced-89af-c784da8867ed None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:56.484911 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e659612c-d929-4ced-89af-c784da8867ed None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:56.490418 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c079a711-9939-4eb5-b1bc-944314e4bbbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:56.491702 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c079a711-9939-4eb5-b1bc-944314e4bbbd admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:56.491702 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c079a711-9939-4eb5-b1bc-944314e4bbbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:56.492030 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c079a711-9939-4eb5-b1bc-944314e4bbbd admin admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:56.492892 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c079a711-9939-4eb5-b1bc-944314e4bbbd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:49:56.493276 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c079a711-9939-4eb5-b1bc-944314e4bbbd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:56.495095 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c079a711-9939-4eb5-b1bc-944314e4bbbd admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:56.516934 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 909/1832] 10.222.0.15 () {58 vars in 1152 bytes} [Tue May 31 14:49:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:49:56.521288 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de83d4e-71bb-4bb6-9c71-8f831b9ead7e None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:56.531378 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de83d4e-71bb-4bb6-9c71-8f831b9ead7e None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:56.537783 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e64fed-445f-4f6b-a881-b4cc6cf8733f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:56.538673 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e64fed-445f-4f6b-a881-b4cc6cf8733f admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:56.541131 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e64fed-445f-4f6b-a881-b4cc6cf8733f admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:56.541131 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e64fed-445f-4f6b-a881-b4cc6cf8733f admin admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:56.541131 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e64fed-445f-4f6b-a881-b4cc6cf8733f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:56.542649 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e64fed-445f-4f6b-a881-b4cc6cf8733f admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:56.633753 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 924/1833] 10.222.0.15 () {60 vars in 1152 bytes} [Tue May 31 14:49:56 2022] POST /identity/v3/projects => generated 373 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:49:56.637886 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c079a711-9939-4eb5-b1bc-944314e4bbbd admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:56.649768 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c079a711-9939-4eb5-b1bc-944314e4bbbd admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:56.739848 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e18d32d-65ac-4dd8-9cc4-656e00d8a2c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:56.740578 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e18d32d-65ac-4dd8-9cc4-656e00d8a2c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:56.740938 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e18d32d-65ac-4dd8-9cc4-656e00d8a2c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:56.741156 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e18d32d-65ac-4dd8-9cc4-656e00d8a2c4 admin admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:56.744018 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e18d32d-65ac-4dd8-9cc4-656e00d8a2c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:56.746044 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e18d32d-65ac-4dd8-9cc4-656e00d8a2c4 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:56.877653 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 910/1834] 10.222.0.15 () {60 vars in 1143 bytes} [Tue May 31 14:49:56 2022] POST /identity/v3/users => generated 287 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:49:56.881608 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e64fed-445f-4f6b-a881-b4cc6cf8733f admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:56.909207 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e64fed-445f-4f6b-a881-b4cc6cf8733f admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:56.914773 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afe3320-65c2-4ae8-a3ac-615d8003394d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:56.915857 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afe3320-65c2-4ae8-a3ac-615d8003394d admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:56.916300 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afe3320-65c2-4ae8-a3ac-615d8003394d admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:56.916592 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afe3320-65c2-4ae8-a3ac-615d8003394d admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:56.929522 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afe3320-65c2-4ae8-a3ac-615d8003394d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:56.934180 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afe3320-65c2-4ae8-a3ac-615d8003394d admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:56.957226 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 925/1835] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:49:56 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:49:56.961111 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e18d32d-65ac-4dd8-9cc4-656e00d8a2c4 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:56.976004 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e18d32d-65ac-4dd8-9cc4-656e00d8a2c4 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:56.981174 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ac78a2-7d84-4042-a511-de4cd7a2a6f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:56.982259 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ac78a2-7d84-4042-a511-de4cd7a2a6f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:56.982834 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ac78a2-7d84-4042-a511-de4cd7a2a6f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:56.983250 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ac78a2-7d84-4042-a511-de4cd7a2a6f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:56.984117 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ac78a2-7d84-4042-a511-de4cd7a2a6f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:56.986260 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ac78a2-7d84-4042-a511-de4cd7a2a6f9 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:57.016336 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 911/1836] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:49:56 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:49:57.017170 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afe3320-65c2-4ae8-a3ac-615d8003394d admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:57.032991 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ac78a2-7d84-4042-a511-de4cd7a2a6f9 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:57.037320 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-44ac78a2-7d84-4042-a511-de4cd7a2a6f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:57.038975 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afe3320-65c2-4ae8-a3ac-615d8003394d admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:57.047951 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8882c197-baad-4615-8c96-c0bb3593fc3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:57.049005 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8882c197-baad-4615-8c96-c0bb3593fc3b admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:57.049419 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8882c197-baad-4615-8c96-c0bb3593fc3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:57.049757 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8882c197-baad-4615-8c96-c0bb3593fc3b admin admin] PATH_INFO: `/v3/projects/be1022533b9d42d38f7cccf2a0f7eeff/users/5c87ed83c37f4072933055dc82191040/roles/317f725e26bf43648d8235bb1f7c4cb3` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:57.067156 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ac78a2-7d84-4042-a511-de4cd7a2a6f9 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:57.068323 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8882c197-baad-4615-8c96-c0bb3593fc3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=be1022533b9d42d38f7cccf2a0f7eeff, user_id=5c87ed83c37f4072933055dc82191040, role_id=317f725e26bf43648d8235bb1f7c4cb3)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:57.075266 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8882c197-baad-4615-8c96-c0bb3593fc3b admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:57.079490 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96486248-2783-4438-82a8-4c7fba36d91e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:57.080448 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96486248-2783-4438-82a8-4c7fba36d91e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:57.080729 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96486248-2783-4438-82a8-4c7fba36d91e admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:57.081005 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96486248-2783-4438-82a8-4c7fba36d91e admin admin] PATH_INFO: `/v3/projects/6075deb1d1e4431ea692bd9e99eab39b` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:57.084224 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96486248-2783-4438-82a8-4c7fba36d91e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6075deb1d1e4431ea692bd9e99eab39b)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:57.087019 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96486248-2783-4438-82a8-4c7fba36d91e admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:57.226258 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 926/1837] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:49:57 2022] PUT /identity/v3/projects/be1022533b9d42d38f7cccf2a0f7eeff/users/5c87ed83c37f4072933055dc82191040/roles/317f725e26bf43648d8235bb1f7c4cb3 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:49:57.259532 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7207a9-18c7-48ae-89c6-828a6380d4c1 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:57.260565 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7207a9-18c7-48ae-89c6-828a6380d4c1 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:57.261138 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7207a9-18c7-48ae-89c6-828a6380d4c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:57.357757 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-96486248-2783-4438-82a8-4c7fba36d91e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6075deb1d1e4431ea692bd9e99eab39b', 'request_id': 'req-96486248-2783-4438-82a8-4c7fba36d91e'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:57.396556 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-96486248-2783-4438-82a8-4c7fba36d91e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6075deb1d1e4431ea692bd9e99eab39b', 'request_id': 'req-96486248-2783-4438-82a8-4c7fba36d91e'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:57.398884 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-8b7207a9-18c7-48ae-89c6-828a6380d4c1 None None] MFA Rules not processed for user `5c87ed83c37f4072933055dc82191040`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:49:57.406488 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-8b7207a9-18c7-48ae-89c6-828a6380d4c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:57.517180 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-96486248-2783-4438-82a8-4c7fba36d91e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6075deb1d1e4431ea692bd9e99eab39b', 'request_id': 'req-96486248-2783-4438-82a8-4c7fba36d91e'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:57.527545 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 927/1838] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:49:57 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 14:49:57.532901 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7207a9-18c7-48ae-89c6-828a6380d4c1 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:57.555314 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-96486248-2783-4438-82a8-4c7fba36d91e admin admin] The token cache is being invalidate because project 6075deb1d1e4431ea692bd9e99eab39b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 14:49:57.555605 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-96486248-2783-4438-82a8-4c7fba36d91e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:57.556272 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-96486248-2783-4438-82a8-4c7fba36d91e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:49:57.558058 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 912/1839] 10.222.0.15 () {58 vars in 1232 bytes} [Tue May 31 14:49:57 2022] DELETE /identity/v3/projects/6075deb1d1e4431ea692bd9e99eab39b => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 14:49:57.562920 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c718c1-ebf8-47a5-b8cc-9224a3cfad40 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:57.563211 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c718c1-ebf8-47a5-b8cc-9224a3cfad40 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:57.563504 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c718c1-ebf8-47a5-b8cc-9224a3cfad40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:57.592196 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-09c718c1-ebf8-47a5-b8cc-9224a3cfad40 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:49:57.593436 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-09c718c1-ebf8-47a5-b8cc-9224a3cfad40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:57.645912 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7207a9-18c7-48ae-89c6-828a6380d4c1 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:57.652560 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbd0a37-42b9-4e76-b2d0-d2e1d658b9a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:57.654105 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd0a37-42b9-4e76-b2d0-d2e1d658b9a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:57.654733 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd0a37-42b9-4e76-b2d0-d2e1d658b9a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:57.655312 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd0a37-42b9-4e76-b2d0-d2e1d658b9a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:57.656290 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbd0a37-42b9-4e76-b2d0-d2e1d658b9a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:57.662245 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbd0a37-42b9-4e76-b2d0-d2e1d658b9a3 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:57.665530 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:49:57.682319 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 913/1840] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:49:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:49:57.691935 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b29f441-2fc9-4170-ba37-f5513892a67c None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:57.692289 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b29f441-2fc9-4170-ba37-f5513892a67c None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:57.692592 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b29f441-2fc9-4170-ba37-f5513892a67c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:57.715248 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-8b29f441-2fc9-4170-ba37-f5513892a67c None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:49:57.716997 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-8b29f441-2fc9-4170-ba37-f5513892a67c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:57.724912 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 914/1841] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:49:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:49:57.729050 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b29f441-2fc9-4170-ba37-f5513892a67c None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:57.738016 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b29f441-2fc9-4170-ba37-f5513892a67c None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:57.751776 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ca3b58-4dba-491a-85c1-3c12d0c22f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:57.754230 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca3b58-4dba-491a-85c1-3c12d0c22f9a admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:57.754230 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca3b58-4dba-491a-85c1-3c12d0c22f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:57.754230 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca3b58-4dba-491a-85c1-3c12d0c22f9a admin admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:57.754230 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ca3b58-4dba-491a-85c1-3c12d0c22f9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:49:57.754764 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ca3b58-4dba-491a-85c1-3c12d0c22f9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:57.756035 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ca3b58-4dba-491a-85c1-3c12d0c22f9a admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:57.771812 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 915/1842] 10.222.0.15 () {58 vars in 1152 bytes} [Tue May 31 14:49:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 14:49:57.781196 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ca3b58-4dba-491a-85c1-3c12d0c22f9a admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:57.795882 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ca3b58-4dba-491a-85c1-3c12d0c22f9a admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:57.801926 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83858c9c-b1c6-4263-9171-71a363c8119d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:57.802933 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83858c9c-b1c6-4263-9171-71a363c8119d admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:57.803239 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83858c9c-b1c6-4263-9171-71a363c8119d admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:57.805919 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83858c9c-b1c6-4263-9171-71a363c8119d admin admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:57.805919 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83858c9c-b1c6-4263-9171-71a363c8119d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:57.806745 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83858c9c-b1c6-4263-9171-71a363c8119d admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:57.835792 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 928/1843] 10.222.0.15 () {60 vars in 1152 bytes} [Tue May 31 14:49:57 2022] POST /identity/v3/projects => generated 371 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:49:57.836702 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbd0a37-42b9-4e76-b2d0-d2e1d658b9a3 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:57.838355 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-ecbd0a37-42b9-4e76-b2d0-d2e1d658b9a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:57.906666 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbd0a37-42b9-4e76-b2d0-d2e1d658b9a3 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:57.908587 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 916/1844] 10.222.0.15 () {60 vars in 1152 bytes} [Tue May 31 14:49:57 2022] POST /identity/v3/projects => generated 379 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:49:57.914241 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83858c9c-b1c6-4263-9171-71a363c8119d admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:57.972162 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4dfa8a-b072-4efa-9ba8-3baf50a49e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:57.975480 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4dfa8a-b072-4efa-9ba8-3baf50a49e7a admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:57.975480 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4dfa8a-b072-4efa-9ba8-3baf50a49e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:57.975480 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4dfa8a-b072-4efa-9ba8-3baf50a49e7a admin admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:57.975480 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4dfa8a-b072-4efa-9ba8-3baf50a49e7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:57.976257 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4dfa8a-b072-4efa-9ba8-3baf50a49e7a admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:57.980929 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83858c9c-b1c6-4263-9171-71a363c8119d admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:57.986529 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86157c0b-5baf-449b-a703-f20dd252d3e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:57.987239 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86157c0b-5baf-449b-a703-f20dd252d3e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:57.987524 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86157c0b-5baf-449b-a703-f20dd252d3e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:57.987836 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86157c0b-5baf-449b-a703-f20dd252d3e6 admin admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:57.988520 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86157c0b-5baf-449b-a703-f20dd252d3e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:57.990440 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86157c0b-5baf-449b-a703-f20dd252d3e6 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:58.057076 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 929/1845] 10.222.0.15 () {60 vars in 1143 bytes} [Tue May 31 14:49:57 2022] POST /identity/v3/users => generated 292 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:49:58.058365 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4dfa8a-b072-4efa-9ba8-3baf50a49e7a admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:58.088088 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 917/1846] 10.222.0.15 () {60 vars in 1143 bytes} [Tue May 31 14:49:57 2022] POST /identity/v3/users => generated 290 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:49:58.089288 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86157c0b-5baf-449b-a703-f20dd252d3e6 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:58.102248 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4dfa8a-b072-4efa-9ba8-3baf50a49e7a admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:58.116228 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86157c0b-5baf-449b-a703-f20dd252d3e6 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:58.126846 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cf7295-3204-4c9f-8f6b-00047a85da8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:58.127729 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cf7295-3204-4c9f-8f6b-00047a85da8c admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:58.128302 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cf7295-3204-4c9f-8f6b-00047a85da8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:58.128467 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cf7295-3204-4c9f-8f6b-00047a85da8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:58.129309 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cf7295-3204-4c9f-8f6b-00047a85da8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:58.137436 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cf7295-3204-4c9f-8f6b-00047a85da8c admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:58.140696 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0261a9c3-39cd-4dfa-a833-f089cc465c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:58.141620 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0261a9c3-39cd-4dfa-a833-f089cc465c4a admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:58.142095 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0261a9c3-39cd-4dfa-a833-f089cc465c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:58.142761 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0261a9c3-39cd-4dfa-a833-f089cc465c4a admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:58.151882 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0261a9c3-39cd-4dfa-a833-f089cc465c4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:58.153819 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 930/1847] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:49:58 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:49:58.157009 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0261a9c3-39cd-4dfa-a833-f089cc465c4a admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:58.159004 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cf7295-3204-4c9f-8f6b-00047a85da8c admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:58.161594 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:49:58.174406 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cf7295-3204-4c9f-8f6b-00047a85da8c admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:58.178735 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 918/1848] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:49:58 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:49:58.180248 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0261a9c3-39cd-4dfa-a833-f089cc465c4a admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:58.192338 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0261a9c3-39cd-4dfa-a833-f089cc465c4a admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:58.193233 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da193d6b-fc1b-47c6-be98-779f42ec4c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:58.194139 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da193d6b-fc1b-47c6-be98-779f42ec4c04 admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:58.194478 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da193d6b-fc1b-47c6-be98-779f42ec4c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:58.194796 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da193d6b-fc1b-47c6-be98-779f42ec4c04 admin admin] PATH_INFO: `/v3/projects/e46eec614a0b4be39df20f564e8f0fe1/users/122fb6defa8b49b08843dbf6f9c67312/roles/76c53e2c353644f885028a0226c06146` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:58.198935 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016340c0-68ba-4a1a-aaef-917dc7ba74b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:58.199803 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016340c0-68ba-4a1a-aaef-917dc7ba74b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:58.201854 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016340c0-68ba-4a1a-aaef-917dc7ba74b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:58.202373 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016340c0-68ba-4a1a-aaef-917dc7ba74b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:58.203190 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016340c0-68ba-4a1a-aaef-917dc7ba74b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:58.205130 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016340c0-68ba-4a1a-aaef-917dc7ba74b2 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:58.218206 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 919/1849] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:49:58 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:49:58.219778 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da193d6b-fc1b-47c6-be98-779f42ec4c04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e46eec614a0b4be39df20f564e8f0fe1, user_id=122fb6defa8b49b08843dbf6f9c67312, role_id=76c53e2c353644f885028a0226c06146)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:58.222888 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016340c0-68ba-4a1a-aaef-917dc7ba74b2 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:58.230191 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da193d6b-fc1b-47c6-be98-779f42ec4c04 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:58.244512 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016340c0-68ba-4a1a-aaef-917dc7ba74b2 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:58.251816 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa63d770-c7c3-4566-a4a3-72a4c04e0988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:58.252867 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63d770-c7c3-4566-a4a3-72a4c04e0988 admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:58.253357 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63d770-c7c3-4566-a4a3-72a4c04e0988 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:58.253804 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63d770-c7c3-4566-a4a3-72a4c04e0988 admin admin] PATH_INFO: `/v3/projects/083c9d149e6f4f27b021f9dae561891e/users/1dbbd60f7d254b2885eae8c7d04d5fcd/roles/317f725e26bf43648d8235bb1f7c4cb3` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:58.278223 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa63d770-c7c3-4566-a4a3-72a4c04e0988 admin admin] RBAC: Authorizing `identity:create_grant(project_id=083c9d149e6f4f27b021f9dae561891e, user_id=1dbbd60f7d254b2885eae8c7d04d5fcd, role_id=317f725e26bf43648d8235bb1f7c4cb3)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:58.281335 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa63d770-c7c3-4566-a4a3-72a4c04e0988 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:58.374851 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 920/1850] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:49:58 2022] PUT /identity/v3/projects/083c9d149e6f4f27b021f9dae561891e/users/1dbbd60f7d254b2885eae8c7d04d5fcd/roles/317f725e26bf43648d8235bb1f7c4cb3 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:49:58.375035 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 931/1851] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:49:58 2022] PUT /identity/v3/projects/e46eec614a0b4be39df20f564e8f0fe1/users/122fb6defa8b49b08843dbf6f9c67312/roles/76c53e2c353644f885028a0226c06146 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 14:49:58.375129 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa63d770-c7c3-4566-a4a3-72a4c04e0988 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:58.376685 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7064ccc9-7eb2-4dbf-9743-ef770808a236 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:58.377072 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7064ccc9-7eb2-4dbf-9743-ef770808a236 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:58.377328 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7064ccc9-7eb2-4dbf-9743-ef770808a236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:58.409706 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-7064ccc9-7eb2-4dbf-9743-ef770808a236 None None] MFA Rules not processed for user `1dbbd60f7d254b2885eae8c7d04d5fcd`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:49:58.411831 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-7064ccc9-7eb2-4dbf-9743-ef770808a236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:58.471555 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa63d770-c7c3-4566-a4a3-72a4c04e0988 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:58.491993 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 932/1852] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:49:58 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 14:49:58.496634 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7064ccc9-7eb2-4dbf-9743-ef770808a236 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:58.577459 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7064ccc9-7eb2-4dbf-9743-ef770808a236 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:58.582699 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4135bb5b-1047-4bc8-8f7e-8962924ebe2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:58.584967 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4135bb5b-1047-4bc8-8f7e-8962924ebe2e admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:58.585416 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4135bb5b-1047-4bc8-8f7e-8962924ebe2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:58.585706 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4135bb5b-1047-4bc8-8f7e-8962924ebe2e admin admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:58.586419 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4135bb5b-1047-4bc8-8f7e-8962924ebe2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:58.588863 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4135bb5b-1047-4bc8-8f7e-8962924ebe2e admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:58.614140 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c074e6-6193-46d8-9987-62c8539a2fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:58.616443 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c074e6-6193-46d8-9987-62c8539a2fd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:58.616443 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c074e6-6193-46d8-9987-62c8539a2fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:58.616443 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c074e6-6193-46d8-9987-62c8539a2fd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:58.617454 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c074e6-6193-46d8-9987-62c8539a2fd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:58.619730 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c074e6-6193-46d8-9987-62c8539a2fd6 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:58.635532 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 921/1853] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:49:58 2022] GET /identity/v3/roles => generated 1420 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:49:58.637430 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c074e6-6193-46d8-9987-62c8539a2fd6 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:58.652859 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c074e6-6193-46d8-9987-62c8539a2fd6 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:58.660700 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11beaf0-0500-4536-98a3-ae9d08db7859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:58.662045 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11beaf0-0500-4536-98a3-ae9d08db7859 admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:58.673115 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11beaf0-0500-4536-98a3-ae9d08db7859 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:58.673115 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11beaf0-0500-4536-98a3-ae9d08db7859 admin admin] PATH_INFO: `/v3/projects/e46eec614a0b4be39df20f564e8f0fe1/users/122fb6defa8b49b08843dbf6f9c67312/roles/76c53e2c353644f885028a0226c06146` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:58.673115 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11beaf0-0500-4536-98a3-ae9d08db7859 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e46eec614a0b4be39df20f564e8f0fe1, user_id=122fb6defa8b49b08843dbf6f9c67312, role_id=76c53e2c353644f885028a0226c06146)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:58.674155 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11beaf0-0500-4536-98a3-ae9d08db7859 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:58.686699 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 922/1854] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:49:58 2022] PUT /identity/v3/projects/e46eec614a0b4be39df20f564e8f0fe1/users/122fb6defa8b49b08843dbf6f9c67312/roles/76c53e2c353644f885028a0226c06146 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:49:58.698915 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2f18a1-538f-4c75-9423-9d7dfc0c1097 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:58.699229 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2f18a1-538f-4c75-9423-9d7dfc0c1097 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:58.699513 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2f18a1-538f-4c75-9423-9d7dfc0c1097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:58.733763 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-2d2f18a1-538f-4c75-9423-9d7dfc0c1097 None None] MFA Rules not processed for user `122fb6defa8b49b08843dbf6f9c67312`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:49:58.735199 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-2d2f18a1-538f-4c75-9423-9d7dfc0c1097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:58.813583 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 933/1855] 10.222.0.15 () {60 vars in 1152 bytes} [Tue May 31 14:49:58 2022] POST /identity/v3/projects => generated 377 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:49:58.816725 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4135bb5b-1047-4bc8-8f7e-8962924ebe2e admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:58.902911 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 923/1856] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:49:58 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:49:58.923117 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4135bb5b-1047-4bc8-8f7e-8962924ebe2e admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:58.932603 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72203d41-dd1a-4541-8cfb-266566936f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:58.933446 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72203d41-dd1a-4541-8cfb-266566936f8b admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:58.933738 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72203d41-dd1a-4541-8cfb-266566936f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:58.934019 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72203d41-dd1a-4541-8cfb-266566936f8b admin admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:58.935440 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72203d41-dd1a-4541-8cfb-266566936f8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:58.937374 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72203d41-dd1a-4541-8cfb-266566936f8b admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:59.062676 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 934/1857] 10.222.0.15 () {60 vars in 1143 bytes} [Tue May 31 14:49:58 2022] POST /identity/v3/users => generated 295 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:49:59.074567 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2f18a1-538f-4c75-9423-9d7dfc0c1097 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:59.074567 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-2d2f18a1-538f-4c75-9423-9d7dfc0c1097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:59.077577 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72203d41-dd1a-4541-8cfb-266566936f8b admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:59.088353 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72203d41-dd1a-4541-8cfb-266566936f8b admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:59.093551 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941b4b33-911b-4351-9fa6-fca8a20e3438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:59.094278 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941b4b33-911b-4351-9fa6-fca8a20e3438 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:59.094686 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941b4b33-911b-4351-9fa6-fca8a20e3438 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:59.095011 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941b4b33-911b-4351-9fa6-fca8a20e3438 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:59.095961 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941b4b33-911b-4351-9fa6-fca8a20e3438 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:59.097736 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941b4b33-911b-4351-9fa6-fca8a20e3438 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:59.110589 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 935/1858] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:49:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:49:59.112970 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941b4b33-911b-4351-9fa6-fca8a20e3438 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:59.124317 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941b4b33-911b-4351-9fa6-fca8a20e3438 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:59.129468 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7180c4be-2248-48cb-a88b-69c83c3aaba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:59.132078 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7180c4be-2248-48cb-a88b-69c83c3aaba8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:59.132078 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7180c4be-2248-48cb-a88b-69c83c3aaba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:59.132078 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7180c4be-2248-48cb-a88b-69c83c3aaba8 admin admin] PATH_INFO: `/v3/projects/71a948da3f104d208e0ee4c984d11489/users/a0cfd9b6842048028d635ee8449ce7ca/roles/76c53e2c353644f885028a0226c06146` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:59.146475 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2f18a1-538f-4c75-9423-9d7dfc0c1097 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:59.156139 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7180c4be-2248-48cb-a88b-69c83c3aaba8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71a948da3f104d208e0ee4c984d11489, user_id=a0cfd9b6842048028d635ee8449ce7ca, role_id=76c53e2c353644f885028a0226c06146)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:59.159758 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7180c4be-2248-48cb-a88b-69c83c3aaba8 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:59.225610 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e54e2c8-a1ff-4d10-bd64-d8f7f84e60b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afbf718dcd9b4741a926b0a2321bd53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:59.226339 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e54e2c8-a1ff-4d10-bd64-d8f7f84e60b1 service cinder] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:59.226662 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e54e2c8-a1ff-4d10-bd64-d8f7f84e60b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:59.227206 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e54e2c8-a1ff-4d10-bd64-d8f7f84e60b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:59.234695 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 936/1859] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:49:59 2022] PUT /identity/v3/projects/71a948da3f104d208e0ee4c984d11489/users/a0cfd9b6842048028d635ee8449ce7ca/roles/76c53e2c353644f885028a0226c06146 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 14:49:59.238803 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7180c4be-2248-48cb-a88b-69c83c3aaba8 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:59.323991 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e54e2c8-a1ff-4d10-bd64-d8f7f84e60b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:59.326206 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e54e2c8-a1ff-4d10-bd64-d8f7f84e60b1 service cinder] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:59.342881 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7180c4be-2248-48cb-a88b-69c83c3aaba8 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:59.348525 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f925debb-1d03-4ab2-95b2-85015f467964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:59.349407 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f925debb-1d03-4ab2-95b2-85015f467964 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:59.349697 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f925debb-1d03-4ab2-95b2-85015f467964 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:59.350128 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f925debb-1d03-4ab2-95b2-85015f467964 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:59.351995 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f925debb-1d03-4ab2-95b2-85015f467964 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:59.352951 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f925debb-1d03-4ab2-95b2-85015f467964 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:59.353289 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 924/1860] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:49:59 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 14:49:59.367493 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 937/1861] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:49:59 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:49:59.373499 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e54e2c8-a1ff-4d10-bd64-d8f7f84e60b1 service cinder] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:59.385970 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e54e2c8-a1ff-4d10-bd64-d8f7f84e60b1 service cinder] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:59.392113 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc75d61-f774-4f93-8673-2dd02cbbe97b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:59.393007 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc75d61-f774-4f93-8673-2dd02cbbe97b admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:59.393292 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc75d61-f774-4f93-8673-2dd02cbbe97b admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:59.393677 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc75d61-f774-4f93-8673-2dd02cbbe97b admin admin] PATH_INFO: `/v3/projects/71a948da3f104d208e0ee4c984d11489/users/a0cfd9b6842048028d635ee8449ce7ca/roles/76c53e2c353644f885028a0226c06146` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:59.396899 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc75d61-f774-4f93-8673-2dd02cbbe97b admin admin] RBAC: Authorizing `identity:create_grant(project_id=71a948da3f104d208e0ee4c984d11489, user_id=a0cfd9b6842048028d635ee8449ce7ca, role_id=76c53e2c353644f885028a0226c06146)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:59.399704 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc75d61-f774-4f93-8673-2dd02cbbe97b admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:59.431191 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 925/1862] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:49:59 2022] PUT /identity/v3/projects/71a948da3f104d208e0ee4c984d11489/users/a0cfd9b6842048028d635ee8449ce7ca/roles/76c53e2c353644f885028a0226c06146 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:49:59.433584 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282bb5bf-22d6-476d-8ef9-5c2abd201961 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:59.434063 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282bb5bf-22d6-476d-8ef9-5c2abd201961 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:59.435259 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282bb5bf-22d6-476d-8ef9-5c2abd201961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:59.471508 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-282bb5bf-22d6-476d-8ef9-5c2abd201961 None None] MFA Rules not processed for user `a0cfd9b6842048028d635ee8449ce7ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:49:59.475629 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-282bb5bf-22d6-476d-8ef9-5c2abd201961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:59.592479 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc75d61-f774-4f93-8673-2dd02cbbe97b admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:59.629472 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 938/1863] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:49:59 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:49:59.638311 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282bb5bf-22d6-476d-8ef9-5c2abd201961 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:49:59.639858 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-282bb5bf-22d6-476d-8ef9-5c2abd201961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:59.661996 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:49:59.677209 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc75d61-f774-4f93-8673-2dd02cbbe97b admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:59.683074 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f09915-71ca-40f6-ac64-ffd5c19a04c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afbf718dcd9b4741a926b0a2321bd53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:59.683646 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f09915-71ca-40f6-ac64-ffd5c19a04c6 service cinder] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:59.683934 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f09915-71ca-40f6-ac64-ffd5c19a04c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:59.684214 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f09915-71ca-40f6-ac64-ffd5c19a04c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:59.686581 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-c3f09915-71ca-40f6-ac64-ffd5c19a04c6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:49:59.712765 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282bb5bf-22d6-476d-8ef9-5c2abd201961 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:49:59.716728 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7eb6c8-41e2-4362-8e0a-ee01f5f5c73f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afbf718dcd9b4741a926b0a2321bd53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:49:59.717475 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7eb6c8-41e2-4362-8e0a-ee01f5f5c73f service cinder] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:49:59.717883 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7eb6c8-41e2-4362-8e0a-ee01f5f5c73f service cinder] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:49:59.718264 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7eb6c8-41e2-4362-8e0a-ee01f5f5c73f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:49:59.729578 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7eb6c8-41e2-4362-8e0a-ee01f5f5c73f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:59.732534 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7eb6c8-41e2-4362-8e0a-ee01f5f5c73f service cinder] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:59.745112 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 939/1864] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:49:59 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 14:49:59.755140 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f09915-71ca-40f6-ac64-ffd5c19a04c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:49:59.756665 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f09915-71ca-40f6-ac64-ffd5c19a04c6 service cinder] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:49:59.767225 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 926/1865] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:49:59 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 14:50:00.059126 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:00.949534 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7eb6c8-41e2-4362-8e0a-ee01f5f5c73f service cinder] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:00.963389 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7eb6c8-41e2-4362-8e0a-ee01f5f5c73f service cinder] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:00.971614 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0644c1af-601f-421c-b1d2-7b05bd853185 tempest-VolumeQuotaClassesTest-85859596 tempest-VolumeQuotaClassesTest-85859596-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0cfd9b6842048028d635ee8449ce7ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71a948da3f104d208e0ee4c984d11489', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:00.972674 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0644c1af-601f-421c-b1d2-7b05bd853185 tempest-VolumeQuotaClassesTest-85859596 tempest-VolumeQuotaClassesTest-85859596-project-admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:00.973017 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0644c1af-601f-421c-b1d2-7b05bd853185 tempest-VolumeQuotaClassesTest-85859596 tempest-VolumeQuotaClassesTest-85859596-project-admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:00.974328 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0644c1af-601f-421c-b1d2-7b05bd853185 tempest-VolumeQuotaClassesTest-85859596 tempest-VolumeQuotaClassesTest-85859596-project-admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:00.976279 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0644c1af-601f-421c-b1d2-7b05bd853185 tempest-VolumeQuotaClassesTest-85859596 tempest-VolumeQuotaClassesTest-85859596-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:50:00.976819 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0644c1af-601f-421c-b1d2-7b05bd853185 tempest-VolumeQuotaClassesTest-85859596 tempest-VolumeQuotaClassesTest-85859596-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:00.993156 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0644c1af-601f-421c-b1d2-7b05bd853185 tempest-VolumeQuotaClassesTest-85859596 tempest-VolumeQuotaClassesTest-85859596-project-admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:00.998654 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:01.015885 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 940/1866] 10.222.0.15 () {58 vars in 1152 bytes} [Tue May 31 14:50:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:50:01.025653 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f09915-71ca-40f6-ac64-ffd5c19a04c6 service cinder] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:01.037764 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f09915-71ca-40f6-ac64-ffd5c19a04c6 service cinder] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:01.043109 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63127d45-6221-4e00-97d1-352fac55ed59 tempest-VolumeQuotaClassesTest-85859596 tempest-VolumeQuotaClassesTest-85859596-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0cfd9b6842048028d635ee8449ce7ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71a948da3f104d208e0ee4c984d11489', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:01.044688 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63127d45-6221-4e00-97d1-352fac55ed59 tempest-VolumeQuotaClassesTest-85859596 tempest-VolumeQuotaClassesTest-85859596-project-admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:01.044998 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63127d45-6221-4e00-97d1-352fac55ed59 tempest-VolumeQuotaClassesTest-85859596 tempest-VolumeQuotaClassesTest-85859596-project-admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:01.045259 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63127d45-6221-4e00-97d1-352fac55ed59 tempest-VolumeQuotaClassesTest-85859596 tempest-VolumeQuotaClassesTest-85859596-project-admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:01.046249 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63127d45-6221-4e00-97d1-352fac55ed59 tempest-VolumeQuotaClassesTest-85859596 tempest-VolumeQuotaClassesTest-85859596-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:01.048483 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63127d45-6221-4e00-97d1-352fac55ed59 tempest-VolumeQuotaClassesTest-85859596 tempest-VolumeQuotaClassesTest-85859596-project-admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:01.156179 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 927/1867] 10.222.0.15 () {60 vars in 1152 bytes} [Tue May 31 14:50:01 2022] POST /identity/v3/projects => generated 354 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:50:01.157549 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0644c1af-601f-421c-b1d2-7b05bd853185 tempest-VolumeQuotaClassesTest-85859596 tempest-VolumeQuotaClassesTest-85859596-project-admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:01.172606 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0644c1af-601f-421c-b1d2-7b05bd853185 tempest-VolumeQuotaClassesTest-85859596 tempest-VolumeQuotaClassesTest-85859596-project-admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:01.302128 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174c6a31-0b57-42d8-b1f3-c23ff17e9c75 tempest-VolumeQuotaClassesTest-85859596 tempest-VolumeQuotaClassesTest-85859596-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0cfd9b6842048028d635ee8449ce7ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71a948da3f104d208e0ee4c984d11489', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:01.303176 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c6a31-0b57-42d8-b1f3-c23ff17e9c75 tempest-VolumeQuotaClassesTest-85859596 tempest-VolumeQuotaClassesTest-85859596-project-admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:01.303689 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c6a31-0b57-42d8-b1f3-c23ff17e9c75 tempest-VolumeQuotaClassesTest-85859596 tempest-VolumeQuotaClassesTest-85859596-project-admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:01.304318 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c6a31-0b57-42d8-b1f3-c23ff17e9c75 tempest-VolumeQuotaClassesTest-85859596 tempest-VolumeQuotaClassesTest-85859596-project-admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:01.305220 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174c6a31-0b57-42d8-b1f3-c23ff17e9c75 tempest-VolumeQuotaClassesTest-85859596 tempest-VolumeQuotaClassesTest-85859596-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:50:01.306851 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174c6a31-0b57-42d8-b1f3-c23ff17e9c75 tempest-VolumeQuotaClassesTest-85859596 tempest-VolumeQuotaClassesTest-85859596-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:01.307714 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174c6a31-0b57-42d8-b1f3-c23ff17e9c75 tempest-VolumeQuotaClassesTest-85859596 tempest-VolumeQuotaClassesTest-85859596-project-admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:01.334113 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 941/1868] 10.222.0.15 () {58 vars in 1152 bytes} [Tue May 31 14:50:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:50:01.633674 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63127d45-6221-4e00-97d1-352fac55ed59 tempest-VolumeQuotaClassesTest-85859596 tempest-VolumeQuotaClassesTest-85859596-project-admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:01.645384 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63127d45-6221-4e00-97d1-352fac55ed59 tempest-VolumeQuotaClassesTest-85859596 tempest-VolumeQuotaClassesTest-85859596-project-admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:01.654021 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4db8b5d-8eb5-403c-8ed2-e98568550751 tempest-VolumeQuotaClassesTest-85859596 tempest-VolumeQuotaClassesTest-85859596-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0cfd9b6842048028d635ee8449ce7ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71a948da3f104d208e0ee4c984d11489', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:01.654021 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db8b5d-8eb5-403c-8ed2-e98568550751 tempest-VolumeQuotaClassesTest-85859596 tempest-VolumeQuotaClassesTest-85859596-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:01.654021 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db8b5d-8eb5-403c-8ed2-e98568550751 tempest-VolumeQuotaClassesTest-85859596 tempest-VolumeQuotaClassesTest-85859596-project-admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:01.654526 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db8b5d-8eb5-403c-8ed2-e98568550751 tempest-VolumeQuotaClassesTest-85859596 tempest-VolumeQuotaClassesTest-85859596-project-admin] PATH_INFO: `/v3/projects/4f1d62ab33a9491c9813104d27879711` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:01.655586 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4db8b5d-8eb5-403c-8ed2-e98568550751 tempest-VolumeQuotaClassesTest-85859596 tempest-VolumeQuotaClassesTest-85859596-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4f1d62ab33a9491c9813104d27879711)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:01.657694 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4db8b5d-8eb5-403c-8ed2-e98568550751 tempest-VolumeQuotaClassesTest-85859596 tempest-VolumeQuotaClassesTest-85859596-project-admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:01.776731 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-b4db8b5d-8eb5-403c-8ed2-e98568550751 tempest-VolumeQuotaClassesTest-85859596 tempest-VolumeQuotaClassesTest-85859596-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f1d62ab33a9491c9813104d27879711', 'request_id': 'req-b4db8b5d-8eb5-403c-8ed2-e98568550751'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:01.786987 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-b4db8b5d-8eb5-403c-8ed2-e98568550751 tempest-VolumeQuotaClassesTest-85859596 tempest-VolumeQuotaClassesTest-85859596-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f1d62ab33a9491c9813104d27879711', 'request_id': 'req-b4db8b5d-8eb5-403c-8ed2-e98568550751'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:01.877170 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-b4db8b5d-8eb5-403c-8ed2-e98568550751 tempest-VolumeQuotaClassesTest-85859596 tempest-VolumeQuotaClassesTest-85859596-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f1d62ab33a9491c9813104d27879711', 'request_id': 'req-b4db8b5d-8eb5-403c-8ed2-e98568550751'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:01.898473 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-b4db8b5d-8eb5-403c-8ed2-e98568550751 tempest-VolumeQuotaClassesTest-85859596 tempest-VolumeQuotaClassesTest-85859596-project-admin] The token cache is being invalidate because project 4f1d62ab33a9491c9813104d27879711 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 14:50:01.898639 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-b4db8b5d-8eb5-403c-8ed2-e98568550751 tempest-VolumeQuotaClassesTest-85859596 tempest-VolumeQuotaClassesTest-85859596-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:01.899321 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-b4db8b5d-8eb5-403c-8ed2-e98568550751 tempest-VolumeQuotaClassesTest-85859596 tempest-VolumeQuotaClassesTest-85859596-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:01.919769 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 928/1869] 10.222.0.15 () {58 vars in 1232 bytes} [Tue May 31 14:50:01 2022] DELETE /identity/v3/projects/4f1d62ab33a9491c9813104d27879711 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:50:02.219257 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:02.418934 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:02.703947 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174c6a31-0b57-42d8-b1f3-c23ff17e9c75 tempest-VolumeQuotaClassesTest-85859596 tempest-VolumeQuotaClassesTest-85859596-project-admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:02.706865 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-174c6a31-0b57-42d8-b1f3-c23ff17e9c75 tempest-VolumeQuotaClassesTest-85859596 tempest-VolumeQuotaClassesTest-85859596-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:02.803592 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174c6a31-0b57-42d8-b1f3-c23ff17e9c75 tempest-VolumeQuotaClassesTest-85859596 tempest-VolumeQuotaClassesTest-85859596-project-admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:02.874268 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f040638d-c81a-44f2-a47a-ce1ffd0cabd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:02.875992 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f040638d-c81a-44f2-a47a-ce1ffd0cabd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:02.876649 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f040638d-c81a-44f2-a47a-ce1ffd0cabd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:02.877026 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f040638d-c81a-44f2-a47a-ce1ffd0cabd0 admin admin] PATH_INFO: `/v3/users/1dbbd60f7d254b2885eae8c7d04d5fcd` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:02.878691 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f040638d-c81a-44f2-a47a-ce1ffd0cabd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1dbbd60f7d254b2885eae8c7d04d5fcd)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:02.882359 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f040638d-c81a-44f2-a47a-ce1ffd0cabd0 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:03.058045 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4db8b5d-8eb5-403c-8ed2-e98568550751 tempest-VolumeQuotaClassesTest-85859596 tempest-VolumeQuotaClassesTest-85859596-project-admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:03.059590 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-b4db8b5d-8eb5-403c-8ed2-e98568550751 tempest-VolumeQuotaClassesTest-85859596 tempest-VolumeQuotaClassesTest-85859596-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:03.073500 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4db8b5d-8eb5-403c-8ed2-e98568550751 tempest-VolumeQuotaClassesTest-85859596 tempest-VolumeQuotaClassesTest-85859596-project-admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:03.078212 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c76bb2-da49-4fa5-aae3-87478275d915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:03.079313 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c76bb2-da49-4fa5-aae3-87478275d915 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:03.079735 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c76bb2-da49-4fa5-aae3-87478275d915 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:03.080146 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c76bb2-da49-4fa5-aae3-87478275d915 admin admin] PATH_INFO: `/v3/users/2de740cbf54f4045ade685cbbb6f86b2` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:03.081411 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c76bb2-da49-4fa5-aae3-87478275d915 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2de740cbf54f4045ade685cbbb6f86b2)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:03.083572 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c76bb2-da49-4fa5-aae3-87478275d915 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:03.124593 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-f040638d-c81a-44f2-a47a-ce1ffd0cabd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1dbbd60f7d254b2885eae8c7d04d5fcd'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:03.258688 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-f040638d-c81a-44f2-a47a-ce1ffd0cabd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1dbbd60f7d254b2885eae8c7d04d5fcd'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:03.259567 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-f040638d-c81a-44f2-a47a-ce1ffd0cabd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1dbbd60f7d254b2885eae8c7d04d5fcd'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:03.269699 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-f040638d-c81a-44f2-a47a-ce1ffd0cabd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1dbbd60f7d254b2885eae8c7d04d5fcd'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:03.271602 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-f040638d-c81a-44f2-a47a-ce1ffd0cabd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1dbbd60f7d254b2885eae8c7d04d5fcd'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:03.318874 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 942/1870] 10.222.0.15 () {58 vars in 1223 bytes} [Tue May 31 14:50:02 2022] DELETE /identity/v3/users/1dbbd60f7d254b2885eae8c7d04d5fcd => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:50:03.320323 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb72ef9-4484-4a15-9548-076cb544b498 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:03.340729 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb72ef9-4484-4a15-9548-076cb544b498 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:03.340729 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb72ef9-4484-4a15-9548-076cb544b498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:03.342077 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-05c76bb2-da49-4fa5-aae3-87478275d915 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2de740cbf54f4045ade685cbbb6f86b2'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:03.348766 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-05c76bb2-da49-4fa5-aae3-87478275d915 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2de740cbf54f4045ade685cbbb6f86b2'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:03.350849 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-05c76bb2-da49-4fa5-aae3-87478275d915 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2de740cbf54f4045ade685cbbb6f86b2'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:03.351867 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-05c76bb2-da49-4fa5-aae3-87478275d915 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2de740cbf54f4045ade685cbbb6f86b2'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:03.360655 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-1fb72ef9-4484-4a15-9548-076cb544b498 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:50:03.363844 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-1fb72ef9-4484-4a15-9548-076cb544b498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:03.371726 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-05c76bb2-da49-4fa5-aae3-87478275d915 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2de740cbf54f4045ade685cbbb6f86b2'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:03.454369 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 943/1871] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:50:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:50:03.466818 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 929/1872] 10.222.0.15 () {58 vars in 1223 bytes} [Tue May 31 14:50:03 2022] DELETE /identity/v3/users/2de740cbf54f4045ade685cbbb6f86b2 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 14:50:03.471600 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0097744-fc0a-4909-a358-06f38881a524 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:03.472453 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0097744-fc0a-4909-a358-06f38881a524 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:03.472759 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0097744-fc0a-4909-a358-06f38881a524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:03.475531 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c76bb2-da49-4fa5-aae3-87478275d915 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:03.480064 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-05c76bb2-da49-4fa5-aae3-87478275d915 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:03.500575 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-d0097744-fc0a-4909-a358-06f38881a524 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:50:03.502033 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-d0097744-fc0a-4909-a358-06f38881a524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:03.573973 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c76bb2-da49-4fa5-aae3-87478275d915 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:03.578976 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d4d0d3-e248-4dff-90f5-e1eabc3aac19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:03.579635 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d4d0d3-e248-4dff-90f5-e1eabc3aac19 service neutron] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:03.580093 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d4d0d3-e248-4dff-90f5-e1eabc3aac19 service neutron] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:03.580510 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d4d0d3-e248-4dff-90f5-e1eabc3aac19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:03.590310 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 944/1873] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:50:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 14:50:03.600780 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0097744-fc0a-4909-a358-06f38881a524 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:03.615384 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0097744-fc0a-4909-a358-06f38881a524 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:03.631802 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dcaed3-c21a-44ee-a6bc-bae8b597f5ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:03.632488 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dcaed3-c21a-44ee-a6bc-bae8b597f5ca service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:03.633050 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dcaed3-c21a-44ee-a6bc-bae8b597f5ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:03.633050 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dcaed3-c21a-44ee-a6bc-bae8b597f5ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:03.647305 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dcaed3-c21a-44ee-a6bc-bae8b597f5ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:03.649519 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dcaed3-c21a-44ee-a6bc-bae8b597f5ca service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:03.664503 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d4d0d3-e248-4dff-90f5-e1eabc3aac19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:03.666104 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 945/1874] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:50:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:50:03.666393 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d4d0d3-e248-4dff-90f5-e1eabc3aac19 service neutron] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:03.680009 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 930/1875] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:50:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:50:04.162314 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:04.203573 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dcaed3-c21a-44ee-a6bc-bae8b597f5ca service neutron] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:04.204998 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-08dcaed3-c21a-44ee-a6bc-bae8b597f5ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:04.220128 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dcaed3-c21a-44ee-a6bc-bae8b597f5ca service neutron] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:04.226259 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d4d0d3-e248-4dff-90f5-e1eabc3aac19 service neutron] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:04.229796 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-93d4d0d3-e248-4dff-90f5-e1eabc3aac19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:04.242783 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac22d7f-b8fd-4844-a283-3b98510cff44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:04.244472 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac22d7f-b8fd-4844-a283-3b98510cff44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:04.244890 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac22d7f-b8fd-4844-a283-3b98510cff44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:04.245298 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac22d7f-b8fd-4844-a283-3b98510cff44 admin admin] PATH_INFO: `/v3/projects/909b7ef806294c609f96cb3aaec3f478` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:04.247050 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac22d7f-b8fd-4844-a283-3b98510cff44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=909b7ef806294c609f96cb3aaec3f478)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:04.250958 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac22d7f-b8fd-4844-a283-3b98510cff44 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:04.264819 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d4d0d3-e248-4dff-90f5-e1eabc3aac19 service neutron] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:04.277527 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9dff67-40a8-4907-a9a3-f0015192bf94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:04.278483 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9dff67-40a8-4907-a9a3-f0015192bf94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:04.279346 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9dff67-40a8-4907-a9a3-f0015192bf94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:04.285722 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9dff67-40a8-4907-a9a3-f0015192bf94 admin admin] PATH_INFO: `/v3/projects/083c9d149e6f4f27b021f9dae561891e` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:04.285722 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9dff67-40a8-4907-a9a3-f0015192bf94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=083c9d149e6f4f27b021f9dae561891e)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:04.285722 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9dff67-40a8-4907-a9a3-f0015192bf94 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:04.476270 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-fac22d7f-b8fd-4844-a283-3b98510cff44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '909b7ef806294c609f96cb3aaec3f478', 'request_id': 'req-fac22d7f-b8fd-4844-a283-3b98510cff44'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:04.485273 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-9e9dff67-40a8-4907-a9a3-f0015192bf94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '083c9d149e6f4f27b021f9dae561891e', 'request_id': 'req-9e9dff67-40a8-4907-a9a3-f0015192bf94'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:04.491968 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-9e9dff67-40a8-4907-a9a3-f0015192bf94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '083c9d149e6f4f27b021f9dae561891e', 'request_id': 'req-9e9dff67-40a8-4907-a9a3-f0015192bf94'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:04.584859 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-fac22d7f-b8fd-4844-a283-3b98510cff44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '909b7ef806294c609f96cb3aaec3f478', 'request_id': 'req-fac22d7f-b8fd-4844-a283-3b98510cff44'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:04.592402 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-fac22d7f-b8fd-4844-a283-3b98510cff44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '909b7ef806294c609f96cb3aaec3f478', 'request_id': 'req-fac22d7f-b8fd-4844-a283-3b98510cff44'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:04.596881 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:04.608063 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-fac22d7f-b8fd-4844-a283-3b98510cff44 admin admin] The token cache is being invalidate because project 909b7ef806294c609f96cb3aaec3f478 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80503) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 14:50:04.608587 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-fac22d7f-b8fd-4844-a283-3b98510cff44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:04.609427 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-fac22d7f-b8fd-4844-a283-3b98510cff44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:04.611364 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 946/1876] 10.222.0.15 () {58 vars in 1232 bytes} [Tue May 31 14:50:04 2022] DELETE /identity/v3/projects/909b7ef806294c609f96cb3aaec3f478 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:50:04.615782 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac22d7f-b8fd-4844-a283-3b98510cff44 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:04.617391 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-fac22d7f-b8fd-4844-a283-3b98510cff44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:04.630821 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-9e9dff67-40a8-4907-a9a3-f0015192bf94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '083c9d149e6f4f27b021f9dae561891e', 'request_id': 'req-9e9dff67-40a8-4907-a9a3-f0015192bf94'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:04.647927 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-9e9dff67-40a8-4907-a9a3-f0015192bf94 admin admin] The token cache is being invalidate because project 083c9d149e6f4f27b021f9dae561891e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 14:50:04.648486 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-9e9dff67-40a8-4907-a9a3-f0015192bf94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:04.649695 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-9e9dff67-40a8-4907-a9a3-f0015192bf94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:04.652184 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 931/1877] 10.222.0.15 () {58 vars in 1232 bytes} [Tue May 31 14:50:04 2022] DELETE /identity/v3/projects/083c9d149e6f4f27b021f9dae561891e => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:50:04.656891 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9dff67-40a8-4907-a9a3-f0015192bf94 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:04.659608 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-9e9dff67-40a8-4907-a9a3-f0015192bf94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:04.709530 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac22d7f-b8fd-4844-a283-3b98510cff44 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:04.755653 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9dff67-40a8-4907-a9a3-f0015192bf94 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:04.766627 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d175e81b-4a0d-45f3-acad-1c7be7259beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:04.767618 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d175e81b-4a0d-45f3-acad-1c7be7259beb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:04.767906 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d175e81b-4a0d-45f3-acad-1c7be7259beb admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:04.768181 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d175e81b-4a0d-45f3-acad-1c7be7259beb admin admin] PATH_INFO: `/v3/users/a0cfd9b6842048028d635ee8449ce7ca` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:04.769410 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d175e81b-4a0d-45f3-acad-1c7be7259beb admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0cfd9b6842048028d635ee8449ce7ca)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:04.771635 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d175e81b-4a0d-45f3-acad-1c7be7259beb admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:04.815857 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6ed3d7-0a80-46ed-b426-3a082243c202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:04.816747 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ed3d7-0a80-46ed-b426-3a082243c202 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:04.817058 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ed3d7-0a80-46ed-b426-3a082243c202 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:04.817330 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ed3d7-0a80-46ed-b426-3a082243c202 admin admin] PATH_INFO: `/v3/users/715e48bbd31f4365b5e4ab2b9eb71967` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:04.818675 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6ed3d7-0a80-46ed-b426-3a082243c202 admin admin] RBAC: Authorizing `identity:delete_user(user_id=715e48bbd31f4365b5e4ab2b9eb71967)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:04.820523 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6ed3d7-0a80-46ed-b426-3a082243c202 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:05.030242 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-3a6ed3d7-0a80-46ed-b426-3a082243c202 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '715e48bbd31f4365b5e4ab2b9eb71967'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:05.031824 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-d175e81b-4a0d-45f3-acad-1c7be7259beb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0cfd9b6842048028d635ee8449ce7ca'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:05.041319 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-d175e81b-4a0d-45f3-acad-1c7be7259beb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0cfd9b6842048028d635ee8449ce7ca'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:05.042118 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-d175e81b-4a0d-45f3-acad-1c7be7259beb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0cfd9b6842048028d635ee8449ce7ca'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:05.042815 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-d175e81b-4a0d-45f3-acad-1c7be7259beb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0cfd9b6842048028d635ee8449ce7ca'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:05.056587 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-d175e81b-4a0d-45f3-acad-1c7be7259beb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0cfd9b6842048028d635ee8449ce7ca'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:05.102745 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-3a6ed3d7-0a80-46ed-b426-3a082243c202 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '715e48bbd31f4365b5e4ab2b9eb71967'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:05.104636 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-3a6ed3d7-0a80-46ed-b426-3a082243c202 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '715e48bbd31f4365b5e4ab2b9eb71967'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:05.116310 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-3a6ed3d7-0a80-46ed-b426-3a082243c202 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '715e48bbd31f4365b5e4ab2b9eb71967'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:05.117045 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-3a6ed3d7-0a80-46ed-b426-3a082243c202 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '715e48bbd31f4365b5e4ab2b9eb71967'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:05.141412 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 947/1878] 10.222.0.15 () {58 vars in 1223 bytes} [Tue May 31 14:50:04 2022] DELETE /identity/v3/users/715e48bbd31f4365b5e4ab2b9eb71967 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 14:50:05.199316 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 932/1879] 10.222.0.15 () {58 vars in 1223 bytes} [Tue May 31 14:50:04 2022] DELETE /identity/v3/users/a0cfd9b6842048028d635ee8449ce7ca => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:50:05.775356 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6ed3d7-0a80-46ed-b426-3a082243c202 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:05.776888 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-3a6ed3d7-0a80-46ed-b426-3a082243c202 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:05.844304 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6ed3d7-0a80-46ed-b426-3a082243c202 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:05.855783 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d175e81b-4a0d-45f3-acad-1c7be7259beb admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:05.858190 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-d175e81b-4a0d-45f3-acad-1c7be7259beb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:05.929035 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1fc2ba-07b0-468d-85c3-4f180498b1ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:05.929944 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1fc2ba-07b0-468d-85c3-4f180498b1ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:05.930211 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1fc2ba-07b0-468d-85c3-4f180498b1ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:05.930492 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1fc2ba-07b0-468d-85c3-4f180498b1ab admin admin] PATH_INFO: `/v3/projects/8755941ead87491ba6998fb95ea573af` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:05.931803 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1fc2ba-07b0-468d-85c3-4f180498b1ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=8755941ead87491ba6998fb95ea573af)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:05.933840 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1fc2ba-07b0-468d-85c3-4f180498b1ab admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:06.008466 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d175e81b-4a0d-45f3-acad-1c7be7259beb admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:06.026990 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ca11c3-2bf5-449a-9f8d-5ff26da02553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:06.031232 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ca11c3-2bf5-449a-9f8d-5ff26da02553 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:06.031232 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ca11c3-2bf5-449a-9f8d-5ff26da02553 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:06.031232 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ca11c3-2bf5-449a-9f8d-5ff26da02553 admin admin] PATH_INFO: `/v3/projects/71a948da3f104d208e0ee4c984d11489` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:06.032654 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ca11c3-2bf5-449a-9f8d-5ff26da02553 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71a948da3f104d208e0ee4c984d11489)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:06.034968 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ca11c3-2bf5-449a-9f8d-5ff26da02553 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:06.061814 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-1b1fc2ba-07b0-468d-85c3-4f180498b1ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8755941ead87491ba6998fb95ea573af', 'request_id': 'req-1b1fc2ba-07b0-468d-85c3-4f180498b1ab'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:06.133582 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:06.153092 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-85ca11c3-2bf5-449a-9f8d-5ff26da02553 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71a948da3f104d208e0ee4c984d11489', 'request_id': 'req-85ca11c3-2bf5-449a-9f8d-5ff26da02553'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:06.160830 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-85ca11c3-2bf5-449a-9f8d-5ff26da02553 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71a948da3f104d208e0ee4c984d11489', 'request_id': 'req-85ca11c3-2bf5-449a-9f8d-5ff26da02553'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:06.162081 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-1b1fc2ba-07b0-468d-85c3-4f180498b1ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8755941ead87491ba6998fb95ea573af', 'request_id': 'req-1b1fc2ba-07b0-468d-85c3-4f180498b1ab'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:06.170642 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-1b1fc2ba-07b0-468d-85c3-4f180498b1ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8755941ead87491ba6998fb95ea573af', 'request_id': 'req-1b1fc2ba-07b0-468d-85c3-4f180498b1ab'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:06.182747 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-1b1fc2ba-07b0-468d-85c3-4f180498b1ab admin admin] The token cache is being invalidate because project 8755941ead87491ba6998fb95ea573af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80503) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 14:50:06.183634 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-1b1fc2ba-07b0-468d-85c3-4f180498b1ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:06.185013 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-1b1fc2ba-07b0-468d-85c3-4f180498b1ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:06.186965 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 948/1880] 10.222.0.15 () {58 vars in 1232 bytes} [Tue May 31 14:50:05 2022] DELETE /identity/v3/projects/8755941ead87491ba6998fb95ea573af => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:50:06.192511 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37bd395-0f19-4b36-8a6e-1b8d875db2de None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:06.192936 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37bd395-0f19-4b36-8a6e-1b8d875db2de None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:06.193345 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37bd395-0f19-4b36-8a6e-1b8d875db2de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:06.234704 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-c37bd395-0f19-4b36-8a6e-1b8d875db2de None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:50:06.236399 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-c37bd395-0f19-4b36-8a6e-1b8d875db2de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:06.247543 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-85ca11c3-2bf5-449a-9f8d-5ff26da02553 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71a948da3f104d208e0ee4c984d11489', 'request_id': 'req-85ca11c3-2bf5-449a-9f8d-5ff26da02553'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:06.265886 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-85ca11c3-2bf5-449a-9f8d-5ff26da02553 admin admin] The token cache is being invalidate because project 71a948da3f104d208e0ee4c984d11489 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 14:50:06.266662 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-85ca11c3-2bf5-449a-9f8d-5ff26da02553 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:06.268442 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-85ca11c3-2bf5-449a-9f8d-5ff26da02553 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:06.275415 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 933/1881] 10.222.0.15 () {58 vars in 1232 bytes} [Tue May 31 14:50:05 2022] DELETE /identity/v3/projects/71a948da3f104d208e0ee4c984d11489 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:50:06.279641 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a3a94c-48b7-4ac2-b6f4-5b39908e657c None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:06.280869 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a3a94c-48b7-4ac2-b6f4-5b39908e657c None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:06.281400 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a3a94c-48b7-4ac2-b6f4-5b39908e657c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:06.351136 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-46a3a94c-48b7-4ac2-b6f4-5b39908e657c None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:50:06.352442 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-46a3a94c-48b7-4ac2-b6f4-5b39908e657c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:06.387464 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 949/1882] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:50:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:50:06.389929 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e2d0d-f203-4499-946e-19709ed38aa7 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:06.391859 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e2d0d-f203-4499-946e-19709ed38aa7 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:06.391859 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e2d0d-f203-4499-946e-19709ed38aa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:06.416820 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-5a9e2d0d-f203-4499-946e-19709ed38aa7 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:50:06.419480 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-5a9e2d0d-f203-4499-946e-19709ed38aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:06.437185 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 950/1883] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:50:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:50:06.441314 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9e2d0d-f203-4499-946e-19709ed38aa7 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:06.476346 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9e2d0d-f203-4499-946e-19709ed38aa7 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:06.481557 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab57f8c0-f69e-4d5d-b60a-c8a9befd61f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:06.482426 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab57f8c0-f69e-4d5d-b60a-c8a9befd61f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:06.482854 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab57f8c0-f69e-4d5d-b60a-c8a9befd61f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:06.483139 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab57f8c0-f69e-4d5d-b60a-c8a9befd61f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:06.483941 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab57f8c0-f69e-4d5d-b60a-c8a9befd61f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:50:06.484254 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab57f8c0-f69e-4d5d-b60a-c8a9befd61f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:06.485919 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab57f8c0-f69e-4d5d-b60a-c8a9befd61f6 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:06.497844 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 951/1884] 10.222.0.15 () {58 vars in 1152 bytes} [Tue May 31 14:50:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:50:06.502096 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab57f8c0-f69e-4d5d-b60a-c8a9befd61f6 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:06.511797 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab57f8c0-f69e-4d5d-b60a-c8a9befd61f6 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:06.515521 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 934/1885] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:50:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:50:06.517484 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3242c68b-7192-4bf6-8a37-f467d3d18efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:06.518142 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3242c68b-7192-4bf6-8a37-f467d3d18efc admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:06.518502 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3242c68b-7192-4bf6-8a37-f467d3d18efc admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:06.518820 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3242c68b-7192-4bf6-8a37-f467d3d18efc admin admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:06.519513 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3242c68b-7192-4bf6-8a37-f467d3d18efc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:06.521516 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3242c68b-7192-4bf6-8a37-f467d3d18efc admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:06.526126 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d379e090-1416-4326-b1d9-5d1f462c217d None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:06.526519 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d379e090-1416-4326-b1d9-5d1f462c217d None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:06.526837 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d379e090-1416-4326-b1d9-5d1f462c217d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:06.547040 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-d379e090-1416-4326-b1d9-5d1f462c217d None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:50:06.547604 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-d379e090-1416-4326-b1d9-5d1f462c217d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:06.555859 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 935/1886] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:50:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 14:50:06.560528 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d379e090-1416-4326-b1d9-5d1f462c217d None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:06.570462 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d379e090-1416-4326-b1d9-5d1f462c217d None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:06.575566 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb7b45b-7c7b-43cd-b7bd-d49186c74748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:06.576235 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb7b45b-7c7b-43cd-b7bd-d49186c74748 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:06.576518 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb7b45b-7c7b-43cd-b7bd-d49186c74748 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:06.576801 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb7b45b-7c7b-43cd-b7bd-d49186c74748 admin admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:06.577622 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb7b45b-7c7b-43cd-b7bd-d49186c74748 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:50:06.577931 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb7b45b-7c7b-43cd-b7bd-d49186c74748 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:06.579565 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb7b45b-7c7b-43cd-b7bd-d49186c74748 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:06.591708 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 936/1887] 10.222.0.15 () {58 vars in 1152 bytes} [Tue May 31 14:50:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 14:50:06.596103 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb7b45b-7c7b-43cd-b7bd-d49186c74748 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:06.606134 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb7b45b-7c7b-43cd-b7bd-d49186c74748 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:06.612074 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783a5186-9684-4538-9500-6a681ca7e907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:06.612742 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a5186-9684-4538-9500-6a681ca7e907 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:06.613035 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a5186-9684-4538-9500-6a681ca7e907 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:06.620175 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a5186-9684-4538-9500-6a681ca7e907 admin admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:06.620175 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783a5186-9684-4538-9500-6a681ca7e907 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:06.620427 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 952/1888] 10.222.0.15 () {60 vars in 1152 bytes} [Tue May 31 14:50:06 2022] POST /identity/v3/projects => generated 377 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 14:50:06.620521 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783a5186-9684-4538-9500-6a681ca7e907 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:06.623805 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3242c68b-7192-4bf6-8a37-f467d3d18efc admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:06.653312 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:06.684425 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3242c68b-7192-4bf6-8a37-f467d3d18efc admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:06.689619 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dddd53a-79e9-4b4e-9d47-57f84694914e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:06.690287 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dddd53a-79e9-4b4e-9d47-57f84694914e admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:06.690602 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dddd53a-79e9-4b4e-9d47-57f84694914e admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:06.690883 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dddd53a-79e9-4b4e-9d47-57f84694914e admin admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:06.691602 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dddd53a-79e9-4b4e-9d47-57f84694914e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:06.693518 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dddd53a-79e9-4b4e-9d47-57f84694914e admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:06.723104 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 937/1889] 10.222.0.15 () {60 vars in 1152 bytes} [Tue May 31 14:50:06 2022] POST /identity/v3/projects => generated 387 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 14:50:06.727136 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783a5186-9684-4538-9500-6a681ca7e907 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:06.791307 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783a5186-9684-4538-9500-6a681ca7e907 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:06.797213 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d30320-5450-4c5a-9c46-b554513b24c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:06.797914 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d30320-5450-4c5a-9c46-b554513b24c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:06.798307 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d30320-5450-4c5a-9c46-b554513b24c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:06.798676 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d30320-5450-4c5a-9c46-b554513b24c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:06.799501 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d30320-5450-4c5a-9c46-b554513b24c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:06.801599 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d30320-5450-4c5a-9c46-b554513b24c8 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:06.848962 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 953/1890] 10.222.0.15 () {60 vars in 1143 bytes} [Tue May 31 14:50:06 2022] POST /identity/v3/users => generated 289 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 14:50:06.852902 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dddd53a-79e9-4b4e-9d47-57f84694914e admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:06.863451 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dddd53a-79e9-4b4e-9d47-57f84694914e admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:06.868128 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b6de8-257e-4bc0-a571-d040d83fd580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:06.868797 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b6de8-257e-4bc0-a571-d040d83fd580 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:06.869087 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b6de8-257e-4bc0-a571-d040d83fd580 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:06.869475 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b6de8-257e-4bc0-a571-d040d83fd580 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:06.870200 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8b6de8-257e-4bc0-a571-d040d83fd580 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:06.871833 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8b6de8-257e-4bc0-a571-d040d83fd580 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:06.881863 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 954/1891] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:50:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 14:50:06.885592 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b6de8-257e-4bc0-a571-d040d83fd580 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:06.895364 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b6de8-257e-4bc0-a571-d040d83fd580 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:06.901160 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a24d1b9-c60f-4cf1-9b31-d7826738ba0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:06.901823 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a24d1b9-c60f-4cf1-9b31-d7826738ba0f admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:06.902317 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a24d1b9-c60f-4cf1-9b31-d7826738ba0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:06.902655 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a24d1b9-c60f-4cf1-9b31-d7826738ba0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:06.904122 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a24d1b9-c60f-4cf1-9b31-d7826738ba0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:06.905707 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a24d1b9-c60f-4cf1-9b31-d7826738ba0f admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:06.922339 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 938/1892] 10.222.0.15 () {60 vars in 1143 bytes} [Tue May 31 14:50:06 2022] POST /identity/v3/users => generated 294 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 14:50:06.922878 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 955/1893] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:50:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 14:50:06.922996 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d30320-5450-4c5a-9c46-b554513b24c8 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:06.923425 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a24d1b9-c60f-4cf1-9b31-d7826738ba0f admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:06.929949 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d30320-5450-4c5a-9c46-b554513b24c8 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:06.933023 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a24d1b9-c60f-4cf1-9b31-d7826738ba0f admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:06.938348 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5162b7a5-98de-44c1-a53a-1467d5547322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:06.938348 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5162b7a5-98de-44c1-a53a-1467d5547322 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:06.938348 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5162b7a5-98de-44c1-a53a-1467d5547322 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:06.938348 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5162b7a5-98de-44c1-a53a-1467d5547322 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:06.938749 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5162b7a5-98de-44c1-a53a-1467d5547322 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:06.938846 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f09eb89-5d49-4750-9425-c40d4b282440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:06.938951 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5162b7a5-98de-44c1-a53a-1467d5547322 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:06.939035 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f09eb89-5d49-4750-9425-c40d4b282440 admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:06.939035 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f09eb89-5d49-4750-9425-c40d4b282440 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:06.939211 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f09eb89-5d49-4750-9425-c40d4b282440 admin admin] PATH_INFO: `/v3/projects/7140780c41a749f8935c9dbaecb34340/users/ca31d36307e24f46aaead708c60f22a9/roles/317f725e26bf43648d8235bb1f7c4cb3` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:06.951068 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 939/1894] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:50:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 14:50:06.952068 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5162b7a5-98de-44c1-a53a-1467d5547322 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:06.956415 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f09eb89-5d49-4750-9425-c40d4b282440 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7140780c41a749f8935c9dbaecb34340, user_id=ca31d36307e24f46aaead708c60f22a9, role_id=317f725e26bf43648d8235bb1f7c4cb3)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:06.959106 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f09eb89-5d49-4750-9425-c40d4b282440 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:06.961768 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5162b7a5-98de-44c1-a53a-1467d5547322 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:06.967145 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d135a5-90ea-422a-b53a-f89f1be9fb4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:06.967808 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d135a5-90ea-422a-b53a-f89f1be9fb4f admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:06.968093 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d135a5-90ea-422a-b53a-f89f1be9fb4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:06.968369 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d135a5-90ea-422a-b53a-f89f1be9fb4f admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:06.969087 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d135a5-90ea-422a-b53a-f89f1be9fb4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:06.970700 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d135a5-90ea-422a-b53a-f89f1be9fb4f admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:06.984464 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 940/1895] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:50:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:50:06.985786 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d135a5-90ea-422a-b53a-f89f1be9fb4f admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:06.995909 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d135a5-90ea-422a-b53a-f89f1be9fb4f admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:07.002908 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d278b81-b1fe-4486-ad9f-feef5884aa74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:07.003973 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d278b81-b1fe-4486-ad9f-feef5884aa74 admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:07.004320 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d278b81-b1fe-4486-ad9f-feef5884aa74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:07.004661 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d278b81-b1fe-4486-ad9f-feef5884aa74 admin admin] PATH_INFO: `/v3/projects/b740d38e903a4d1cb8fc3ad45c48088e/users/ef71cce0b77d41d192397ebce1260fb8/roles/317f725e26bf43648d8235bb1f7c4cb3` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:07.020510 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d278b81-b1fe-4486-ad9f-feef5884aa74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b740d38e903a4d1cb8fc3ad45c48088e, user_id=ef71cce0b77d41d192397ebce1260fb8, role_id=317f725e26bf43648d8235bb1f7c4cb3)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:07.023291 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d278b81-b1fe-4486-ad9f-feef5884aa74 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:07.036852 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 956/1896] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:50:06 2022] PUT /identity/v3/projects/7140780c41a749f8935c9dbaecb34340/users/ca31d36307e24f46aaead708c60f22a9/roles/317f725e26bf43648d8235bb1f7c4cb3 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 14:50:07.048435 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04296935-948d-42fa-8310-876505176f45 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:07.048953 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04296935-948d-42fa-8310-876505176f45 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:07.049407 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04296935-948d-42fa-8310-876505176f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:07.085375 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-04296935-948d-42fa-8310-876505176f45 None None] MFA Rules not processed for user `ca31d36307e24f46aaead708c60f22a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:50:07.086632 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-04296935-948d-42fa-8310-876505176f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:07.101266 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 941/1897] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:50:06 2022] PUT /identity/v3/projects/b740d38e903a4d1cb8fc3ad45c48088e/users/ef71cce0b77d41d192397ebce1260fb8/roles/317f725e26bf43648d8235bb1f7c4cb3 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 14:50:07.111996 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880ff85b-bf76-4a9d-af42-0d3c9322b4b0 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:07.112410 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880ff85b-bf76-4a9d-af42-0d3c9322b4b0 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:07.112895 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880ff85b-bf76-4a9d-af42-0d3c9322b4b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:07.139766 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-880ff85b-bf76-4a9d-af42-0d3c9322b4b0 None None] MFA Rules not processed for user `ef71cce0b77d41d192397ebce1260fb8`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:50:07.140979 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-880ff85b-bf76-4a9d-af42-0d3c9322b4b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:07.158413 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 957/1898] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:50:07 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 14:50:07.170861 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04296935-948d-42fa-8310-876505176f45 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:07.172765 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-04296935-948d-42fa-8310-876505176f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:07.232710 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 942/1899] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:50:07 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 14:50:07.238847 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880ff85b-bf76-4a9d-af42-0d3c9322b4b0 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:07.253930 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04296935-948d-42fa-8310-876505176f45 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:07.323686 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f23135d-da8c-40f2-808e-af5b7d952d54 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ba98b007cc4ae1b20e7f261824b77c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:07.324367 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f23135d-da8c-40f2-808e-af5b7d952d54 service glance] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:07.324984 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f23135d-da8c-40f2-808e-af5b7d952d54 service glance] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:07.324984 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f23135d-da8c-40f2-808e-af5b7d952d54 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:07.332140 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:07.342872 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880ff85b-bf76-4a9d-af42-0d3c9322b4b0 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:07.344868 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6847d4-0be4-4a3f-87f6-80ba1890a702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:07.345803 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6847d4-0be4-4a3f-87f6-80ba1890a702 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:07.347242 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6847d4-0be4-4a3f-87f6-80ba1890a702 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:07.348093 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6847d4-0be4-4a3f-87f6-80ba1890a702 admin admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:07.349306 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6847d4-0be4-4a3f-87f6-80ba1890a702 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:07.372210 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6847d4-0be4-4a3f-87f6-80ba1890a702 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:07.415225 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f23135d-da8c-40f2-808e-af5b7d952d54 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:07.419252 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f23135d-da8c-40f2-808e-af5b7d952d54 service glance] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:07.433287 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 958/1900] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:50:07 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 14:50:07.496990 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 943/1901] 10.222.0.15 () {60 vars in 1152 bytes} [Tue May 31 14:50:07 2022] POST /identity/v3/projects => generated 387 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:50:07.501639 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f23135d-da8c-40f2-808e-af5b7d952d54 service glance] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:07.521148 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f23135d-da8c-40f2-808e-af5b7d952d54 service glance] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:07.620620 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef19f6dd-b346-4d64-83eb-078749f1103a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:07.621379 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef19f6dd-b346-4d64-83eb-078749f1103a admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:07.622362 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef19f6dd-b346-4d64-83eb-078749f1103a admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:07.622362 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef19f6dd-b346-4d64-83eb-078749f1103a admin admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:07.623208 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef19f6dd-b346-4d64-83eb-078749f1103a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:07.625980 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef19f6dd-b346-4d64-83eb-078749f1103a admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:07.721019 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 959/1902] 10.222.0.15 () {60 vars in 1143 bytes} [Tue May 31 14:50:07 2022] POST /identity/v3/users => generated 294 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:50:07.722372 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6847d4-0be4-4a3f-87f6-80ba1890a702 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:07.737722 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6847d4-0be4-4a3f-87f6-80ba1890a702 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:07.744316 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32d8b02-c68e-443b-8aa1-f303a263279b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:07.745557 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32d8b02-c68e-443b-8aa1-f303a263279b admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:07.745988 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32d8b02-c68e-443b-8aa1-f303a263279b admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:07.746668 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32d8b02-c68e-443b-8aa1-f303a263279b admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:07.747570 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32d8b02-c68e-443b-8aa1-f303a263279b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:07.749587 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32d8b02-c68e-443b-8aa1-f303a263279b admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:07.765090 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 944/1903] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:50:07 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:50:07.769686 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef19f6dd-b346-4d64-83eb-078749f1103a admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:07.797959 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef19f6dd-b346-4d64-83eb-078749f1103a admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:07.806189 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fe9d10-6bae-4b98-973c-69b4528be23c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:07.807486 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fe9d10-6bae-4b98-973c-69b4528be23c admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:07.808076 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fe9d10-6bae-4b98-973c-69b4528be23c admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:07.809529 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fe9d10-6bae-4b98-973c-69b4528be23c admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:07.811046 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fe9d10-6bae-4b98-973c-69b4528be23c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:07.813277 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fe9d10-6bae-4b98-973c-69b4528be23c admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:07.836285 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 960/1904] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:50:07 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:50:07.840565 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32d8b02-c68e-443b-8aa1-f303a263279b admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:07.855489 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32d8b02-c68e-443b-8aa1-f303a263279b admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:07.860960 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8ab573-885b-4a3a-8987-d0c5862b7de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:07.862002 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8ab573-885b-4a3a-8987-d0c5862b7de2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:07.862506 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8ab573-885b-4a3a-8987-d0c5862b7de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:07.863122 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8ab573-885b-4a3a-8987-d0c5862b7de2 admin admin] PATH_INFO: `/v3/projects/085ba67b2fdb458a986ad344fb92a365/users/6ed9804778484ed6a756125195f64be2/roles/317f725e26bf43648d8235bb1f7c4cb3` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:07.884485 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8ab573-885b-4a3a-8987-d0c5862b7de2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=085ba67b2fdb458a986ad344fb92a365, user_id=6ed9804778484ed6a756125195f64be2, role_id=317f725e26bf43648d8235bb1f7c4cb3)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:07.888867 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8ab573-885b-4a3a-8987-d0c5862b7de2 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:07.975287 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 945/1905] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:50:07 2022] PUT /identity/v3/projects/085ba67b2fdb458a986ad344fb92a365/users/6ed9804778484ed6a756125195f64be2/roles/317f725e26bf43648d8235bb1f7c4cb3 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:50:07.985239 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8aa5d6-4fc5-4169-8cfe-d3fd10cfa63e None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:07.985690 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8aa5d6-4fc5-4169-8cfe-d3fd10cfa63e None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:07.985828 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8aa5d6-4fc5-4169-8cfe-d3fd10cfa63e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:08.068930 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-8d8aa5d6-4fc5-4169-8cfe-d3fd10cfa63e None None] MFA Rules not processed for user `6ed9804778484ed6a756125195f64be2`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:50:08.070318 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-8d8aa5d6-4fc5-4169-8cfe-d3fd10cfa63e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:08.207544 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 961/1906] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:50:07 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 14:50:08.217254 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8ab573-885b-4a3a-8987-d0c5862b7de2 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:08.299533 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8ab573-885b-4a3a-8987-d0c5862b7de2 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:08.304040 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617075d2-f9d0-493f-b080-a0afe12ad3c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:08.304705 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617075d2-f9d0-493f-b080-a0afe12ad3c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:08.307548 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617075d2-f9d0-493f-b080-a0afe12ad3c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:08.307548 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617075d2-f9d0-493f-b080-a0afe12ad3c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:08.307548 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617075d2-f9d0-493f-b080-a0afe12ad3c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:08.308047 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617075d2-f9d0-493f-b080-a0afe12ad3c6 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:08.412704 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 946/1907] 10.222.0.15 () {60 vars in 1152 bytes} [Tue May 31 14:50:08 2022] POST /identity/v3/projects => generated 387 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:50:08.416764 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8aa5d6-4fc5-4169-8cfe-d3fd10cfa63e None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:08.429900 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8aa5d6-4fc5-4169-8cfe-d3fd10cfa63e None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:08.471387 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:08.508873 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6360aeae-dc21-4f1e-829e-2f40262ec7ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:08.509636 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6360aeae-dc21-4f1e-829e-2f40262ec7ae admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:08.509984 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6360aeae-dc21-4f1e-829e-2f40262ec7ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:08.510326 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6360aeae-dc21-4f1e-829e-2f40262ec7ae admin admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:08.511205 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6360aeae-dc21-4f1e-829e-2f40262ec7ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:08.513990 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6360aeae-dc21-4f1e-829e-2f40262ec7ae admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:08.625678 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 962/1908] 10.222.0.15 () {60 vars in 1143 bytes} [Tue May 31 14:50:08 2022] POST /identity/v3/users => generated 300 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:50:08.629758 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617075d2-f9d0-493f-b080-a0afe12ad3c6 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:08.640488 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617075d2-f9d0-493f-b080-a0afe12ad3c6 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:08.644964 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd81feb8-7950-4222-92e4-2e29c1f05a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:08.645625 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd81feb8-7950-4222-92e4-2e29c1f05a07 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:08.645912 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd81feb8-7950-4222-92e4-2e29c1f05a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:08.646192 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd81feb8-7950-4222-92e4-2e29c1f05a07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:08.647231 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd81feb8-7950-4222-92e4-2e29c1f05a07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:08.648832 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd81feb8-7950-4222-92e4-2e29c1f05a07 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:08.659878 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 947/1909] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:50:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:50:08.663838 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6360aeae-dc21-4f1e-829e-2f40262ec7ae admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:08.674975 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6360aeae-dc21-4f1e-829e-2f40262ec7ae admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:08.679636 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c922ad0-aa75-4e3c-83c3-217fda9c301c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:08.680529 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c922ad0-aa75-4e3c-83c3-217fda9c301c admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:08.680810 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c922ad0-aa75-4e3c-83c3-217fda9c301c admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:08.681084 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c922ad0-aa75-4e3c-83c3-217fda9c301c admin admin] PATH_INFO: `/v3/projects/48f5e7270b7f494aa9d09be75816517a/users/6d84866a104b4b5fb1744a493c0948fc/roles/76c53e2c353644f885028a0226c06146` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:08.701548 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c922ad0-aa75-4e3c-83c3-217fda9c301c admin admin] RBAC: Authorizing `identity:create_grant(project_id=48f5e7270b7f494aa9d09be75816517a, user_id=6d84866a104b4b5fb1744a493c0948fc, role_id=76c53e2c353644f885028a0226c06146)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:08.704270 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c922ad0-aa75-4e3c-83c3-217fda9c301c admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:08.864801 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 963/1910] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:50:08 2022] PUT /identity/v3/projects/48f5e7270b7f494aa9d09be75816517a/users/6d84866a104b4b5fb1744a493c0948fc/roles/76c53e2c353644f885028a0226c06146 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 14:50:08.872850 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd81feb8-7950-4222-92e4-2e29c1f05a07 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:08.883181 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd81feb8-7950-4222-92e4-2e29c1f05a07 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:08.936983 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f48a10f-6814-482e-ade5-1d6b57fae862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:08.937650 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f48a10f-6814-482e-ade5-1d6b57fae862 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:08.937932 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f48a10f-6814-482e-ade5-1d6b57fae862 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:08.938211 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f48a10f-6814-482e-ade5-1d6b57fae862 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:08.938961 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f48a10f-6814-482e-ade5-1d6b57fae862 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:08.940723 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f48a10f-6814-482e-ade5-1d6b57fae862 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:08.956586 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 948/1911] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:50:08 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:50:08.960972 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c922ad0-aa75-4e3c-83c3-217fda9c301c admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:08.972260 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c922ad0-aa75-4e3c-83c3-217fda9c301c admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:08.977425 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e974bc5c-4df7-4b59-9d69-d3979f6db488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:08.978317 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e974bc5c-4df7-4b59-9d69-d3979f6db488 admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:08.978696 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e974bc5c-4df7-4b59-9d69-d3979f6db488 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:08.978985 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e974bc5c-4df7-4b59-9d69-d3979f6db488 admin admin] PATH_INFO: `/v3/projects/48f5e7270b7f494aa9d09be75816517a/users/6d84866a104b4b5fb1744a493c0948fc/roles/76c53e2c353644f885028a0226c06146` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:08.981065 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e974bc5c-4df7-4b59-9d69-d3979f6db488 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48f5e7270b7f494aa9d09be75816517a, user_id=6d84866a104b4b5fb1744a493c0948fc, role_id=76c53e2c353644f885028a0226c06146)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:08.983744 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e974bc5c-4df7-4b59-9d69-d3979f6db488 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:08.994806 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 964/1912] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:50:08 2022] PUT /identity/v3/projects/48f5e7270b7f494aa9d09be75816517a/users/6d84866a104b4b5fb1744a493c0948fc/roles/76c53e2c353644f885028a0226c06146 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:50:09.009968 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a1403-50fe-4b7a-a2b0-559a0f1f3d5f None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:09.010416 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a1403-50fe-4b7a-a2b0-559a0f1f3d5f None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:09.010594 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a1403-50fe-4b7a-a2b0-559a0f1f3d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:09.039002 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-626a1403-50fe-4b7a-a2b0-559a0f1f3d5f None None] MFA Rules not processed for user `6d84866a104b4b5fb1744a493c0948fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:50:09.040284 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-626a1403-50fe-4b7a-a2b0-559a0f1f3d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:09.110521 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 949/1913] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:50:09 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:50:09.121690 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e974bc5c-4df7-4b59-9d69-d3979f6db488 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:09.124174 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-e974bc5c-4df7-4b59-9d69-d3979f6db488 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:09.191325 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e974bc5c-4df7-4b59-9d69-d3979f6db488 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:09.195875 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406b1ec8-81d6-460e-a3b0-25ac6bada03f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afbf718dcd9b4741a926b0a2321bd53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:09.196528 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406b1ec8-81d6-460e-a3b0-25ac6bada03f service cinder] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:09.201091 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406b1ec8-81d6-460e-a3b0-25ac6bada03f service cinder] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:09.201091 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406b1ec8-81d6-460e-a3b0-25ac6bada03f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:09.212070 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406b1ec8-81d6-460e-a3b0-25ac6bada03f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:09.213748 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406b1ec8-81d6-460e-a3b0-25ac6bada03f service cinder] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:09.229721 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 965/1914] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:50:09 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:50:09.328267 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:09.707356 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:10.726925 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626a1403-50fe-4b7a-a2b0-559a0f1f3d5f None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:10.748691 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626a1403-50fe-4b7a-a2b0-559a0f1f3d5f None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:10.753175 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c52225-b038-4045-8248-6a66d852cea8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afbf718dcd9b4741a926b0a2321bd53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:10.754199 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c52225-b038-4045-8248-6a66d852cea8 service cinder] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:10.754694 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c52225-b038-4045-8248-6a66d852cea8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:10.755128 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c52225-b038-4045-8248-6a66d852cea8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:10.833450 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c52225-b038-4045-8248-6a66d852cea8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:10.834993 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c52225-b038-4045-8248-6a66d852cea8 service cinder] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:10.852072 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 950/1915] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:50:10 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:50:10.923110 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:11.019269 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:11.831507 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:11.996382 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:12.596653 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:12.705163 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:13.180834 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:13.277224 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:13.871334 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:14.243676 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406b1ec8-81d6-460e-a3b0-25ac6bada03f service cinder] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:14.246396 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-406b1ec8-81d6-460e-a3b0-25ac6bada03f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:14.338801 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406b1ec8-81d6-460e-a3b0-25ac6bada03f service cinder] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:14.344211 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4fcc5a-08b6-4429-9458-3184841c0942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:14.345153 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4fcc5a-08b6-4429-9458-3184841c0942 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:14.345437 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4fcc5a-08b6-4429-9458-3184841c0942 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:14.345721 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4fcc5a-08b6-4429-9458-3184841c0942 admin admin] PATH_INFO: `/v3/users/dff7a4336ffe4cf7b8f9f2a76ddbc2ea` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:14.346942 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4fcc5a-08b6-4429-9458-3184841c0942 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dff7a4336ffe4cf7b8f9f2a76ddbc2ea)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:14.349069 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4fcc5a-08b6-4429-9458-3184841c0942 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:14.647115 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-2a4fcc5a-08b6-4429-9458-3184841c0942 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dff7a4336ffe4cf7b8f9f2a76ddbc2ea'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:14.717467 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-2a4fcc5a-08b6-4429-9458-3184841c0942 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dff7a4336ffe4cf7b8f9f2a76ddbc2ea'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:14.718201 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-2a4fcc5a-08b6-4429-9458-3184841c0942 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dff7a4336ffe4cf7b8f9f2a76ddbc2ea'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:14.728707 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-2a4fcc5a-08b6-4429-9458-3184841c0942 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dff7a4336ffe4cf7b8f9f2a76ddbc2ea'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:14.729416 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-2a4fcc5a-08b6-4429-9458-3184841c0942 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dff7a4336ffe4cf7b8f9f2a76ddbc2ea'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:14.758852 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 966/1916] 10.222.0.15 () {58 vars in 1223 bytes} [Tue May 31 14:50:14 2022] DELETE /identity/v3/users/dff7a4336ffe4cf7b8f9f2a76ddbc2ea => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:50:14.763705 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86518ebe-bc19-42bc-ae13-f9df599f656b None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:14.764152 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86518ebe-bc19-42bc-ae13-f9df599f656b None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:14.764391 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86518ebe-bc19-42bc-ae13-f9df599f656b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:14.787956 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-86518ebe-bc19-42bc-ae13-f9df599f656b None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:50:14.789295 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-86518ebe-bc19-42bc-ae13-f9df599f656b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:14.834978 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:14.935173 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 951/1917] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:50:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:50:14.946127 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4fcc5a-08b6-4429-9458-3184841c0942 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:14.948908 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-2a4fcc5a-08b6-4429-9458-3184841c0942 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:15.029632 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdad522-dfaf-4c3c-9446-73410afe003d None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:15.029925 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdad522-dfaf-4c3c-9446-73410afe003d None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:15.031166 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdad522-dfaf-4c3c-9446-73410afe003d None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:15.031771 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 952/1918] 10.222.0.15 () {54 vars in 921 bytes} [Tue May 31 14:50:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:50:15.040630 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644a1bc4-52f4-4ec8-97a7-c7a700b39e03 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:15.040909 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644a1bc4-52f4-4ec8-97a7-c7a700b39e03 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:15.041189 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644a1bc4-52f4-4ec8-97a7-c7a700b39e03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:15.044021 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4fcc5a-08b6-4429-9458-3184841c0942 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:15.054817 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e4d2c8-e46e-41bf-a5df-07a6652dfcb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:15.061650 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e4d2c8-e46e-41bf-a5df-07a6652dfcb4 service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:15.062451 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e4d2c8-e46e-41bf-a5df-07a6652dfcb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:15.063065 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e4d2c8-e46e-41bf-a5df-07a6652dfcb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:15.064216 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-644a1bc4-52f4-4ec8-97a7-c7a700b39e03 None None] MFA Rules not processed for user `b57768d448e345ad8879bf29f21b48ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:50:15.065508 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-644a1bc4-52f4-4ec8-97a7-c7a700b39e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:15.077973 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e4d2c8-e46e-41bf-a5df-07a6652dfcb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:15.079797 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e4d2c8-e46e-41bf-a5df-07a6652dfcb4 service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:15.094492 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 967/1919] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:50:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:50:15.177660 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 953/1920] 10.222.0.15 () {58 vars in 1018 bytes} [Tue May 31 14:50:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 14:50:15.196162 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e4d2c8-e46e-41bf-a5df-07a6652dfcb4 service neutron] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:15.196162 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-b2e4d2c8-e46e-41bf-a5df-07a6652dfcb4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:15.210513 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e4d2c8-e46e-41bf-a5df-07a6652dfcb4 service neutron] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:15.232638 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4653f947-fad9-4d8d-85ed-356dc8e6a3d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57768d448e345ad8879bf29f21b48ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:15.233372 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4653f947-fad9-4d8d-85ed-356dc8e6a3d1 service nova] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:15.233669 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4653f947-fad9-4d8d-85ed-356dc8e6a3d1 service nova] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:15.234396 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4653f947-fad9-4d8d-85ed-356dc8e6a3d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:15.254775 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4653f947-fad9-4d8d-85ed-356dc8e6a3d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:15.256677 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4653f947-fad9-4d8d-85ed-356dc8e6a3d1 service nova] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:15.272998 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 968/1921] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:50:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 14:50:16.292345 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644a1bc4-52f4-4ec8-97a7-c7a700b39e03 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:16.293975 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-644a1bc4-52f4-4ec8-97a7-c7a700b39e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:16.408124 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644a1bc4-52f4-4ec8-97a7-c7a700b39e03 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:16.412350 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf70783-66ae-4925-afd2-95426ae262dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afbf718dcd9b4741a926b0a2321bd53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:16.413421 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf70783-66ae-4925-afd2-95426ae262dc service cinder] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:16.413883 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf70783-66ae-4925-afd2-95426ae262dc service cinder] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:16.414652 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf70783-66ae-4925-afd2-95426ae262dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:16.417738 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-adf70783-66ae-4925-afd2-95426ae262dc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:16.496561 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf70783-66ae-4925-afd2-95426ae262dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:16.498503 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf70783-66ae-4925-afd2-95426ae262dc service cinder] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:16.510267 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 954/1922] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:50:16 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:50:16.559401 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4653f947-fad9-4d8d-85ed-356dc8e6a3d1 service nova] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:16.568611 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-4653f947-fad9-4d8d-85ed-356dc8e6a3d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:16.588286 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4653f947-fad9-4d8d-85ed-356dc8e6a3d1 service nova] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:16.594006 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c26515-eef5-4c4f-a6ec-6de2313219c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:16.595194 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c26515-eef5-4c4f-a6ec-6de2313219c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:16.595648 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c26515-eef5-4c4f-a6ec-6de2313219c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:16.596069 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c26515-eef5-4c4f-a6ec-6de2313219c8 admin admin] PATH_INFO: `/v3/projects/c1d5274af3b142dc92637c659d9df43c` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:16.597566 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c26515-eef5-4c4f-a6ec-6de2313219c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1d5274af3b142dc92637c659d9df43c)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:16.599573 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c26515-eef5-4c4f-a6ec-6de2313219c8 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:16.607089 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:16.712168 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-31c26515-eef5-4c4f-a6ec-6de2313219c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1d5274af3b142dc92637c659d9df43c', 'request_id': 'req-31c26515-eef5-4c4f-a6ec-6de2313219c8'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:16.779215 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-31c26515-eef5-4c4f-a6ec-6de2313219c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1d5274af3b142dc92637c659d9df43c', 'request_id': 'req-31c26515-eef5-4c4f-a6ec-6de2313219c8'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:16.786029 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-31c26515-eef5-4c4f-a6ec-6de2313219c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1d5274af3b142dc92637c659d9df43c', 'request_id': 'req-31c26515-eef5-4c4f-a6ec-6de2313219c8'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:16.801716 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-31c26515-eef5-4c4f-a6ec-6de2313219c8 admin admin] The token cache is being invalidate because project c1d5274af3b142dc92637c659d9df43c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80503) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 14:50:16.802035 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-31c26515-eef5-4c4f-a6ec-6de2313219c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:16.802791 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-31c26515-eef5-4c4f-a6ec-6de2313219c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:16.804704 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 969/1923] 10.222.0.15 () {58 vars in 1232 bytes} [Tue May 31 14:50:16 2022] DELETE /identity/v3/projects/c1d5274af3b142dc92637c659d9df43c => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:50:16.810865 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf70783-66ae-4925-afd2-95426ae262dc service cinder] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:16.823221 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf70783-66ae-4925-afd2-95426ae262dc service cinder] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:16.835861 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:16.889916 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd1d041-6b93-49e7-8e69-0a597021acf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:16.890965 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd1d041-6b93-49e7-8e69-0a597021acf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:16.891206 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd1d041-6b93-49e7-8e69-0a597021acf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:16.891491 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd1d041-6b93-49e7-8e69-0a597021acf2 admin admin] PATH_INFO: `/v3/users/7bf7a7de05bd44f7a94d520011324c71` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:16.892703 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd1d041-6b93-49e7-8e69-0a597021acf2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bf7a7de05bd44f7a94d520011324c71)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:16.894953 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd1d041-6b93-49e7-8e69-0a597021acf2 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:17.645357 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-0cd1d041-6b93-49e7-8e69-0a597021acf2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bf7a7de05bd44f7a94d520011324c71'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:17.654702 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-0cd1d041-6b93-49e7-8e69-0a597021acf2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bf7a7de05bd44f7a94d520011324c71'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:17.657028 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-0cd1d041-6b93-49e7-8e69-0a597021acf2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bf7a7de05bd44f7a94d520011324c71'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:17.657981 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-0cd1d041-6b93-49e7-8e69-0a597021acf2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bf7a7de05bd44f7a94d520011324c71'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:17.671875 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-0cd1d041-6b93-49e7-8e69-0a597021acf2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bf7a7de05bd44f7a94d520011324c71'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:17.802832 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 955/1924] 10.222.0.15 () {58 vars in 1223 bytes} [Tue May 31 14:50:16 2022] DELETE /identity/v3/users/7bf7a7de05bd44f7a94d520011324c71 => generated 0 bytes in 993 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:50:18.416343 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c26515-eef5-4c4f-a6ec-6de2313219c8 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:18.425444 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-31c26515-eef5-4c4f-a6ec-6de2313219c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:18.467844 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c26515-eef5-4c4f-a6ec-6de2313219c8 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:18.554350 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4f5d46-d6ee-4be9-8e79-b89fb64b8dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:18.555401 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f5d46-d6ee-4be9-8e79-b89fb64b8dab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:18.556334 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f5d46-d6ee-4be9-8e79-b89fb64b8dab admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:18.556769 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f5d46-d6ee-4be9-8e79-b89fb64b8dab admin admin] PATH_INFO: `/v3/projects/d898b4d9b6ea4be4abd5598a00b93ee2` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:18.558738 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4f5d46-d6ee-4be9-8e79-b89fb64b8dab admin admin] RBAC: Authorizing `identity:delete_project(project_id=d898b4d9b6ea4be4abd5598a00b93ee2)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:18.563069 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4f5d46-d6ee-4be9-8e79-b89fb64b8dab admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:18.704089 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-3a4f5d46-d6ee-4be9-8e79-b89fb64b8dab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd898b4d9b6ea4be4abd5598a00b93ee2', 'request_id': 'req-3a4f5d46-d6ee-4be9-8e79-b89fb64b8dab'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:18.825266 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-3a4f5d46-d6ee-4be9-8e79-b89fb64b8dab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd898b4d9b6ea4be4abd5598a00b93ee2', 'request_id': 'req-3a4f5d46-d6ee-4be9-8e79-b89fb64b8dab'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:18.835382 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-3a4f5d46-d6ee-4be9-8e79-b89fb64b8dab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd898b4d9b6ea4be4abd5598a00b93ee2', 'request_id': 'req-3a4f5d46-d6ee-4be9-8e79-b89fb64b8dab'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:18.857128 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-3a4f5d46-d6ee-4be9-8e79-b89fb64b8dab admin admin] The token cache is being invalidate because project d898b4d9b6ea4be4abd5598a00b93ee2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80503) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 14:50:18.857128 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-3a4f5d46-d6ee-4be9-8e79-b89fb64b8dab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:18.857128 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-3a4f5d46-d6ee-4be9-8e79-b89fb64b8dab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:18.860559 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 970/1925] 10.222.0.15 () {58 vars in 1232 bytes} [Tue May 31 14:50:18 2022] DELETE /identity/v3/projects/d898b4d9b6ea4be4abd5598a00b93ee2 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:50:18.865297 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aa5511-be9a-42fb-92ee-a7a6865c30c1 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:18.865788 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aa5511-be9a-42fb-92ee-a7a6865c30c1 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:18.866104 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aa5511-be9a-42fb-92ee-a7a6865c30c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:18.887834 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-f8aa5511-be9a-42fb-92ee-a7a6865c30c1 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:50:18.889670 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-f8aa5511-be9a-42fb-92ee-a7a6865c30c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:18.985329 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 956/1926] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:50:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:50:18.996520 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a205502-d67a-4e2f-914d-f8750aa057b2 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:18.997010 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a205502-d67a-4e2f-914d-f8750aa057b2 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:18.997522 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a205502-d67a-4e2f-914d-f8750aa057b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:19.022531 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-2a205502-d67a-4e2f-914d-f8750aa057b2 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:50:19.024247 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-2a205502-d67a-4e2f-914d-f8750aa057b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:19.037281 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 971/1927] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:50:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:50:19.049600 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aa5511-be9a-42fb-92ee-a7a6865c30c1 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:19.052353 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aa5511-be9a-42fb-92ee-a7a6865c30c1 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:19.057091 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246f7a53-0841-4bd4-92cc-7824282aaa19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:19.057777 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246f7a53-0841-4bd4-92cc-7824282aaa19 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:19.058041 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246f7a53-0841-4bd4-92cc-7824282aaa19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:19.058755 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246f7a53-0841-4bd4-92cc-7824282aaa19 admin admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:19.061355 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246f7a53-0841-4bd4-92cc-7824282aaa19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:50:19.061355 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246f7a53-0841-4bd4-92cc-7824282aaa19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:19.061684 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246f7a53-0841-4bd4-92cc-7824282aaa19 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:19.080182 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 957/1928] 10.222.0.15 () {58 vars in 1152 bytes} [Tue May 31 14:50:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:50:19.083979 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a205502-d67a-4e2f-914d-f8750aa057b2 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:19.095021 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a205502-d67a-4e2f-914d-f8750aa057b2 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:19.104673 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbac336-338e-4f6e-97db-814dc9092eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:19.107413 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbac336-338e-4f6e-97db-814dc9092eb6 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:19.107413 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbac336-338e-4f6e-97db-814dc9092eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:19.107413 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbac336-338e-4f6e-97db-814dc9092eb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:19.107413 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbac336-338e-4f6e-97db-814dc9092eb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:19.109355 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbac336-338e-4f6e-97db-814dc9092eb6 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:19.120822 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:19.238582 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 972/1929] 10.222.0.15 () {60 vars in 1152 bytes} [Tue May 31 14:50:19 2022] POST /identity/v3/projects => generated 367 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:50:19.242773 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246f7a53-0841-4bd4-92cc-7824282aaa19 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:19.255025 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246f7a53-0841-4bd4-92cc-7824282aaa19 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:19.275342 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:19.358712 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e85ad89-c792-453d-8152-d5c826a71a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:19.359624 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85ad89-c792-453d-8152-d5c826a71a6a admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:19.360095 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85ad89-c792-453d-8152-d5c826a71a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:19.360588 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85ad89-c792-453d-8152-d5c826a71a6a admin admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:19.361691 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e85ad89-c792-453d-8152-d5c826a71a6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:19.364447 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e85ad89-c792-453d-8152-d5c826a71a6a admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:19.488290 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 958/1930] 10.222.0.15 () {60 vars in 1143 bytes} [Tue May 31 14:50:19 2022] POST /identity/v3/users => generated 284 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:50:19.493032 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbac336-338e-4f6e-97db-814dc9092eb6 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:19.503321 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbac336-338e-4f6e-97db-814dc9092eb6 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:19.508263 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725f5cc7-d108-4271-b75f-12f3106832ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:19.509016 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f5cc7-d108-4271-b75f-12f3106832ba admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:19.509221 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f5cc7-d108-4271-b75f-12f3106832ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:19.509491 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f5cc7-d108-4271-b75f-12f3106832ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:19.510629 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725f5cc7-d108-4271-b75f-12f3106832ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:19.513829 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725f5cc7-d108-4271-b75f-12f3106832ba admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:19.530233 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 973/1931] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:50:19 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:50:19.531328 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e85ad89-c792-453d-8152-d5c826a71a6a admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:19.545279 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e85ad89-c792-453d-8152-d5c826a71a6a admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:19.559118 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b7acff-d7f4-4261-914d-39406fbd6130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:19.560562 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7acff-d7f4-4261-914d-39406fbd6130 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:19.561421 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7acff-d7f4-4261-914d-39406fbd6130 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:19.561421 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7acff-d7f4-4261-914d-39406fbd6130 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:19.562007 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b7acff-d7f4-4261-914d-39406fbd6130 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:19.563771 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b7acff-d7f4-4261-914d-39406fbd6130 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:19.578960 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 959/1932] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:50:19 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 14:50:19.580911 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725f5cc7-d108-4271-b75f-12f3106832ba admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:19.591894 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b7acff-d7f4-4261-914d-39406fbd6130 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:19.594236 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-64b7acff-d7f4-4261-914d-39406fbd6130 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:19.597821 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725f5cc7-d108-4271-b75f-12f3106832ba admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:19.609652 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7266139d-4773-4808-a72a-b7840f3a037d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:19.610709 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7266139d-4773-4808-a72a-b7840f3a037d admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:19.611105 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7266139d-4773-4808-a72a-b7840f3a037d admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:19.611403 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7266139d-4773-4808-a72a-b7840f3a037d admin admin] PATH_INFO: `/v3/projects/bc764f1a911c483d870231276f21537c/users/60585bf4907143839fdca05fb56f7f96/roles/317f725e26bf43648d8235bb1f7c4cb3` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:19.612277 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b7acff-d7f4-4261-914d-39406fbd6130 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:19.618887 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290490a1-c62e-493b-bca0-650c3fd2a1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:19.619874 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290490a1-c62e-493b-bca0-650c3fd2a1ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:19.620227 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290490a1-c62e-493b-bca0-650c3fd2a1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:19.620575 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290490a1-c62e-493b-bca0-650c3fd2a1ca admin admin] PATH_INFO: `/v3/users/c7b4644c7fb74ed88c83d348a32c015c` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:19.621891 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290490a1-c62e-493b-bca0-650c3fd2a1ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7b4644c7fb74ed88c83d348a32c015c)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:19.624665 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290490a1-c62e-493b-bca0-650c3fd2a1ca admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:19.638444 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7266139d-4773-4808-a72a-b7840f3a037d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc764f1a911c483d870231276f21537c, user_id=60585bf4907143839fdca05fb56f7f96, role_id=317f725e26bf43648d8235bb1f7c4cb3)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:19.647932 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7266139d-4773-4808-a72a-b7840f3a037d admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:19.759583 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 974/1933] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:50:19 2022] PUT /identity/v3/projects/bc764f1a911c483d870231276f21537c/users/60585bf4907143839fdca05fb56f7f96/roles/317f725e26bf43648d8235bb1f7c4cb3 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:50:19.770620 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938974fa-7c65-4223-b91e-bf26947f67e7 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:19.770913 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938974fa-7c65-4223-b91e-bf26947f67e7 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:19.771191 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938974fa-7c65-4223-b91e-bf26947f67e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:19.797712 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-938974fa-7c65-4223-b91e-bf26947f67e7 None None] MFA Rules not processed for user `60585bf4907143839fdca05fb56f7f96`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:50:19.802753 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-938974fa-7c65-4223-b91e-bf26947f67e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:19.862001 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 975/1934] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:50:19 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 14:50:19.866273 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938974fa-7c65-4223-b91e-bf26947f67e7 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:19.868465 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-290490a1-c62e-493b-bca0-650c3fd2a1ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7b4644c7fb74ed88c83d348a32c015c'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:19.876420 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-290490a1-c62e-493b-bca0-650c3fd2a1ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7b4644c7fb74ed88c83d348a32c015c'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:19.877098 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-290490a1-c62e-493b-bca0-650c3fd2a1ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7b4644c7fb74ed88c83d348a32c015c'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:19.877827 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-290490a1-c62e-493b-bca0-650c3fd2a1ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7b4644c7fb74ed88c83d348a32c015c'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:19.890968 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-290490a1-c62e-493b-bca0-650c3fd2a1ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7b4644c7fb74ed88c83d348a32c015c'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:19.927992 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938974fa-7c65-4223-b91e-bf26947f67e7 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:19.933327 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd1b34e-b1cc-4dba-9094-96f5609f6335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:19.934027 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd1b34e-b1cc-4dba-9094-96f5609f6335 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:19.934399 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd1b34e-b1cc-4dba-9094-96f5609f6335 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:19.934779 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd1b34e-b1cc-4dba-9094-96f5609f6335 admin admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:19.935862 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd1b34e-b1cc-4dba-9094-96f5609f6335 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:19.937958 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd1b34e-b1cc-4dba-9094-96f5609f6335 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:19.979218 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 960/1935] 10.222.0.15 () {58 vars in 1223 bytes} [Tue May 31 14:50:19 2022] DELETE /identity/v3/users/c7b4644c7fb74ed88c83d348a32c015c => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 14:50:20.052864 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 976/1936] 10.222.0.15 () {60 vars in 1152 bytes} [Tue May 31 14:50:19 2022] POST /identity/v3/projects => generated 369 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 14:50:20.053938 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290490a1-c62e-493b-bca0-650c3fd2a1ca admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:20.055486 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-290490a1-c62e-493b-bca0-650c3fd2a1ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:20.126163 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290490a1-c62e-493b-bca0-650c3fd2a1ca admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:20.184959 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c4555d-4786-4059-90be-17212400cfd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:20.185726 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c4555d-4786-4059-90be-17212400cfd5 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:20.186166 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c4555d-4786-4059-90be-17212400cfd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:20.186449 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c4555d-4786-4059-90be-17212400cfd5 admin admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:20.187178 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c4555d-4786-4059-90be-17212400cfd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:20.189692 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c4555d-4786-4059-90be-17212400cfd5 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:20.238046 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd1b34e-b1cc-4dba-9094-96f5609f6335 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:20.241915 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-7fd1b34e-b1cc-4dba-9094-96f5609f6335 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:20.253740 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd1b34e-b1cc-4dba-9094-96f5609f6335 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:20.258679 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c2cd9c-ad34-43c4-bdba-39e299c549c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:20.259586 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c2cd9c-ad34-43c4-bdba-39e299c549c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:20.259887 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c2cd9c-ad34-43c4-bdba-39e299c549c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:20.260176 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c2cd9c-ad34-43c4-bdba-39e299c549c1 admin admin] PATH_INFO: `/v3/projects/d1e1ac97164c4da8a2b08f8411456401` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:20.261351 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c2cd9c-ad34-43c4-bdba-39e299c549c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1e1ac97164c4da8a2b08f8411456401)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:20.263830 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c2cd9c-ad34-43c4-bdba-39e299c549c1 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:20.299650 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 961/1937] 10.222.0.15 () {60 vars in 1143 bytes} [Tue May 31 14:50:20 2022] POST /identity/v3/users => generated 291 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 14:50:20.304997 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c4555d-4786-4059-90be-17212400cfd5 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:20.313846 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c4555d-4786-4059-90be-17212400cfd5 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:20.318674 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6ce6f2-8525-4330-b0f7-085843530384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:20.319321 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ce6f2-8525-4330-b0f7-085843530384 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:20.319607 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ce6f2-8525-4330-b0f7-085843530384 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:20.319889 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ce6f2-8525-4330-b0f7-085843530384 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:20.320641 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6ce6f2-8525-4330-b0f7-085843530384 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:20.322237 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6ce6f2-8525-4330-b0f7-085843530384 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:20.333172 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 962/1938] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:50:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 14:50:20.337136 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6ce6f2-8525-4330-b0f7-085843530384 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:20.348069 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6ce6f2-8525-4330-b0f7-085843530384 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:20.352359 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:20.353590 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3627d268-acbe-4a13-99ef-791fa4346c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:20.354654 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3627d268-acbe-4a13-99ef-791fa4346c65 admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:20.354945 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3627d268-acbe-4a13-99ef-791fa4346c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:20.355227 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3627d268-acbe-4a13-99ef-791fa4346c65 admin admin] PATH_INFO: `/v3/projects/fad51516904646ecac05c5519341d827/users/a7272a5a0abf4fcb9d721692f748f0cd/roles/76c53e2c353644f885028a0226c06146` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:20.370121 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-14c2cd9c-ad34-43c4-bdba-39e299c549c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1e1ac97164c4da8a2b08f8411456401', 'request_id': 'req-14c2cd9c-ad34-43c4-bdba-39e299c549c1'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:20.370885 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3627d268-acbe-4a13-99ef-791fa4346c65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fad51516904646ecac05c5519341d827, user_id=a7272a5a0abf4fcb9d721692f748f0cd, role_id=76c53e2c353644f885028a0226c06146)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:20.374828 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3627d268-acbe-4a13-99ef-791fa4346c65 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:20.384899 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:20.442380 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-14c2cd9c-ad34-43c4-bdba-39e299c549c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1e1ac97164c4da8a2b08f8411456401', 'request_id': 'req-14c2cd9c-ad34-43c4-bdba-39e299c549c1'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:20.448657 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-14c2cd9c-ad34-43c4-bdba-39e299c549c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1e1ac97164c4da8a2b08f8411456401', 'request_id': 'req-14c2cd9c-ad34-43c4-bdba-39e299c549c1'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:20.460704 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-14c2cd9c-ad34-43c4-bdba-39e299c549c1 admin admin] The token cache is being invalidate because project d1e1ac97164c4da8a2b08f8411456401 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80503) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 14:50:20.461001 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-14c2cd9c-ad34-43c4-bdba-39e299c549c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:20.461701 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-14c2cd9c-ad34-43c4-bdba-39e299c549c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:20.463311 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 977/1939] 10.222.0.15 () {58 vars in 1232 bytes} [Tue May 31 14:50:20 2022] DELETE /identity/v3/projects/d1e1ac97164c4da8a2b08f8411456401 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 14:50:20.478603 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 963/1940] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:50:20 2022] PUT /identity/v3/projects/fad51516904646ecac05c5519341d827/users/a7272a5a0abf4fcb9d721692f748f0cd/roles/76c53e2c353644f885028a0226c06146 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 14:50:20.480152 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff5d090-18de-4ee7-b16f-70cf4c97c1b1 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:20.480518 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff5d090-18de-4ee7-b16f-70cf4c97c1b1 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:20.480873 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff5d090-18de-4ee7-b16f-70cf4c97c1b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:20.482308 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3627d268-acbe-4a13-99ef-791fa4346c65 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:20.485244 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-3627d268-acbe-4a13-99ef-791fa4346c65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:20.501700 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-0ff5d090-18de-4ee7-b16f-70cf4c97c1b1 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:50:20.503585 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-0ff5d090-18de-4ee7-b16f-70cf4c97c1b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:20.558381 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3627d268-acbe-4a13-99ef-791fa4346c65 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:20.564129 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e750f69-8366-434f-88a2-c0f623050927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:20.564847 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e750f69-8366-434f-88a2-c0f623050927 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:20.565141 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e750f69-8366-434f-88a2-c0f623050927 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:20.565446 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 978/1941] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:50:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:50:20.566735 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e750f69-8366-434f-88a2-c0f623050927 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:20.568135 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e750f69-8366-434f-88a2-c0f623050927 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:20.570117 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e750f69-8366-434f-88a2-c0f623050927 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:20.576352 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88512386-585e-49de-b878-2332e588a983 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:20.576643 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88512386-585e-49de-b878-2332e588a983 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:20.576926 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88512386-585e-49de-b878-2332e588a983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:20.583714 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 964/1942] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:50:20 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 14:50:20.593310 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e750f69-8366-434f-88a2-c0f623050927 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:20.596183 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-88512386-585e-49de-b878-2332e588a983 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:50:20.597386 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-88512386-585e-49de-b878-2332e588a983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:20.603374 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e750f69-8366-434f-88a2-c0f623050927 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:20.606745 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 979/1943] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:50:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:50:20.611077 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88512386-585e-49de-b878-2332e588a983 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:20.611292 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51389528-4bf7-4e08-99a7-174db0f1c31b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:20.612249 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51389528-4bf7-4e08-99a7-174db0f1c31b admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:20.612525 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51389528-4bf7-4e08-99a7-174db0f1c31b admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:20.612812 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51389528-4bf7-4e08-99a7-174db0f1c31b admin admin] PATH_INFO: `/v3/projects/fad51516904646ecac05c5519341d827/users/a7272a5a0abf4fcb9d721692f748f0cd/roles/76c53e2c353644f885028a0226c06146` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:20.614867 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51389528-4bf7-4e08-99a7-174db0f1c31b admin admin] RBAC: Authorizing `identity:create_grant(project_id=fad51516904646ecac05c5519341d827, user_id=a7272a5a0abf4fcb9d721692f748f0cd, role_id=76c53e2c353644f885028a0226c06146)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:20.617569 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51389528-4bf7-4e08-99a7-174db0f1c31b admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:20.623994 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88512386-585e-49de-b878-2332e588a983 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:20.632246 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 965/1944] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:50:20 2022] PUT /identity/v3/projects/fad51516904646ecac05c5519341d827/users/a7272a5a0abf4fcb9d721692f748f0cd/roles/76c53e2c353644f885028a0226c06146 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:50:20.642913 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fdae65-e10c-46ca-9c31-f02f62ab3ecb None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:20.643210 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fdae65-e10c-46ca-9c31-f02f62ab3ecb None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:20.643478 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fdae65-e10c-46ca-9c31-f02f62ab3ecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:20.683192 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-84fdae65-e10c-46ca-9c31-f02f62ab3ecb None None] MFA Rules not processed for user `a7272a5a0abf4fcb9d721692f748f0cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:50:20.683192 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-84fdae65-e10c-46ca-9c31-f02f62ab3ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:20.698779 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a826f8-7ba6-459d-863b-55497f2b2848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:20.702754 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a826f8-7ba6-459d-863b-55497f2b2848 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:20.702754 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a826f8-7ba6-459d-863b-55497f2b2848 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:20.702754 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a826f8-7ba6-459d-863b-55497f2b2848 admin admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:20.702754 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a826f8-7ba6-459d-863b-55497f2b2848 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:50:20.702754 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a826f8-7ba6-459d-863b-55497f2b2848 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:20.703228 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a826f8-7ba6-459d-863b-55497f2b2848 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:20.714979 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 980/1945] 10.222.0.15 () {58 vars in 1152 bytes} [Tue May 31 14:50:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:50:20.719365 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a826f8-7ba6-459d-863b-55497f2b2848 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:20.729224 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a826f8-7ba6-459d-863b-55497f2b2848 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:20.734488 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d4770a-5985-497a-9c03-6403cb542942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:20.735181 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d4770a-5985-497a-9c03-6403cb542942 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:20.735472 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d4770a-5985-497a-9c03-6403cb542942 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:20.735753 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d4770a-5985-497a-9c03-6403cb542942 admin admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:20.736446 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d4770a-5985-497a-9c03-6403cb542942 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:20.738351 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d4770a-5985-497a-9c03-6403cb542942 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:20.752259 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 966/1946] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:50:20 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 14:50:20.790245 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fdae65-e10c-46ca-9c31-f02f62ab3ecb None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:20.791819 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-84fdae65-e10c-46ca-9c31-f02f62ab3ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:20.853853 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fdae65-e10c-46ca-9c31-f02f62ab3ecb None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:20.858067 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4cec47-8db6-4807-a4fc-5f99a94b3562 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afbf718dcd9b4741a926b0a2321bd53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:20.858752 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4cec47-8db6-4807-a4fc-5f99a94b3562 service cinder] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:20.859039 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4cec47-8db6-4807-a4fc-5f99a94b3562 service cinder] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:20.859332 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4cec47-8db6-4807-a4fc-5f99a94b3562 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:20.868939 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4cec47-8db6-4807-a4fc-5f99a94b3562 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:20.871336 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4cec47-8db6-4807-a4fc-5f99a94b3562 service cinder] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:20.882524 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 967/1947] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:50:20 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 14:50:20.896450 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 981/1948] 10.222.0.15 () {60 vars in 1152 bytes} [Tue May 31 14:50:20 2022] POST /identity/v3/projects => generated 377 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 14:50:20.900862 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4cec47-8db6-4807-a4fc-5f99a94b3562 service cinder] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:20.912358 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4cec47-8db6-4807-a4fc-5f99a94b3562 service cinder] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:20.972217 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de1bd68-576e-4dae-9257-0367d8ac196a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:20.972917 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de1bd68-576e-4dae-9257-0367d8ac196a admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:20.973268 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de1bd68-576e-4dae-9257-0367d8ac196a admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:20.973552 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de1bd68-576e-4dae-9257-0367d8ac196a admin admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:20.974370 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de1bd68-576e-4dae-9257-0367d8ac196a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:20.976309 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de1bd68-576e-4dae-9257-0367d8ac196a admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:21.078886 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:21.084952 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 968/1949] 10.222.0.15 () {60 vars in 1143 bytes} [Tue May 31 14:50:20 2022] POST /identity/v3/users => generated 289 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 14:50:21.089624 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d4770a-5985-497a-9c03-6403cb542942 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:21.100327 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d4770a-5985-497a-9c03-6403cb542942 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:21.108072 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d96bce-affd-4353-902b-c0ec8914f3e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:21.114489 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d96bce-affd-4353-902b-c0ec8914f3e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:21.114489 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d96bce-affd-4353-902b-c0ec8914f3e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:21.114489 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d96bce-affd-4353-902b-c0ec8914f3e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:21.114489 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d96bce-affd-4353-902b-c0ec8914f3e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:21.114489 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d96bce-affd-4353-902b-c0ec8914f3e1 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:21.129907 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 982/1950] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:50:21 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:50:21.130091 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de1bd68-576e-4dae-9257-0367d8ac196a admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:21.140878 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de1bd68-576e-4dae-9257-0367d8ac196a admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:21.147012 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb78b96-83e2-4077-b979-1ad77c790023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:21.147688 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb78b96-83e2-4077-b979-1ad77c790023 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:21.148090 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb78b96-83e2-4077-b979-1ad77c790023 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:21.148398 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb78b96-83e2-4077-b979-1ad77c790023 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:21.149276 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb78b96-83e2-4077-b979-1ad77c790023 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:21.150905 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb78b96-83e2-4077-b979-1ad77c790023 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:21.161989 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 969/1951] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:50:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:50:21.166246 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d96bce-affd-4353-902b-c0ec8914f3e1 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:21.177491 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d96bce-affd-4353-902b-c0ec8914f3e1 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:21.182347 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229d1e6e-93f4-4b59-9596-b6a6dd3887a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:21.183252 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229d1e6e-93f4-4b59-9596-b6a6dd3887a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:21.183570 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229d1e6e-93f4-4b59-9596-b6a6dd3887a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:21.183850 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229d1e6e-93f4-4b59-9596-b6a6dd3887a3 admin admin] PATH_INFO: `/v3/projects/79d80f978ac24af083ebabc052f34f4c/users/76afe593701f4ff0b73660e7622eca69/roles/317f725e26bf43648d8235bb1f7c4cb3` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:21.187553 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:21.199501 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229d1e6e-93f4-4b59-9596-b6a6dd3887a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79d80f978ac24af083ebabc052f34f4c, user_id=76afe593701f4ff0b73660e7622eca69, role_id=317f725e26bf43648d8235bb1f7c4cb3)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:21.202178 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229d1e6e-93f4-4b59-9596-b6a6dd3887a3 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:21.271019 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 983/1952] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:50:21 2022] PUT /identity/v3/projects/79d80f978ac24af083ebabc052f34f4c/users/76afe593701f4ff0b73660e7622eca69/roles/317f725e26bf43648d8235bb1f7c4cb3 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 14:50:21.282486 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a71afda-65ad-4e0b-b681-c6957d4dfb06 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:21.282808 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a71afda-65ad-4e0b-b681-c6957d4dfb06 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:21.283094 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a71afda-65ad-4e0b-b681-c6957d4dfb06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:21.312559 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-8a71afda-65ad-4e0b-b681-c6957d4dfb06 None None] MFA Rules not processed for user `76afe593701f4ff0b73660e7622eca69`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:50:21.313757 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-8a71afda-65ad-4e0b-b681-c6957d4dfb06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:21.377906 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:21.386714 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 970/1953] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:50:21 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:50:21.393126 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229d1e6e-93f4-4b59-9596-b6a6dd3887a3 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:21.458598 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229d1e6e-93f4-4b59-9596-b6a6dd3887a3 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:21.464048 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a6f0e6-8bba-4371-bc6e-fe7cf074121d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:21.464741 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a6f0e6-8bba-4371-bc6e-fe7cf074121d admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:21.465025 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a6f0e6-8bba-4371-bc6e-fe7cf074121d admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:21.465303 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a6f0e6-8bba-4371-bc6e-fe7cf074121d admin admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:21.466640 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a6f0e6-8bba-4371-bc6e-fe7cf074121d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:21.469779 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a6f0e6-8bba-4371-bc6e-fe7cf074121d admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:21.608955 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 984/1954] 10.222.0.15 () {60 vars in 1152 bytes} [Tue May 31 14:50:21 2022] POST /identity/v3/projects => generated 375 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:50:21.612926 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a71afda-65ad-4e0b-b681-c6957d4dfb06 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:21.623917 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a71afda-65ad-4e0b-b681-c6957d4dfb06 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:21.682313 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b876f64-9c91-436d-b14b-2857aa68692b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:21.683049 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b876f64-9c91-436d-b14b-2857aa68692b admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:21.683333 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b876f64-9c91-436d-b14b-2857aa68692b admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:21.683614 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b876f64-9c91-436d-b14b-2857aa68692b admin admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:21.684494 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b876f64-9c91-436d-b14b-2857aa68692b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:21.686448 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b876f64-9c91-436d-b14b-2857aa68692b admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:21.873922 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a6f0e6-8bba-4371-bc6e-fe7cf074121d admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:21.874404 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 971/1955] 10.222.0.15 () {60 vars in 1143 bytes} [Tue May 31 14:50:21 2022] POST /identity/v3/users => generated 294 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:50:21.886417 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a6f0e6-8bba-4371-bc6e-fe7cf074121d admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:21.892280 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbda0a39-1bd4-4fa1-ba37-16e06b1a42ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:21.893138 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda0a39-1bd4-4fa1-ba37-16e06b1a42ea admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:21.893492 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda0a39-1bd4-4fa1-ba37-16e06b1a42ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:21.893890 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda0a39-1bd4-4fa1-ba37-16e06b1a42ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:21.894778 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbda0a39-1bd4-4fa1-ba37-16e06b1a42ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:21.896508 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbda0a39-1bd4-4fa1-ba37-16e06b1a42ea admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:21.909490 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 985/1956] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:50:21 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:50:21.916704 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b876f64-9c91-436d-b14b-2857aa68692b admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:21.931743 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b876f64-9c91-436d-b14b-2857aa68692b admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:21.939873 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f96f8c-7b4d-4aed-9ceb-0271c57ecef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:21.941623 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f96f8c-7b4d-4aed-9ceb-0271c57ecef3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:21.941913 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f96f8c-7b4d-4aed-9ceb-0271c57ecef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:21.942363 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f96f8c-7b4d-4aed-9ceb-0271c57ecef3 admin admin] PATH_INFO: `/v3/projects/8960b8aa4b804a9095ddc849688824f7/users/5d1ac0295d81410caa1a66345973876b/roles/76c53e2c353644f885028a0226c06146` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:21.959133 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f96f8c-7b4d-4aed-9ceb-0271c57ecef3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8960b8aa4b804a9095ddc849688824f7, user_id=5d1ac0295d81410caa1a66345973876b, role_id=76c53e2c353644f885028a0226c06146)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:21.963696 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f96f8c-7b4d-4aed-9ceb-0271c57ecef3 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:21.964841 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbda0a39-1bd4-4fa1-ba37-16e06b1a42ea admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:21.967215 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-cbda0a39-1bd4-4fa1-ba37-16e06b1a42ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:21.981268 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbda0a39-1bd4-4fa1-ba37-16e06b1a42ea admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:21.986144 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48097c0-cc43-4706-aefa-0e29d6235cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:21.987133 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48097c0-cc43-4706-aefa-0e29d6235cda admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:21.987527 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48097c0-cc43-4706-aefa-0e29d6235cda admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:21.988027 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48097c0-cc43-4706-aefa-0e29d6235cda admin admin] PATH_INFO: `/v3/users/ef71cce0b77d41d192397ebce1260fb8` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:21.989359 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48097c0-cc43-4706-aefa-0e29d6235cda admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef71cce0b77d41d192397ebce1260fb8)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:21.991328 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48097c0-cc43-4706-aefa-0e29d6235cda admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:22.021662 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 972/1957] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:50:21 2022] PUT /identity/v3/projects/8960b8aa4b804a9095ddc849688824f7/users/5d1ac0295d81410caa1a66345973876b/roles/76c53e2c353644f885028a0226c06146 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:50:22.025677 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f96f8c-7b4d-4aed-9ceb-0271c57ecef3 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:22.120358 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f96f8c-7b4d-4aed-9ceb-0271c57ecef3 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:22.125483 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a190038-b81e-471c-9a6d-d391a5d6c164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:22.126438 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a190038-b81e-471c-9a6d-d391a5d6c164 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:22.126770 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a190038-b81e-471c-9a6d-d391a5d6c164 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:22.127182 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a190038-b81e-471c-9a6d-d391a5d6c164 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:22.127913 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a190038-b81e-471c-9a6d-d391a5d6c164 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:22.129502 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a190038-b81e-471c-9a6d-d391a5d6c164 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:22.140149 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 973/1958] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:50:22 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 14:50:22.144188 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a190038-b81e-471c-9a6d-d391a5d6c164 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:22.153970 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a190038-b81e-471c-9a6d-d391a5d6c164 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:22.166634 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b709f61-4c32-455f-a15b-da1c2c03909c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:22.166634 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b709f61-4c32-455f-a15b-da1c2c03909c admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:22.166634 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b709f61-4c32-455f-a15b-da1c2c03909c admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:22.166634 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b709f61-4c32-455f-a15b-da1c2c03909c admin admin] PATH_INFO: `/v3/projects/8960b8aa4b804a9095ddc849688824f7/users/5d1ac0295d81410caa1a66345973876b/roles/76c53e2c353644f885028a0226c06146` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:22.167022 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b709f61-4c32-455f-a15b-da1c2c03909c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8960b8aa4b804a9095ddc849688824f7, user_id=5d1ac0295d81410caa1a66345973876b, role_id=76c53e2c353644f885028a0226c06146)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:22.168530 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b709f61-4c32-455f-a15b-da1c2c03909c admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:22.180503 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 974/1959] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:50:22 2022] PUT /identity/v3/projects/8960b8aa4b804a9095ddc849688824f7/users/5d1ac0295d81410caa1a66345973876b/roles/76c53e2c353644f885028a0226c06146 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 14:50:22.195649 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89408758-525d-4738-8f6c-ff56d06f267f None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:22.195649 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89408758-525d-4738-8f6c-ff56d06f267f None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:22.195649 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89408758-525d-4738-8f6c-ff56d06f267f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:22.205907 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-a48097c0-cc43-4706-aefa-0e29d6235cda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef71cce0b77d41d192397ebce1260fb8'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:22.224720 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-89408758-525d-4738-8f6c-ff56d06f267f None None] MFA Rules not processed for user `5d1ac0295d81410caa1a66345973876b`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:50:22.225911 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-89408758-525d-4738-8f6c-ff56d06f267f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:22.259561 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:22.293404 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-a48097c0-cc43-4706-aefa-0e29d6235cda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef71cce0b77d41d192397ebce1260fb8'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:22.294832 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-a48097c0-cc43-4706-aefa-0e29d6235cda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef71cce0b77d41d192397ebce1260fb8'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:22.305818 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-a48097c0-cc43-4706-aefa-0e29d6235cda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef71cce0b77d41d192397ebce1260fb8'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:22.306185 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 975/1960] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:50:22 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:50:22.306518 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-a48097c0-cc43-4706-aefa-0e29d6235cda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef71cce0b77d41d192397ebce1260fb8'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:22.318255 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89408758-525d-4738-8f6c-ff56d06f267f None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:22.319964 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-89408758-525d-4738-8f6c-ff56d06f267f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:22.325576 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 986/1961] 10.222.0.15 () {58 vars in 1223 bytes} [Tue May 31 14:50:21 2022] DELETE /identity/v3/users/ef71cce0b77d41d192397ebce1260fb8 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 14:50:22.329816 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65901098-5dc4-49a5-96fb-3cb55a454fd2 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:22.330114 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65901098-5dc4-49a5-96fb-3cb55a454fd2 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:22.330398 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65901098-5dc4-49a5-96fb-3cb55a454fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:22.348216 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-65901098-5dc4-49a5-96fb-3cb55a454fd2 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:50:22.349553 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-65901098-5dc4-49a5-96fb-3cb55a454fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:22.376772 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:22.382211 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89408758-525d-4738-8f6c-ff56d06f267f None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:22.409399 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 987/1962] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:50:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:50:22.422985 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65901098-5dc4-49a5-96fb-3cb55a454fd2 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:22.425043 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-65901098-5dc4-49a5-96fb-3cb55a454fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:22.436858 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17a122e-237d-4de4-afca-15b0761d6270 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afbf718dcd9b4741a926b0a2321bd53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:22.437541 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17a122e-237d-4de4-afca-15b0761d6270 service cinder] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:22.437822 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17a122e-237d-4de4-afca-15b0761d6270 service cinder] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:22.438097 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17a122e-237d-4de4-afca-15b0761d6270 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:22.440039 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-e17a122e-237d-4de4-afca-15b0761d6270 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:22.500992 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65901098-5dc4-49a5-96fb-3cb55a454fd2 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:22.508285 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09203bf4-1db0-48fe-87f3-9cbd30daa7db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:22.509348 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09203bf4-1db0-48fe-87f3-9cbd30daa7db service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:22.509818 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09203bf4-1db0-48fe-87f3-9cbd30daa7db service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:22.510129 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09203bf4-1db0-48fe-87f3-9cbd30daa7db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:22.520669 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17a122e-237d-4de4-afca-15b0761d6270 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:22.522122 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09203bf4-1db0-48fe-87f3-9cbd30daa7db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:22.522276 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17a122e-237d-4de4-afca-15b0761d6270 service cinder] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:22.523767 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09203bf4-1db0-48fe-87f3-9cbd30daa7db service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:22.534136 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 988/1964] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:50:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 14:50:22.534270 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 976/1964] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:50:22 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:50:22.974016 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09203bf4-1db0-48fe-87f3-9cbd30daa7db service neutron] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:22.976734 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-09203bf4-1db0-48fe-87f3-9cbd30daa7db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:23.006767 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09203bf4-1db0-48fe-87f3-9cbd30daa7db service neutron] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:23.014071 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb53e32-a88e-4f79-affd-475c78f3357d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:23.014995 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb53e32-a88e-4f79-affd-475c78f3357d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:23.015298 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb53e32-a88e-4f79-affd-475c78f3357d admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:23.015565 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb53e32-a88e-4f79-affd-475c78f3357d admin admin] PATH_INFO: `/v3/projects/b740d38e903a4d1cb8fc3ad45c48088e` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:23.016773 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb53e32-a88e-4f79-affd-475c78f3357d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b740d38e903a4d1cb8fc3ad45c48088e)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:23.021355 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb53e32-a88e-4f79-affd-475c78f3357d admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:23.141758 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-5cb53e32-a88e-4f79-affd-475c78f3357d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b740d38e903a4d1cb8fc3ad45c48088e', 'request_id': 'req-5cb53e32-a88e-4f79-affd-475c78f3357d'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:23.249206 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-5cb53e32-a88e-4f79-affd-475c78f3357d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b740d38e903a4d1cb8fc3ad45c48088e', 'request_id': 'req-5cb53e32-a88e-4f79-affd-475c78f3357d'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:23.268839 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-5cb53e32-a88e-4f79-affd-475c78f3357d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b740d38e903a4d1cb8fc3ad45c48088e', 'request_id': 'req-5cb53e32-a88e-4f79-affd-475c78f3357d'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:23.282862 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-5cb53e32-a88e-4f79-affd-475c78f3357d admin admin] The token cache is being invalidate because project b740d38e903a4d1cb8fc3ad45c48088e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80503) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 14:50:23.283207 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-5cb53e32-a88e-4f79-affd-475c78f3357d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:23.283869 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-5cb53e32-a88e-4f79-affd-475c78f3357d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:23.288984 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 989/1965] 10.222.0.15 () {58 vars in 1232 bytes} [Tue May 31 14:50:22 2022] DELETE /identity/v3/projects/b740d38e903a4d1cb8fc3ad45c48088e => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:50:23.290045 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17a122e-237d-4de4-afca-15b0761d6270 service cinder] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:23.301754 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17a122e-237d-4de4-afca-15b0761d6270 service cinder] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:23.340131 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:23.370955 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e238536-630b-473d-8fc7-9ccb88e9f0fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:23.372008 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e238536-630b-473d-8fc7-9ccb88e9f0fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:23.372875 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e238536-630b-473d-8fc7-9ccb88e9f0fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:23.373220 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e238536-630b-473d-8fc7-9ccb88e9f0fc admin admin] PATH_INFO: `/v3/users/6ed9804778484ed6a756125195f64be2` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:23.374476 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e238536-630b-473d-8fc7-9ccb88e9f0fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ed9804778484ed6a756125195f64be2)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:23.376436 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e238536-630b-473d-8fc7-9ccb88e9f0fc admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:23.599268 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-7e238536-630b-473d-8fc7-9ccb88e9f0fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ed9804778484ed6a756125195f64be2'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:23.606073 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-7e238536-630b-473d-8fc7-9ccb88e9f0fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ed9804778484ed6a756125195f64be2'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:23.610974 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-7e238536-630b-473d-8fc7-9ccb88e9f0fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ed9804778484ed6a756125195f64be2'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:23.610974 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-7e238536-630b-473d-8fc7-9ccb88e9f0fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ed9804778484ed6a756125195f64be2'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:23.620576 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-7e238536-630b-473d-8fc7-9ccb88e9f0fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ed9804778484ed6a756125195f64be2'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:23.693853 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 977/1966] 10.222.0.15 () {58 vars in 1223 bytes} [Tue May 31 14:50:23 2022] DELETE /identity/v3/users/6ed9804778484ed6a756125195f64be2 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 14:50:24.139149 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb53e32-a88e-4f79-affd-475c78f3357d admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:24.140561 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-5cb53e32-a88e-4f79-affd-475c78f3357d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:24.152789 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e238536-630b-473d-8fc7-9ccb88e9f0fc admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:24.154357 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-7e238536-630b-473d-8fc7-9ccb88e9f0fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:24.156693 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb53e32-a88e-4f79-affd-475c78f3357d admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:24.217385 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:24.222953 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e238536-630b-473d-8fc7-9ccb88e9f0fc admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:24.224561 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c68cdc4-1a2e-43c9-af62-9131eea9798f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:24.225474 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c68cdc4-1a2e-43c9-af62-9131eea9798f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:24.225755 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c68cdc4-1a2e-43c9-af62-9131eea9798f admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:24.242203 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c68cdc4-1a2e-43c9-af62-9131eea9798f admin admin] PATH_INFO: `/v3/users/60585bf4907143839fdca05fb56f7f96` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:24.242203 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c68cdc4-1a2e-43c9-af62-9131eea9798f admin admin] RBAC: Authorizing `identity:delete_user(user_id=60585bf4907143839fdca05fb56f7f96)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:24.242628 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175640b9-7a62-49e4-bc9d-0e79e73f82b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:24.242628 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175640b9-7a62-49e4-bc9d-0e79e73f82b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:24.242628 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175640b9-7a62-49e4-bc9d-0e79e73f82b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:24.242628 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175640b9-7a62-49e4-bc9d-0e79e73f82b1 admin admin] PATH_INFO: `/v3/projects/085ba67b2fdb458a986ad344fb92a365` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:24.242986 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c68cdc4-1a2e-43c9-af62-9131eea9798f admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:24.243077 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175640b9-7a62-49e4-bc9d-0e79e73f82b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=085ba67b2fdb458a986ad344fb92a365)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:24.243077 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175640b9-7a62-49e4-bc9d-0e79e73f82b1 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:24.448514 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-175640b9-7a62-49e4-bc9d-0e79e73f82b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '085ba67b2fdb458a986ad344fb92a365', 'request_id': 'req-175640b9-7a62-49e4-bc9d-0e79e73f82b1'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:24.451346 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-2c68cdc4-1a2e-43c9-af62-9131eea9798f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60585bf4907143839fdca05fb56f7f96'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:24.458347 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-175640b9-7a62-49e4-bc9d-0e79e73f82b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '085ba67b2fdb458a986ad344fb92a365', 'request_id': 'req-175640b9-7a62-49e4-bc9d-0e79e73f82b1'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:24.461752 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:24.527889 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-2c68cdc4-1a2e-43c9-af62-9131eea9798f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60585bf4907143839fdca05fb56f7f96'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:24.528631 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-2c68cdc4-1a2e-43c9-af62-9131eea9798f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60585bf4907143839fdca05fb56f7f96'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:24.536740 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-2c68cdc4-1a2e-43c9-af62-9131eea9798f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60585bf4907143839fdca05fb56f7f96'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:24.537429 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-2c68cdc4-1a2e-43c9-af62-9131eea9798f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60585bf4907143839fdca05fb56f7f96'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:24.556173 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 990/1967] 10.222.0.15 () {58 vars in 1223 bytes} [Tue May 31 14:50:24 2022] DELETE /identity/v3/users/60585bf4907143839fdca05fb56f7f96 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:50:24.561115 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53337304-81dd-4eb8-a8a0-e5a3b04ed763 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:24.561470 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53337304-81dd-4eb8-a8a0-e5a3b04ed763 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:24.561753 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53337304-81dd-4eb8-a8a0-e5a3b04ed763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:24.580530 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-53337304-81dd-4eb8-a8a0-e5a3b04ed763 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:50:24.582067 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-53337304-81dd-4eb8-a8a0-e5a3b04ed763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:24.591209 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-175640b9-7a62-49e4-bc9d-0e79e73f82b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '085ba67b2fdb458a986ad344fb92a365', 'request_id': 'req-175640b9-7a62-49e4-bc9d-0e79e73f82b1'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:24.602603 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-175640b9-7a62-49e4-bc9d-0e79e73f82b1 admin admin] The token cache is being invalidate because project 085ba67b2fdb458a986ad344fb92a365 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 14:50:24.602903 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-175640b9-7a62-49e4-bc9d-0e79e73f82b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:24.606014 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-175640b9-7a62-49e4-bc9d-0e79e73f82b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:24.606014 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 978/1968] 10.222.0.15 () {58 vars in 1232 bytes} [Tue May 31 14:50:24 2022] DELETE /identity/v3/projects/085ba67b2fdb458a986ad344fb92a365 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 14:50:24.612496 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175640b9-7a62-49e4-bc9d-0e79e73f82b1 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:24.614037 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-175640b9-7a62-49e4-bc9d-0e79e73f82b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:24.656923 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 991/1969] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:50:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 14:50:24.666728 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53337304-81dd-4eb8-a8a0-e5a3b04ed763 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:24.668528 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-53337304-81dd-4eb8-a8a0-e5a3b04ed763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:24.709132 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175640b9-7a62-49e4-bc9d-0e79e73f82b1 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:24.715246 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712974cf-fbc4-460b-b1a7-f229ddc4e0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:24.716326 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712974cf-fbc4-460b-b1a7-f229ddc4e0f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:24.716791 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712974cf-fbc4-460b-b1a7-f229ddc4e0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:24.717331 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712974cf-fbc4-460b-b1a7-f229ddc4e0f3 admin admin] PATH_INFO: `/v3/users/6d84866a104b4b5fb1744a493c0948fc` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:24.718542 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712974cf-fbc4-460b-b1a7-f229ddc4e0f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d84866a104b4b5fb1744a493c0948fc)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:24.720815 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712974cf-fbc4-460b-b1a7-f229ddc4e0f3 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:24.749379 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53337304-81dd-4eb8-a8a0-e5a3b04ed763 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:24.753254 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f05d464-5ab1-4c54-a39c-2de2fcddb4a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:24.753899 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f05d464-5ab1-4c54-a39c-2de2fcddb4a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:24.754185 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f05d464-5ab1-4c54-a39c-2de2fcddb4a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:24.754467 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f05d464-5ab1-4c54-a39c-2de2fcddb4a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:24.763509 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f05d464-5ab1-4c54-a39c-2de2fcddb4a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:24.766135 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f05d464-5ab1-4c54-a39c-2de2fcddb4a6 service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:24.774211 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 992/1970] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:50:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 14:50:24.920720 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-712974cf-fbc4-460b-b1a7-f229ddc4e0f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d84866a104b4b5fb1744a493c0948fc'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:24.928033 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-712974cf-fbc4-460b-b1a7-f229ddc4e0f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d84866a104b4b5fb1744a493c0948fc'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:24.928694 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-712974cf-fbc4-460b-b1a7-f229ddc4e0f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d84866a104b4b5fb1744a493c0948fc'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:24.929395 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-712974cf-fbc4-460b-b1a7-f229ddc4e0f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d84866a104b4b5fb1744a493c0948fc'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:24.943781 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-712974cf-fbc4-460b-b1a7-f229ddc4e0f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d84866a104b4b5fb1744a493c0948fc'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:25.031945 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 979/1971] 10.222.0.15 () {58 vars in 1223 bytes} [Tue May 31 14:50:24 2022] DELETE /identity/v3/users/6d84866a104b4b5fb1744a493c0948fc => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 14:50:25.203964 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f05d464-5ab1-4c54-a39c-2de2fcddb4a6 service neutron] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:25.205520 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-4f05d464-5ab1-4c54-a39c-2de2fcddb4a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:25.226835 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f05d464-5ab1-4c54-a39c-2de2fcddb4a6 service neutron] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:25.255490 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:25.305380 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50cda57-c53c-4034-82fa-419aa3fdac1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:25.306584 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50cda57-c53c-4034-82fa-419aa3fdac1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:25.306999 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50cda57-c53c-4034-82fa-419aa3fdac1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:25.307297 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50cda57-c53c-4034-82fa-419aa3fdac1b admin admin] PATH_INFO: `/v3/projects/bc764f1a911c483d870231276f21537c` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:25.308506 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50cda57-c53c-4034-82fa-419aa3fdac1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc764f1a911c483d870231276f21537c)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:25.311206 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50cda57-c53c-4034-82fa-419aa3fdac1b admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:25.463716 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-a50cda57-c53c-4034-82fa-419aa3fdac1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc764f1a911c483d870231276f21537c', 'request_id': 'req-a50cda57-c53c-4034-82fa-419aa3fdac1b'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:25.479066 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712974cf-fbc4-460b-b1a7-f229ddc4e0f3 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:25.480744 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-712974cf-fbc4-460b-b1a7-f229ddc4e0f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:25.496463 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712974cf-fbc4-460b-b1a7-f229ddc4e0f3 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:25.550858 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-a50cda57-c53c-4034-82fa-419aa3fdac1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc764f1a911c483d870231276f21537c', 'request_id': 'req-a50cda57-c53c-4034-82fa-419aa3fdac1b'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:25.559225 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-a50cda57-c53c-4034-82fa-419aa3fdac1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc764f1a911c483d870231276f21537c', 'request_id': 'req-a50cda57-c53c-4034-82fa-419aa3fdac1b'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:25.569145 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84a79eb-3384-496a-9719-6b08b14378c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:25.570016 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84a79eb-3384-496a-9719-6b08b14378c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:25.570297 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84a79eb-3384-496a-9719-6b08b14378c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:25.570613 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84a79eb-3384-496a-9719-6b08b14378c4 admin admin] PATH_INFO: `/v3/projects/48f5e7270b7f494aa9d09be75816517a` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:25.571984 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84a79eb-3384-496a-9719-6b08b14378c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48f5e7270b7f494aa9d09be75816517a)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:25.573637 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-a50cda57-c53c-4034-82fa-419aa3fdac1b admin admin] The token cache is being invalidate because project bc764f1a911c483d870231276f21537c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80503) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 14:50:25.573830 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-a50cda57-c53c-4034-82fa-419aa3fdac1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:25.573923 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84a79eb-3384-496a-9719-6b08b14378c4 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:25.574585 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-a50cda57-c53c-4034-82fa-419aa3fdac1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:25.576300 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 993/1972] 10.222.0.15 () {58 vars in 1232 bytes} [Tue May 31 14:50:25 2022] DELETE /identity/v3/projects/bc764f1a911c483d870231276f21537c => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:50:25.581003 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50cda57-c53c-4034-82fa-419aa3fdac1b admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:25.582710 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-a50cda57-c53c-4034-82fa-419aa3fdac1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:25.583350 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:25.598772 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50cda57-c53c-4034-82fa-419aa3fdac1b admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:25.604511 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d782cd-c140-4bbf-be29-ed264e97c0db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:25.605416 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d782cd-c140-4bbf-be29-ed264e97c0db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:25.605704 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d782cd-c140-4bbf-be29-ed264e97c0db admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:25.606024 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d782cd-c140-4bbf-be29-ed264e97c0db admin admin] PATH_INFO: `/v3/users/a7272a5a0abf4fcb9d721692f748f0cd` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:25.607933 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d782cd-c140-4bbf-be29-ed264e97c0db admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7272a5a0abf4fcb9d721692f748f0cd)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:25.610043 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d782cd-c140-4bbf-be29-ed264e97c0db admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:25.706458 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-f84a79eb-3384-496a-9719-6b08b14378c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48f5e7270b7f494aa9d09be75816517a', 'request_id': 'req-f84a79eb-3384-496a-9719-6b08b14378c4'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:25.712520 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-f84a79eb-3384-496a-9719-6b08b14378c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48f5e7270b7f494aa9d09be75816517a', 'request_id': 'req-f84a79eb-3384-496a-9719-6b08b14378c4'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:25.779600 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-f84a79eb-3384-496a-9719-6b08b14378c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48f5e7270b7f494aa9d09be75816517a', 'request_id': 'req-f84a79eb-3384-496a-9719-6b08b14378c4'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:25.791588 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-f84a79eb-3384-496a-9719-6b08b14378c4 admin admin] The token cache is being invalidate because project 48f5e7270b7f494aa9d09be75816517a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 14:50:25.791926 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-f84a79eb-3384-496a-9719-6b08b14378c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:25.793035 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-f84a79eb-3384-496a-9719-6b08b14378c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:25.795336 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 980/1973] 10.222.0.15 () {58 vars in 1232 bytes} [Tue May 31 14:50:25 2022] DELETE /identity/v3/projects/48f5e7270b7f494aa9d09be75816517a => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:50:25.802890 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2395cd7a-eb81-4c5f-8df0-fcc911deec12 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:25.803179 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2395cd7a-eb81-4c5f-8df0-fcc911deec12 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:25.803477 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2395cd7a-eb81-4c5f-8df0-fcc911deec12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:25.821158 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-2395cd7a-eb81-4c5f-8df0-fcc911deec12 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:50:25.822373 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-2395cd7a-eb81-4c5f-8df0-fcc911deec12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:25.883759 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 981/1974] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:50:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 14:50:25.904166 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccc196c-473c-4ca0-8e8b-53bacc6d9169 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:25.904166 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccc196c-473c-4ca0-8e8b-53bacc6d9169 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:25.904166 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccc196c-473c-4ca0-8e8b-53bacc6d9169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:25.914528 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-bccc196c-473c-4ca0-8e8b-53bacc6d9169 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:50:25.916281 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-bccc196c-473c-4ca0-8e8b-53bacc6d9169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:25.929299 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 982/1975] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:50:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 14:50:25.929299 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccc196c-473c-4ca0-8e8b-53bacc6d9169 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:25.929299 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-bccc196c-473c-4ca0-8e8b-53bacc6d9169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:25.944647 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-d3d782cd-c140-4bbf-be29-ed264e97c0db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7272a5a0abf4fcb9d721692f748f0cd'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:25.991698 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccc196c-473c-4ca0-8e8b-53bacc6d9169 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:25.995617 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d114926-c2d5-4ad8-afc2-caf64d12963c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afbf718dcd9b4741a926b0a2321bd53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:25.996299 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d114926-c2d5-4ad8-afc2-caf64d12963c service cinder] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:25.996586 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d114926-c2d5-4ad8-afc2-caf64d12963c service cinder] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:25.996869 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d114926-c2d5-4ad8-afc2-caf64d12963c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:25.998827 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-7d114926-c2d5-4ad8-afc2-caf64d12963c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:26.031932 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-d3d782cd-c140-4bbf-be29-ed264e97c0db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7272a5a0abf4fcb9d721692f748f0cd'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:26.032687 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-d3d782cd-c140-4bbf-be29-ed264e97c0db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7272a5a0abf4fcb9d721692f748f0cd'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:26.041573 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-d3d782cd-c140-4bbf-be29-ed264e97c0db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7272a5a0abf4fcb9d721692f748f0cd'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:26.042371 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-d3d782cd-c140-4bbf-be29-ed264e97c0db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7272a5a0abf4fcb9d721692f748f0cd'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:26.062002 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 994/1976] 10.222.0.15 () {58 vars in 1223 bytes} [Tue May 31 14:50:25 2022] DELETE /identity/v3/users/a7272a5a0abf4fcb9d721692f748f0cd => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 14:50:26.063050 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d782cd-c140-4bbf-be29-ed264e97c0db admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:26.064457 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-d3d782cd-c140-4bbf-be29-ed264e97c0db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:26.071278 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d114926-c2d5-4ad8-afc2-caf64d12963c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:26.072744 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d114926-c2d5-4ad8-afc2-caf64d12963c service cinder] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:26.084417 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 983/1977] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:50:25 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:50:26.128304 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:26.136249 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:26.174824 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d782cd-c140-4bbf-be29-ed264e97c0db admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:26.179445 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1a546e-dbd4-486c-a9eb-1444c19c4974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:26.180106 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1a546e-dbd4-486c-a9eb-1444c19c4974 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:26.185978 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1a546e-dbd4-486c-a9eb-1444c19c4974 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:26.185978 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1a546e-dbd4-486c-a9eb-1444c19c4974 admin admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:26.185978 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1a546e-dbd4-486c-a9eb-1444c19c4974 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:50:26.185978 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1a546e-dbd4-486c-a9eb-1444c19c4974 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:26.185978 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1a546e-dbd4-486c-a9eb-1444c19c4974 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:26.194617 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 995/1978] 10.222.0.15 () {58 vars in 1152 bytes} [Tue May 31 14:50:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:50:26.199099 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d114926-c2d5-4ad8-afc2-caf64d12963c service cinder] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:26.211514 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d114926-c2d5-4ad8-afc2-caf64d12963c service cinder] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:26.216796 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b0f7da-fda8-4838-b31d-541cbe25dafb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:26.217463 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b0f7da-fda8-4838-b31d-541cbe25dafb admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:26.217755 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b0f7da-fda8-4838-b31d-541cbe25dafb admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:26.218041 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b0f7da-fda8-4838-b31d-541cbe25dafb admin admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:26.218780 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b0f7da-fda8-4838-b31d-541cbe25dafb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:26.221417 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b0f7da-fda8-4838-b31d-541cbe25dafb admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:26.342755 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 984/1979] 10.222.0.15 () {60 vars in 1152 bytes} [Tue May 31 14:50:26 2022] POST /identity/v3/projects => generated 371 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:50:26.346411 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1a546e-dbd4-486c-a9eb-1444c19c4974 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:26.356506 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1a546e-dbd4-486c-a9eb-1444c19c4974 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:26.424075 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc5ac24-3390-4702-8101-a584d843c21a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:26.436296 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc5ac24-3390-4702-8101-a584d843c21a admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:26.436296 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc5ac24-3390-4702-8101-a584d843c21a admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:26.436296 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc5ac24-3390-4702-8101-a584d843c21a admin admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:26.436296 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc5ac24-3390-4702-8101-a584d843c21a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:26.436928 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc5ac24-3390-4702-8101-a584d843c21a admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:26.560264 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 996/1980] 10.222.0.15 () {60 vars in 1143 bytes} [Tue May 31 14:50:26 2022] POST /identity/v3/users => generated 286 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:50:26.560445 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b0f7da-fda8-4838-b31d-541cbe25dafb admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:26.563429 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-a1b0f7da-fda8-4838-b31d-541cbe25dafb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:26.566451 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc5ac24-3390-4702-8101-a584d843c21a admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:26.586931 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b0f7da-fda8-4838-b31d-541cbe25dafb admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:26.587801 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc5ac24-3390-4702-8101-a584d843c21a admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:26.594094 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06010c78-e394-4188-8d42-679c36929c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:26.594956 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06010c78-e394-4188-8d42-679c36929c59 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:26.597359 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06010c78-e394-4188-8d42-679c36929c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:26.597713 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f3416f-80b6-438a-a3ef-e4ee1071f732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:26.597818 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06010c78-e394-4188-8d42-679c36929c59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:26.597818 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06010c78-e394-4188-8d42-679c36929c59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:26.598003 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f3416f-80b6-438a-a3ef-e4ee1071f732 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:26.598003 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f3416f-80b6-438a-a3ef-e4ee1071f732 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:26.598003 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f3416f-80b6-438a-a3ef-e4ee1071f732 admin admin] PATH_INFO: `/v3/projects/fad51516904646ecac05c5519341d827` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:26.598200 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06010c78-e394-4188-8d42-679c36929c59 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:26.598998 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f3416f-80b6-438a-a3ef-e4ee1071f732 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fad51516904646ecac05c5519341d827)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:26.601084 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f3416f-80b6-438a-a3ef-e4ee1071f732 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:26.609624 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 997/1981] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:50:26 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:50:26.614844 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06010c78-e394-4188-8d42-679c36929c59 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:26.626882 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06010c78-e394-4188-8d42-679c36929c59 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:26.632026 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6778ea4-9c27-40d9-8b55-3e44436e9469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:26.632697 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6778ea4-9c27-40d9-8b55-3e44436e9469 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:26.632991 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6778ea4-9c27-40d9-8b55-3e44436e9469 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:26.633277 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6778ea4-9c27-40d9-8b55-3e44436e9469 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:26.634015 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6778ea4-9c27-40d9-8b55-3e44436e9469 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:26.635752 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6778ea4-9c27-40d9-8b55-3e44436e9469 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:26.649676 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 998/1982] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:50:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:50:26.651237 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6778ea4-9c27-40d9-8b55-3e44436e9469 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:26.663717 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6778ea4-9c27-40d9-8b55-3e44436e9469 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:26.668914 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b146d857-bddc-494f-a807-ac48dfaa1dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:26.670525 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b146d857-bddc-494f-a807-ac48dfaa1dec admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:26.670894 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b146d857-bddc-494f-a807-ac48dfaa1dec admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:26.672258 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b146d857-bddc-494f-a807-ac48dfaa1dec admin admin] PATH_INFO: `/v3/projects/77d9d8a2f0cb447d80381ba887072aeb/users/3412b3e57aae4b9380ca0b42250c9f6d/roles/317f725e26bf43648d8235bb1f7c4cb3` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:26.686630 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b146d857-bddc-494f-a807-ac48dfaa1dec admin admin] RBAC: Authorizing `identity:create_grant(project_id=77d9d8a2f0cb447d80381ba887072aeb, user_id=3412b3e57aae4b9380ca0b42250c9f6d, role_id=317f725e26bf43648d8235bb1f7c4cb3)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:26.689415 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b146d857-bddc-494f-a807-ac48dfaa1dec admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:26.803481 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 999/1983] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:50:26 2022] PUT /identity/v3/projects/77d9d8a2f0cb447d80381ba887072aeb/users/3412b3e57aae4b9380ca0b42250c9f6d/roles/317f725e26bf43648d8235bb1f7c4cb3 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:50:26.817978 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-90f3416f-80b6-438a-a3ef-e4ee1071f732 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fad51516904646ecac05c5519341d827', 'request_id': 'req-90f3416f-80b6-438a-a3ef-e4ee1071f732'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:26.819794 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-90f3416f-80b6-438a-a3ef-e4ee1071f732 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fad51516904646ecac05c5519341d827', 'request_id': 'req-90f3416f-80b6-438a-a3ef-e4ee1071f732'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:26.820013 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b64f08-4354-42be-975d-44f8434b35aa None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:26.820397 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b64f08-4354-42be-975d-44f8434b35aa None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:26.820753 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b64f08-4354-42be-975d-44f8434b35aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:26.847920 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-12b64f08-4354-42be-975d-44f8434b35aa None None] MFA Rules not processed for user `3412b3e57aae4b9380ca0b42250c9f6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:50:26.849140 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-12b64f08-4354-42be-975d-44f8434b35aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:26.893285 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-90f3416f-80b6-438a-a3ef-e4ee1071f732 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fad51516904646ecac05c5519341d827', 'request_id': 'req-90f3416f-80b6-438a-a3ef-e4ee1071f732'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:26.897584 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:26.919735 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-90f3416f-80b6-438a-a3ef-e4ee1071f732 admin admin] The token cache is being invalidate because project fad51516904646ecac05c5519341d827 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 14:50:26.920207 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-90f3416f-80b6-438a-a3ef-e4ee1071f732 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:26.920872 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1000/1984] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:50:26 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 14:50:26.921324 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-90f3416f-80b6-438a-a3ef-e4ee1071f732 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:26.923593 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 985/1985] 10.222.0.15 () {58 vars in 1232 bytes} [Tue May 31 14:50:26 2022] DELETE /identity/v3/projects/fad51516904646ecac05c5519341d827 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 14:50:26.928397 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0137cb5a-afdf-4c62-981a-802823610838 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:26.928692 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0137cb5a-afdf-4c62-981a-802823610838 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:26.928969 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0137cb5a-afdf-4c62-981a-802823610838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:26.934390 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f3416f-80b6-438a-a3ef-e4ee1071f732 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:26.936024 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-90f3416f-80b6-438a-a3ef-e4ee1071f732 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:26.952233 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-0137cb5a-afdf-4c62-981a-802823610838 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:50:26.952233 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-0137cb5a-afdf-4c62-981a-802823610838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:27.003768 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f3416f-80b6-438a-a3ef-e4ee1071f732 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:27.008430 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743a269b-c64b-4f11-b986-bd93817fce0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afbf718dcd9b4741a926b0a2321bd53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:27.008430 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a269b-c64b-4f11-b986-bd93817fce0e service cinder] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:27.008661 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a269b-c64b-4f11-b986-bd93817fce0e service cinder] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:27.008782 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a269b-c64b-4f11-b986-bd93817fce0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:27.010722 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-743a269b-c64b-4f11-b986-bd93817fce0e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:27.021309 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1001/1986] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:50:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:50:27.024143 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743a269b-c64b-4f11-b986-bd93817fce0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:27.025622 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743a269b-c64b-4f11-b986-bd93817fce0e service cinder] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:27.030703 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a17d66-ebf5-4bcf-beab-8382fe4872a0 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:27.031247 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a17d66-ebf5-4bcf-beab-8382fe4872a0 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:27.031429 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a17d66-ebf5-4bcf-beab-8382fe4872a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:27.039983 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 986/1987] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:50:26 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 14:50:27.058416 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-98a17d66-ebf5-4bcf-beab-8382fe4872a0 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:50:27.060437 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-98a17d66-ebf5-4bcf-beab-8382fe4872a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:27.068190 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743a269b-c64b-4f11-b986-bd93817fce0e service cinder] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:27.071720 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-743a269b-c64b-4f11-b986-bd93817fce0e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:27.074663 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1002/1988] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:50:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:50:27.077037 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a17d66-ebf5-4bcf-beab-8382fe4872a0 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:27.086676 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a17d66-ebf5-4bcf-beab-8382fe4872a0 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:27.091314 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da673d23-268e-4869-926c-c1c802a417b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:27.091524 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743a269b-c64b-4f11-b986-bd93817fce0e service cinder] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:27.091980 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da673d23-268e-4869-926c-c1c802a417b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:27.092270 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da673d23-268e-4869-926c-c1c802a417b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:27.092551 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da673d23-268e-4869-926c-c1c802a417b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:27.093317 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da673d23-268e-4869-926c-c1c802a417b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:50:27.093614 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da673d23-268e-4869-926c-c1c802a417b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:27.095470 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da673d23-268e-4869-926c-c1c802a417b0 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:27.096539 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782d9b45-3a2e-434f-b800-a9af85fac91b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:27.097858 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782d9b45-3a2e-434f-b800-a9af85fac91b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:27.097858 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782d9b45-3a2e-434f-b800-a9af85fac91b admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:27.100836 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782d9b45-3a2e-434f-b800-a9af85fac91b admin admin] PATH_INFO: `/v3/users/3412b3e57aae4b9380ca0b42250c9f6d` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:27.100836 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782d9b45-3a2e-434f-b800-a9af85fac91b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3412b3e57aae4b9380ca0b42250c9f6d)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:27.101945 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782d9b45-3a2e-434f-b800-a9af85fac91b admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:27.108256 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1003/1989] 10.222.0.15 () {58 vars in 1152 bytes} [Tue May 31 14:50:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 14:50:27.112464 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da673d23-268e-4869-926c-c1c802a417b0 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:27.129584 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da673d23-268e-4869-926c-c1c802a417b0 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:27.133881 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfdc75e-fd38-4261-996c-e12099aafef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:27.134433 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfdc75e-fd38-4261-996c-e12099aafef0 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:27.134756 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfdc75e-fd38-4261-996c-e12099aafef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:27.135038 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfdc75e-fd38-4261-996c-e12099aafef0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:27.135765 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfdc75e-fd38-4261-996c-e12099aafef0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:27.137680 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfdc75e-fd38-4261-996c-e12099aafef0 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:27.233107 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1004/1990] 10.222.0.15 () {60 vars in 1152 bytes} [Tue May 31 14:50:27 2022] POST /identity/v3/projects => generated 379 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 14:50:27.236872 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfdc75e-fd38-4261-996c-e12099aafef0 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:27.260845 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:27.268375 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-782d9b45-3a2e-434f-b800-a9af85fac91b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3412b3e57aae4b9380ca0b42250c9f6d'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:27.275407 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-782d9b45-3a2e-434f-b800-a9af85fac91b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3412b3e57aae4b9380ca0b42250c9f6d'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:27.276255 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-782d9b45-3a2e-434f-b800-a9af85fac91b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3412b3e57aae4b9380ca0b42250c9f6d'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:27.277188 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-782d9b45-3a2e-434f-b800-a9af85fac91b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3412b3e57aae4b9380ca0b42250c9f6d'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:27.289003 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-782d9b45-3a2e-434f-b800-a9af85fac91b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3412b3e57aae4b9380ca0b42250c9f6d'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:27.318668 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfdc75e-fd38-4261-996c-e12099aafef0 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:27.323423 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31675c98-5115-4da0-adfb-363a5cb69726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:27.324097 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31675c98-5115-4da0-adfb-363a5cb69726 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:27.324385 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31675c98-5115-4da0-adfb-363a5cb69726 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:27.324665 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31675c98-5115-4da0-adfb-363a5cb69726 admin admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:27.325354 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31675c98-5115-4da0-adfb-363a5cb69726 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:27.328629 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31675c98-5115-4da0-adfb-363a5cb69726 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:27.373828 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 987/1991] 10.222.0.15 () {58 vars in 1223 bytes} [Tue May 31 14:50:27 2022] DELETE /identity/v3/users/3412b3e57aae4b9380ca0b42250c9f6d => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:50:27.378287 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2475a3-956a-4ebc-ba3e-e2ad472b8d54 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:27.378673 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2475a3-956a-4ebc-ba3e-e2ad472b8d54 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:27.378987 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2475a3-956a-4ebc-ba3e-e2ad472b8d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:27.397189 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-df2475a3-956a-4ebc-ba3e-e2ad472b8d54 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:50:27.406579 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-df2475a3-956a-4ebc-ba3e-e2ad472b8d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:27.406707 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1005/1992] 10.222.0.15 () {60 vars in 1143 bytes} [Tue May 31 14:50:27 2022] POST /identity/v3/users => generated 290 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 14:50:27.407573 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31675c98-5115-4da0-adfb-363a5cb69726 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:27.409344 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-31675c98-5115-4da0-adfb-363a5cb69726 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:27.422236 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31675c98-5115-4da0-adfb-363a5cb69726 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:27.457413 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:27.460434 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 988/1993] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:50:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 14:50:27.471339 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2475a3-956a-4ebc-ba3e-e2ad472b8d54 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:27.473183 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-df2475a3-956a-4ebc-ba3e-e2ad472b8d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:27.481865 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd4b91b-6722-4c1f-bfa4-b16eab7ac9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:27.482542 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd4b91b-6722-4c1f-bfa4-b16eab7ac9e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:27.482861 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd4b91b-6722-4c1f-bfa4-b16eab7ac9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:27.483139 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd4b91b-6722-4c1f-bfa4-b16eab7ac9e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:27.483863 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd4b91b-6722-4c1f-bfa4-b16eab7ac9e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:27.485510 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd4b91b-6722-4c1f-bfa4-b16eab7ac9e9 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:27.498719 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1006/1994] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:50:27 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:50:27.501942 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd4b91b-6722-4c1f-bfa4-b16eab7ac9e9 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:27.514433 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd4b91b-6722-4c1f-bfa4-b16eab7ac9e9 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:27.517688 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b18757d-1a7c-4f4a-93c6-48347db99f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:27.518441 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b18757d-1a7c-4f4a-93c6-48347db99f47 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:27.518764 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b18757d-1a7c-4f4a-93c6-48347db99f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:27.519092 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b18757d-1a7c-4f4a-93c6-48347db99f47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:27.520030 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b18757d-1a7c-4f4a-93c6-48347db99f47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:27.521612 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b18757d-1a7c-4f4a-93c6-48347db99f47 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:27.533025 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1007/1995] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:50:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:50:27.537753 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b18757d-1a7c-4f4a-93c6-48347db99f47 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:27.539432 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2475a3-956a-4ebc-ba3e-e2ad472b8d54 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:27.544089 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895001d6-b6ef-4512-8b24-69ee5b57cd1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:27.544780 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895001d6-b6ef-4512-8b24-69ee5b57cd1b service neutron] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:27.545062 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895001d6-b6ef-4512-8b24-69ee5b57cd1b service neutron] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:27.545336 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895001d6-b6ef-4512-8b24-69ee5b57cd1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:27.549959 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b18757d-1a7c-4f4a-93c6-48347db99f47 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:27.554807 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aab73e-0aa3-47a3-b363-d93f874f1fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:27.555281 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895001d6-b6ef-4512-8b24-69ee5b57cd1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:27.555705 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aab73e-0aa3-47a3-b363-d93f874f1fab admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:27.555988 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aab73e-0aa3-47a3-b363-d93f874f1fab admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:27.556267 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aab73e-0aa3-47a3-b363-d93f874f1fab admin admin] PATH_INFO: `/v3/projects/879c190dc7724153ba2299871e3decc6/users/28e35b75d69942f6881eda2319040ae6/roles/317f725e26bf43648d8235bb1f7c4cb3` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:27.556711 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895001d6-b6ef-4512-8b24-69ee5b57cd1b service neutron] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:27.566355 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 989/1996] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:50:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 14:50:27.567110 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895001d6-b6ef-4512-8b24-69ee5b57cd1b service neutron] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:27.568292 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-895001d6-b6ef-4512-8b24-69ee5b57cd1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:27.571323 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aab73e-0aa3-47a3-b363-d93f874f1fab admin admin] RBAC: Authorizing `identity:create_grant(project_id=879c190dc7724153ba2299871e3decc6, user_id=28e35b75d69942f6881eda2319040ae6, role_id=317f725e26bf43648d8235bb1f7c4cb3)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:27.574194 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aab73e-0aa3-47a3-b363-d93f874f1fab admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:27.581214 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895001d6-b6ef-4512-8b24-69ee5b57cd1b service neutron] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:27.586020 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0ec4cc-df23-40da-8de8-bcf6da3f95e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:27.587041 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0ec4cc-df23-40da-8de8-bcf6da3f95e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:27.587261 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0ec4cc-df23-40da-8de8-bcf6da3f95e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:27.589160 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0ec4cc-df23-40da-8de8-bcf6da3f95e2 admin admin] PATH_INFO: `/v3/users/ca31d36307e24f46aaead708c60f22a9` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:27.589160 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0ec4cc-df23-40da-8de8-bcf6da3f95e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca31d36307e24f46aaead708c60f22a9)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:27.590750 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0ec4cc-df23-40da-8de8-bcf6da3f95e2 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:27.665753 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1008/1997] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:50:27 2022] PUT /identity/v3/projects/879c190dc7724153ba2299871e3decc6/users/28e35b75d69942f6881eda2319040ae6/roles/317f725e26bf43648d8235bb1f7c4cb3 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:50:27.676823 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b46e88a-b63c-4f1c-a7e7-9079ab9edc4d None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:27.677115 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b46e88a-b63c-4f1c-a7e7-9079ab9edc4d None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:27.677396 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b46e88a-b63c-4f1c-a7e7-9079ab9edc4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:27.704833 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-5b46e88a-b63c-4f1c-a7e7-9079ab9edc4d None None] MFA Rules not processed for user `28e35b75d69942f6881eda2319040ae6`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:50:27.706068 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-5b46e88a-b63c-4f1c-a7e7-9079ab9edc4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:27.769129 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1009/1998] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:50:27 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 14:50:27.773366 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b46e88a-b63c-4f1c-a7e7-9079ab9edc4d None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:27.843283 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b46e88a-b63c-4f1c-a7e7-9079ab9edc4d None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:27.850334 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5711c3e2-786d-4895-887d-4cd365ee2851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:27.850931 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5711c3e2-786d-4895-887d-4cd365ee2851 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:27.851211 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5711c3e2-786d-4895-887d-4cd365ee2851 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:27.851485 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5711c3e2-786d-4895-887d-4cd365ee2851 admin admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:27.852317 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5711c3e2-786d-4895-887d-4cd365ee2851 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:27.854509 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5711c3e2-786d-4895-887d-4cd365ee2851 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:27.879903 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-3b0ec4cc-df23-40da-8de8-bcf6da3f95e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca31d36307e24f46aaead708c60f22a9'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:27.887319 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-3b0ec4cc-df23-40da-8de8-bcf6da3f95e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca31d36307e24f46aaead708c60f22a9'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:27.888074 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-3b0ec4cc-df23-40da-8de8-bcf6da3f95e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca31d36307e24f46aaead708c60f22a9'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:27.889011 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-3b0ec4cc-df23-40da-8de8-bcf6da3f95e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca31d36307e24f46aaead708c60f22a9'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:27.901350 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-3b0ec4cc-df23-40da-8de8-bcf6da3f95e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca31d36307e24f46aaead708c60f22a9'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:27.928856 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:27.936555 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1010/1999] 10.222.0.15 () {60 vars in 1152 bytes} [Tue May 31 14:50:27 2022] POST /identity/v3/projects => generated 379 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 14:50:27.940541 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5711c3e2-786d-4895-887d-4cd365ee2851 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:27.942401 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-5711c3e2-786d-4895-887d-4cd365ee2851 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:28.010345 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 990/2000] 10.222.0.15 () {58 vars in 1223 bytes} [Tue May 31 14:50:27 2022] DELETE /identity/v3/users/ca31d36307e24f46aaead708c60f22a9 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:50:28.012097 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c30c9ab-1175-49ec-94cd-8110edcf8851 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:28.012396 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c30c9ab-1175-49ec-94cd-8110edcf8851 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:28.012676 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c30c9ab-1175-49ec-94cd-8110edcf8851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:28.019104 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5711c3e2-786d-4895-887d-4cd365ee2851 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:28.034659 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-7c30c9ab-1175-49ec-94cd-8110edcf8851 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:50:28.036948 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-7c30c9ab-1175-49ec-94cd-8110edcf8851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:28.076534 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:28.091542 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad336a0-5537-46ae-b210-cee12f7804c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:28.092325 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad336a0-5537-46ae-b210-cee12f7804c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:28.092897 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad336a0-5537-46ae-b210-cee12f7804c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:28.093028 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad336a0-5537-46ae-b210-cee12f7804c9 admin admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:28.093629 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad336a0-5537-46ae-b210-cee12f7804c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:28.095649 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad336a0-5537-46ae-b210-cee12f7804c9 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:28.106593 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 991/2001] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:50:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 14:50:28.109662 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c30c9ab-1175-49ec-94cd-8110edcf8851 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:28.112319 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-7c30c9ab-1175-49ec-94cd-8110edcf8851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:28.129172 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c30c9ab-1175-49ec-94cd-8110edcf8851 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:28.134478 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f87b35f-6834-49e7-b730-69499719b7f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:28.135391 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f87b35f-6834-49e7-b730-69499719b7f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:28.135706 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f87b35f-6834-49e7-b730-69499719b7f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:28.135956 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f87b35f-6834-49e7-b730-69499719b7f2 admin admin] PATH_INFO: `/v3/projects/77d9d8a2f0cb447d80381ba887072aeb` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:28.142540 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f87b35f-6834-49e7-b730-69499719b7f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77d9d8a2f0cb447d80381ba887072aeb)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:28.142540 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f87b35f-6834-49e7-b730-69499719b7f2 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:28.237606 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1011/2002] 10.222.0.15 () {60 vars in 1143 bytes} [Tue May 31 14:50:27 2022] POST /identity/v3/users => generated 290 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:50:28.238607 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad336a0-5537-46ae-b210-cee12f7804c9 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:28.240174 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-2ad336a0-5537-46ae-b210-cee12f7804c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:28.269555 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-3f87b35f-6834-49e7-b730-69499719b7f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77d9d8a2f0cb447d80381ba887072aeb', 'request_id': 'req-3f87b35f-6834-49e7-b730-69499719b7f2'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:28.276161 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-3f87b35f-6834-49e7-b730-69499719b7f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77d9d8a2f0cb447d80381ba887072aeb', 'request_id': 'req-3f87b35f-6834-49e7-b730-69499719b7f2'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:28.304711 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad336a0-5537-46ae-b210-cee12f7804c9 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:28.333701 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-3f87b35f-6834-49e7-b730-69499719b7f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77d9d8a2f0cb447d80381ba887072aeb', 'request_id': 'req-3f87b35f-6834-49e7-b730-69499719b7f2'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:28.345276 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-3f87b35f-6834-49e7-b730-69499719b7f2 admin admin] The token cache is being invalidate because project 77d9d8a2f0cb447d80381ba887072aeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 14:50:28.345471 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-3f87b35f-6834-49e7-b730-69499719b7f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:28.346268 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-3f87b35f-6834-49e7-b730-69499719b7f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:28.348073 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 992/2003] 10.222.0.15 () {58 vars in 1232 bytes} [Tue May 31 14:50:28 2022] DELETE /identity/v3/projects/77d9d8a2f0cb447d80381ba887072aeb => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 14:50:28.348858 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f87b35f-6834-49e7-b730-69499719b7f2 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:28.350197 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-3f87b35f-6834-49e7-b730-69499719b7f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:28.353050 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d978a7-47be-43ea-9f4d-a3d43250d4de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:28.353698 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d978a7-47be-43ea-9f4d-a3d43250d4de service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:28.353980 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d978a7-47be-43ea-9f4d-a3d43250d4de service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:28.354253 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d978a7-47be-43ea-9f4d-a3d43250d4de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:28.357904 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-97d978a7-47be-43ea-9f4d-a3d43250d4de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:28.401332 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:28.414368 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f87b35f-6834-49e7-b730-69499719b7f2 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:28.419627 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:28.421746 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2162d680-6c8b-415e-b7e8-20d13c17359a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:28.422419 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2162d680-6c8b-415e-b7e8-20d13c17359a admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:28.423115 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2162d680-6c8b-415e-b7e8-20d13c17359a admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:28.423408 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2162d680-6c8b-415e-b7e8-20d13c17359a admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:28.423826 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d978a7-47be-43ea-9f4d-a3d43250d4de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:28.424289 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2162d680-6c8b-415e-b7e8-20d13c17359a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:28.425302 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d978a7-47be-43ea-9f4d-a3d43250d4de service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:28.425760 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2162d680-6c8b-415e-b7e8-20d13c17359a admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:28.435611 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1012/2004] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:50:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:50:28.436438 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 993/2005] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:50:28 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:50:28.437148 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a3331-b195-46b5-8ba9-3b6c739ea53d None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:28.437449 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a3331-b195-46b5-8ba9-3b6c739ea53d None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:28.437732 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a3331-b195-46b5-8ba9-3b6c739ea53d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:28.440352 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2162d680-6c8b-415e-b7e8-20d13c17359a admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:28.450096 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2162d680-6c8b-415e-b7e8-20d13c17359a admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:28.455115 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c462e88f-e876-4e6d-b4c8-f819db43c47b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:28.455944 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c462e88f-e876-4e6d-b4c8-f819db43c47b admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:28.456102 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c462e88f-e876-4e6d-b4c8-f819db43c47b admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:28.456356 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c462e88f-e876-4e6d-b4c8-f819db43c47b admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:28.456638 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-006a3331-b195-46b5-8ba9-3b6c739ea53d None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:50:28.457082 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c462e88f-e876-4e6d-b4c8-f819db43c47b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:28.457982 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-006a3331-b195-46b5-8ba9-3b6c739ea53d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:28.458810 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c462e88f-e876-4e6d-b4c8-f819db43c47b admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:28.466709 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1013/2006] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:50:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:50:28.474086 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4659f916-42c1-476a-9f32-e4a3fd35c5fd None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:28.474626 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4659f916-42c1-476a-9f32-e4a3fd35c5fd None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:28.474908 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4659f916-42c1-476a-9f32-e4a3fd35c5fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:28.475188 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 994/2007] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:50:28 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:50:28.479159 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c462e88f-e876-4e6d-b4c8-f819db43c47b admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:28.491393 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c462e88f-e876-4e6d-b4c8-f819db43c47b admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:28.496261 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-4659f916-42c1-476a-9f32-e4a3fd35c5fd None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:50:28.498176 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-4659f916-42c1-476a-9f32-e4a3fd35c5fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:28.498540 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b020d70c-58a5-4665-a214-fa1f89e78c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:28.499474 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b020d70c-58a5-4665-a214-fa1f89e78c6f admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:28.500791 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b020d70c-58a5-4665-a214-fa1f89e78c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:28.501089 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b020d70c-58a5-4665-a214-fa1f89e78c6f admin admin] PATH_INFO: `/v3/projects/90679142eccd4bd3acf765940488017c/users/ff14741e248540c3871379117c7091ff/roles/317f725e26bf43648d8235bb1f7c4cb3` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:28.507070 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1014/2008] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:50:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:50:28.511964 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4659f916-42c1-476a-9f32-e4a3fd35c5fd None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:28.520865 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b020d70c-58a5-4665-a214-fa1f89e78c6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=90679142eccd4bd3acf765940488017c, user_id=ff14741e248540c3871379117c7091ff, role_id=317f725e26bf43648d8235bb1f7c4cb3)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:28.522288 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4659f916-42c1-476a-9f32-e4a3fd35c5fd None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:28.523787 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b020d70c-58a5-4665-a214-fa1f89e78c6f admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:28.527819 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9272ec5-c18a-4cdc-8e80-e1ca67e6d1dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:28.528529 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9272ec5-c18a-4cdc-8e80-e1ca67e6d1dc admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:28.529401 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9272ec5-c18a-4cdc-8e80-e1ca67e6d1dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:28.529401 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9272ec5-c18a-4cdc-8e80-e1ca67e6d1dc admin admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:28.529927 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9272ec5-c18a-4cdc-8e80-e1ca67e6d1dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:50:28.530243 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9272ec5-c18a-4cdc-8e80-e1ca67e6d1dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:28.531882 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9272ec5-c18a-4cdc-8e80-e1ca67e6d1dc admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:28.543658 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1015/2009] 10.222.0.15 () {58 vars in 1152 bytes} [Tue May 31 14:50:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 14:50:28.548698 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9272ec5-c18a-4cdc-8e80-e1ca67e6d1dc admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:28.558468 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9272ec5-c18a-4cdc-8e80-e1ca67e6d1dc admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:28.563803 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a072c66-5d01-47bc-ac7d-5b5c9a9dea94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:28.564482 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a072c66-5d01-47bc-ac7d-5b5c9a9dea94 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:28.564793 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a072c66-5d01-47bc-ac7d-5b5c9a9dea94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:28.565048 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a072c66-5d01-47bc-ac7d-5b5c9a9dea94 admin admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:28.565732 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a072c66-5d01-47bc-ac7d-5b5c9a9dea94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:28.567837 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a072c66-5d01-47bc-ac7d-5b5c9a9dea94 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:28.575860 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 995/2010] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:50:28 2022] PUT /identity/v3/projects/90679142eccd4bd3acf765940488017c/users/ff14741e248540c3871379117c7091ff/roles/317f725e26bf43648d8235bb1f7c4cb3 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 14:50:28.586709 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07273da7-60ed-46be-8464-69eff6f15260 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:28.587201 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07273da7-60ed-46be-8464-69eff6f15260 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:28.587484 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07273da7-60ed-46be-8464-69eff6f15260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:28.615365 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-07273da7-60ed-46be-8464-69eff6f15260 None None] MFA Rules not processed for user `ff14741e248540c3871379117c7091ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:50:28.616581 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-07273da7-60ed-46be-8464-69eff6f15260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:28.686165 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 996/2011] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:50:28 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 14:50:28.690815 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07273da7-60ed-46be-8464-69eff6f15260 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:28.704606 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1016/2012] 10.222.0.15 () {60 vars in 1152 bytes} [Tue May 31 14:50:28 2022] POST /identity/v3/projects => generated 373 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 14:50:28.709631 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a072c66-5d01-47bc-ac7d-5b5c9a9dea94 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:28.773195 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07273da7-60ed-46be-8464-69eff6f15260 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:28.790366 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a072c66-5d01-47bc-ac7d-5b5c9a9dea94 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:28.795866 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de8dfcb-476d-4f7f-bad9-1320addc326e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:28.796528 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de8dfcb-476d-4f7f-bad9-1320addc326e admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:28.796807 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de8dfcb-476d-4f7f-bad9-1320addc326e admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:28.797078 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de8dfcb-476d-4f7f-bad9-1320addc326e admin admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:28.798020 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de8dfcb-476d-4f7f-bad9-1320addc326e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:28.799949 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de8dfcb-476d-4f7f-bad9-1320addc326e admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:28.821894 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:28.833103 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e77d7a-e56c-4ff2-bb73-ab6e48c60cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:28.833788 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e77d7a-e56c-4ff2-bb73-ab6e48c60cf3 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:28.834070 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e77d7a-e56c-4ff2-bb73-ab6e48c60cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:28.834351 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e77d7a-e56c-4ff2-bb73-ab6e48c60cf3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:28.835083 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e77d7a-e56c-4ff2-bb73-ab6e48c60cf3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:28.836996 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e77d7a-e56c-4ff2-bb73-ab6e48c60cf3 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:28.904978 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1017/2013] 10.222.0.15 () {60 vars in 1143 bytes} [Tue May 31 14:50:28 2022] POST /identity/v3/users => generated 287 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:50:28.905892 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de8dfcb-476d-4f7f-bad9-1320addc326e admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:28.907606 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-3de8dfcb-476d-4f7f-bad9-1320addc326e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:28.920679 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de8dfcb-476d-4f7f-bad9-1320addc326e admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:28.925503 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d361bae4-05ad-4dda-97fe-eccc00639d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:28.926433 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d361bae4-05ad-4dda-97fe-eccc00639d61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:28.926762 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d361bae4-05ad-4dda-97fe-eccc00639d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:28.927032 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d361bae4-05ad-4dda-97fe-eccc00639d61 admin admin] PATH_INFO: `/v3/projects/7140780c41a749f8935c9dbaecb34340` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:28.928193 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d361bae4-05ad-4dda-97fe-eccc00639d61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7140780c41a749f8935c9dbaecb34340)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:28.930085 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d361bae4-05ad-4dda-97fe-eccc00639d61 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:28.937704 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 997/2014] 10.222.0.15 () {60 vars in 1152 bytes} [Tue May 31 14:50:28 2022] POST /identity/v3/projects => generated 379 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 14:50:28.937704 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e77d7a-e56c-4ff2-bb73-ab6e48c60cf3 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:29.002435 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e77d7a-e56c-4ff2-bb73-ab6e48c60cf3 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:29.007250 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1d6785-db44-4eb2-82ff-e5b3fdfe95ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:29.007918 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1d6785-db44-4eb2-82ff-e5b3fdfe95ea admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:29.008228 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1d6785-db44-4eb2-82ff-e5b3fdfe95ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:29.008515 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1d6785-db44-4eb2-82ff-e5b3fdfe95ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:29.009234 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1d6785-db44-4eb2-82ff-e5b3fdfe95ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:29.010943 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1d6785-db44-4eb2-82ff-e5b3fdfe95ea admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:29.020897 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 998/2015] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:50:28 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:50:29.023878 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1d6785-db44-4eb2-82ff-e5b3fdfe95ea admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:29.031232 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1d6785-db44-4eb2-82ff-e5b3fdfe95ea admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:29.035864 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b902c3b1-ea1f-4744-9184-bcfdcf8a0979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:29.036487 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b902c3b1-ea1f-4744-9184-bcfdcf8a0979 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:29.036864 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b902c3b1-ea1f-4744-9184-bcfdcf8a0979 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:29.037144 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b902c3b1-ea1f-4744-9184-bcfdcf8a0979 admin admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:29.037821 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b902c3b1-ea1f-4744-9184-bcfdcf8a0979 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:29.039767 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b902c3b1-ea1f-4744-9184-bcfdcf8a0979 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:29.071030 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-d361bae4-05ad-4dda-97fe-eccc00639d61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7140780c41a749f8935c9dbaecb34340', 'request_id': 'req-d361bae4-05ad-4dda-97fe-eccc00639d61'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:29.073196 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:29.137157 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 999/2016] 10.222.0.15 () {60 vars in 1143 bytes} [Tue May 31 14:50:29 2022] POST /identity/v3/users => generated 296 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:50:29.137157 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b902c3b1-ea1f-4744-9184-bcfdcf8a0979 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:29.145003 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b902c3b1-ea1f-4744-9184-bcfdcf8a0979 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:29.157686 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-d361bae4-05ad-4dda-97fe-eccc00639d61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7140780c41a749f8935c9dbaecb34340', 'request_id': 'req-d361bae4-05ad-4dda-97fe-eccc00639d61'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:29.171409 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-d361bae4-05ad-4dda-97fe-eccc00639d61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7140780c41a749f8935c9dbaecb34340', 'request_id': 'req-d361bae4-05ad-4dda-97fe-eccc00639d61'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:29.182048 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-d361bae4-05ad-4dda-97fe-eccc00639d61 admin admin] The token cache is being invalidate because project 7140780c41a749f8935c9dbaecb34340 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80503) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 14:50:29.182297 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-d361bae4-05ad-4dda-97fe-eccc00639d61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:29.182993 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-d361bae4-05ad-4dda-97fe-eccc00639d61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:29.184598 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1018/2017] 10.222.0.15 () {58 vars in 1232 bytes} [Tue May 31 14:50:28 2022] DELETE /identity/v3/projects/7140780c41a749f8935c9dbaecb34340 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:50:29.185960 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d361bae4-05ad-4dda-97fe-eccc00639d61 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:29.187292 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-d361bae4-05ad-4dda-97fe-eccc00639d61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:29.216296 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bd215e-7ef1-4cf6-998d-08c9adfd1ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:29.216979 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd215e-7ef1-4cf6-998d-08c9adfd1ded admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:29.217261 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd215e-7ef1-4cf6-998d-08c9adfd1ded admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:29.217542 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd215e-7ef1-4cf6-998d-08c9adfd1ded admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:29.218364 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bd215e-7ef1-4cf6-998d-08c9adfd1ded admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:29.220057 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bd215e-7ef1-4cf6-998d-08c9adfd1ded admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:29.235056 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1000/2018] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:50:29 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:50:29.235056 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0eaa8d-e1e1-4c95-8981-8ccfa2de566a None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:29.235056 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0eaa8d-e1e1-4c95-8981-8ccfa2de566a None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:29.235056 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0eaa8d-e1e1-4c95-8981-8ccfa2de566a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:29.254098 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-cb0eaa8d-e1e1-4c95-8981-8ccfa2de566a None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:50:29.255425 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-cb0eaa8d-e1e1-4c95-8981-8ccfa2de566a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:29.263165 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d361bae4-05ad-4dda-97fe-eccc00639d61 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:29.267147 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1001/2019] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:50:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:50:29.268345 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0eaa8d-e1e1-4c95-8981-8ccfa2de566a None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:29.270186 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-cb0eaa8d-e1e1-4c95-8981-8ccfa2de566a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:29.272012 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93a4e68-76b4-445f-acca-8d9f0e9913da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:29.274670 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a4e68-76b4-445f-acca-8d9f0e9913da admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:29.274670 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a4e68-76b4-445f-acca-8d9f0e9913da admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:29.274670 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a4e68-76b4-445f-acca-8d9f0e9913da admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:29.274670 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93a4e68-76b4-445f-acca-8d9f0e9913da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:29.275896 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93a4e68-76b4-445f-acca-8d9f0e9913da admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:29.289678 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0eaa8d-e1e1-4c95-8981-8ccfa2de566a None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:29.289784 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1019/2020] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:50:29 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:50:29.290442 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d6174-b160-43a9-82ff-2f9712d44e98 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:29.291766 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d6174-b160-43a9-82ff-2f9712d44e98 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:29.291766 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d6174-b160-43a9-82ff-2f9712d44e98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:29.293165 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abfec50-114a-47b1-8e0e-45188f6d4db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:29.294641 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abfec50-114a-47b1-8e0e-45188f6d4db8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:29.294889 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abfec50-114a-47b1-8e0e-45188f6d4db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:29.295208 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abfec50-114a-47b1-8e0e-45188f6d4db8 admin admin] PATH_INFO: `/v3/projects/6cdab2d3fc5944aca688265d2bfcc7ba/users/bfc7559a4b8c4449b0513f5b7a7e9211/roles/317f725e26bf43648d8235bb1f7c4cb3` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:29.312385 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abfec50-114a-47b1-8e0e-45188f6d4db8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cdab2d3fc5944aca688265d2bfcc7ba, user_id=bfc7559a4b8c4449b0513f5b7a7e9211, role_id=317f725e26bf43648d8235bb1f7c4cb3)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:29.315483 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abfec50-114a-47b1-8e0e-45188f6d4db8 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:29.320000 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-567d6174-b160-43a9-82ff-2f9712d44e98 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:50:29.321297 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-567d6174-b160-43a9-82ff-2f9712d44e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:29.334257 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1020/2021] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:50:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:50:29.335004 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567d6174-b160-43a9-82ff-2f9712d44e98 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:29.345479 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567d6174-b160-43a9-82ff-2f9712d44e98 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:29.350477 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79bb450-84f3-4a18-8102-27241d11bd75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:29.352059 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79bb450-84f3-4a18-8102-27241d11bd75 admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:29.352059 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79bb450-84f3-4a18-8102-27241d11bd75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:29.352059 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79bb450-84f3-4a18-8102-27241d11bd75 admin admin] PATH_INFO: `/v3/projects/6fad3cded3484f6580922e6cb85c93b2/users/2cb2850ec7654464936e7175ac3ef1d2/roles/76c53e2c353644f885028a0226c06146` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:29.370798 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79bb450-84f3-4a18-8102-27241d11bd75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fad3cded3484f6580922e6cb85c93b2, user_id=2cb2850ec7654464936e7175ac3ef1d2, role_id=76c53e2c353644f885028a0226c06146)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:29.373721 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79bb450-84f3-4a18-8102-27241d11bd75 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:29.378191 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1002/2022] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:50:29 2022] PUT /identity/v3/projects/6cdab2d3fc5944aca688265d2bfcc7ba/users/bfc7559a4b8c4449b0513f5b7a7e9211/roles/317f725e26bf43648d8235bb1f7c4cb3 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:50:29.379184 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abfec50-114a-47b1-8e0e-45188f6d4db8 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:29.401191 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:29.449527 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abfec50-114a-47b1-8e0e-45188f6d4db8 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:29.453641 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1021/2023] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:50:29 2022] PUT /identity/v3/projects/6fad3cded3484f6580922e6cb85c93b2/users/2cb2850ec7654464936e7175ac3ef1d2/roles/76c53e2c353644f885028a0226c06146 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:50:29.455339 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cf5ef3-ef1c-4de4-97c8-352adc2dfd9d None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:29.455703 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cf5ef3-ef1c-4de4-97c8-352adc2dfd9d None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:29.456060 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cf5ef3-ef1c-4de4-97c8-352adc2dfd9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:29.497594 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-49cf5ef3-ef1c-4de4-97c8-352adc2dfd9d None None] MFA Rules not processed for user `bfc7559a4b8c4449b0513f5b7a7e9211`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:50:29.502449 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-49cf5ef3-ef1c-4de4-97c8-352adc2dfd9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:29.530278 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899f2522-5a6a-473a-9e9c-72b4d9efa59f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:29.531137 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899f2522-5a6a-473a-9e9c-72b4d9efa59f admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:29.531448 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899f2522-5a6a-473a-9e9c-72b4d9efa59f admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:29.531850 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899f2522-5a6a-473a-9e9c-72b4d9efa59f admin admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:29.532613 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899f2522-5a6a-473a-9e9c-72b4d9efa59f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:50:29.533035 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899f2522-5a6a-473a-9e9c-72b4d9efa59f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:29.534699 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899f2522-5a6a-473a-9e9c-72b4d9efa59f admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:29.549605 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1003/2024] 10.222.0.15 () {58 vars in 1152 bytes} [Tue May 31 14:50:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:50:29.552196 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899f2522-5a6a-473a-9e9c-72b4d9efa59f admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:29.562324 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899f2522-5a6a-473a-9e9c-72b4d9efa59f admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:29.569580 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d10c3a9-85ed-43eb-9990-291cefadc875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:29.570247 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d10c3a9-85ed-43eb-9990-291cefadc875 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:29.570538 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d10c3a9-85ed-43eb-9990-291cefadc875 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:29.570832 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d10c3a9-85ed-43eb-9990-291cefadc875 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:29.571567 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d10c3a9-85ed-43eb-9990-291cefadc875 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:29.571898 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1022/2025] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:50:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:50:29.572784 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cf5ef3-ef1c-4de4-97c8-352adc2dfd9d None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:29.573217 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d10c3a9-85ed-43eb-9990-291cefadc875 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:29.583685 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cf5ef3-ef1c-4de4-97c8-352adc2dfd9d None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:29.584255 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1004/2026] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:50:29 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:50:29.587973 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d10c3a9-85ed-43eb-9990-291cefadc875 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:29.591751 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4138a6e4-9002-4d3b-a3b3-5d6ea4eeb905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:29.592433 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4138a6e4-9002-4d3b-a3b3-5d6ea4eeb905 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:29.592719 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4138a6e4-9002-4d3b-a3b3-5d6ea4eeb905 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:29.592995 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4138a6e4-9002-4d3b-a3b3-5d6ea4eeb905 admin admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:29.593686 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4138a6e4-9002-4d3b-a3b3-5d6ea4eeb905 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:29.595637 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4138a6e4-9002-4d3b-a3b3-5d6ea4eeb905 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:29.598458 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d10c3a9-85ed-43eb-9990-291cefadc875 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:29.603684 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990273a2-75b2-4475-b6fe-197f1181ead4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:29.604586 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990273a2-75b2-4475-b6fe-197f1181ead4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:29.604869 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990273a2-75b2-4475-b6fe-197f1181ead4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:29.605144 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990273a2-75b2-4475-b6fe-197f1181ead4 admin admin] PATH_INFO: `/v3/projects/6fad3cded3484f6580922e6cb85c93b2/users/2cb2850ec7654464936e7175ac3ef1d2/roles/76c53e2c353644f885028a0226c06146` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:29.607830 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990273a2-75b2-4475-b6fe-197f1181ead4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fad3cded3484f6580922e6cb85c93b2, user_id=2cb2850ec7654464936e7175ac3ef1d2, role_id=76c53e2c353644f885028a0226c06146)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:29.610428 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990273a2-75b2-4475-b6fe-197f1181ead4 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:29.620874 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1005/2027] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:50:29 2022] PUT /identity/v3/projects/6fad3cded3484f6580922e6cb85c93b2/users/2cb2850ec7654464936e7175ac3ef1d2/roles/76c53e2c353644f885028a0226c06146 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 14:50:29.631136 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e74632-c588-4889-9b72-74e517038348 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:29.631453 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e74632-c588-4889-9b72-74e517038348 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:29.631729 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e74632-c588-4889-9b72-74e517038348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:29.658652 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-68e74632-c588-4889-9b72-74e517038348 None None] MFA Rules not processed for user `2cb2850ec7654464936e7175ac3ef1d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:50:29.659912 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-68e74632-c588-4889-9b72-74e517038348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:29.676781 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1023/2028] 10.222.0.15 () {60 vars in 1152 bytes} [Tue May 31 14:50:29 2022] POST /identity/v3/projects => generated 385 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:50:29.677740 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4138a6e4-9002-4d3b-a3b3-5d6ea4eeb905 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:29.691663 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:29.732374 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1006/2029] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:50:29 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 14:50:29.736474 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e74632-c588-4889-9b72-74e517038348 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:29.737656 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-68e74632-c588-4889-9b72-74e517038348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:29.752215 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4138a6e4-9002-4d3b-a3b3-5d6ea4eeb905 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:29.757938 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bdbcb4-ae10-4748-9946-50489d5df25c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:29.758271 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bdbcb4-ae10-4748-9946-50489d5df25c admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:29.758593 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bdbcb4-ae10-4748-9946-50489d5df25c admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:29.758928 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bdbcb4-ae10-4748-9946-50489d5df25c admin admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:29.759701 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bdbcb4-ae10-4748-9946-50489d5df25c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:29.761641 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bdbcb4-ae10-4748-9946-50489d5df25c admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:29.769972 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:29.801967 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e74632-c588-4889-9b72-74e517038348 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:29.849659 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e23835-ea9f-45b6-bf7b-2ddec1f6ff8a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afbf718dcd9b4741a926b0a2321bd53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:29.850240 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e23835-ea9f-45b6-bf7b-2ddec1f6ff8a service cinder] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:29.850571 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e23835-ea9f-45b6-bf7b-2ddec1f6ff8a service cinder] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:29.850877 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e23835-ea9f-45b6-bf7b-2ddec1f6ff8a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:29.863994 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1024/2030] 10.222.0.15 () {60 vars in 1143 bytes} [Tue May 31 14:50:29 2022] POST /identity/v3/users => generated 293 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 14:50:29.870106 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bdbcb4-ae10-4748-9946-50489d5df25c admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:29.887541 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bdbcb4-ae10-4748-9946-50489d5df25c admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:29.894088 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17c6b75-538a-4fc1-a6ac-7764d6e440a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:29.894945 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c6b75-538a-4fc1-a6ac-7764d6e440a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:29.895251 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c6b75-538a-4fc1-a6ac-7764d6e440a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:29.895531 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c6b75-538a-4fc1-a6ac-7764d6e440a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:29.896257 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17c6b75-538a-4fc1-a6ac-7764d6e440a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:29.897998 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17c6b75-538a-4fc1-a6ac-7764d6e440a5 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:29.909722 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1025/2031] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:50:29 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 14:50:29.914815 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17c6b75-538a-4fc1-a6ac-7764d6e440a5 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:29.925789 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17c6b75-538a-4fc1-a6ac-7764d6e440a5 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:29.927863 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e23835-ea9f-45b6-bf7b-2ddec1f6ff8a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:29.929392 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e23835-ea9f-45b6-bf7b-2ddec1f6ff8a service cinder] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:29.931775 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098f0d9b-5513-4288-be23-62d66ffbeac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:29.932588 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f0d9b-5513-4288-be23-62d66ffbeac3 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:29.932861 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f0d9b-5513-4288-be23-62d66ffbeac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:29.935131 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f0d9b-5513-4288-be23-62d66ffbeac3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:29.935131 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098f0d9b-5513-4288-be23-62d66ffbeac3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:29.935544 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098f0d9b-5513-4288-be23-62d66ffbeac3 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:29.942811 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1007/2032] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:50:29 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:50:29.951926 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e23835-ea9f-45b6-bf7b-2ddec1f6ff8a service cinder] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:29.953452 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-43e23835-ea9f-45b6-bf7b-2ddec1f6ff8a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:29.963458 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1026/2033] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:50:29 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:50:29.968681 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098f0d9b-5513-4288-be23-62d66ffbeac3 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:29.969390 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e23835-ea9f-45b6-bf7b-2ddec1f6ff8a service cinder] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:29.973285 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00246286-3a5b-4ba2-897f-7be2e40039e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afbf718dcd9b4741a926b0a2321bd53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:29.973983 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00246286-3a5b-4ba2-897f-7be2e40039e1 service cinder] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:29.974267 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00246286-3a5b-4ba2-897f-7be2e40039e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:29.974541 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00246286-3a5b-4ba2-897f-7be2e40039e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:29.979564 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098f0d9b-5513-4288-be23-62d66ffbeac3 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:29.985167 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b22dfd-95c8-4dd5-b253-97d3e05a8344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:29.985978 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b22dfd-95c8-4dd5-b253-97d3e05a8344 admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:29.986260 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b22dfd-95c8-4dd5-b253-97d3e05a8344 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:29.986535 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b22dfd-95c8-4dd5-b253-97d3e05a8344 admin admin] PATH_INFO: `/v3/projects/3b435f0d7f1749c9b2b1e222bc8026b1/users/9d415e27d3d845acaa8893423603a422/roles/317f725e26bf43648d8235bb1f7c4cb3` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:30.007327 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b22dfd-95c8-4dd5-b253-97d3e05a8344 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b435f0d7f1749c9b2b1e222bc8026b1, user_id=9d415e27d3d845acaa8893423603a422, role_id=317f725e26bf43648d8235bb1f7c4cb3)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:30.010532 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b22dfd-95c8-4dd5-b253-97d3e05a8344 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:30.052723 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00246286-3a5b-4ba2-897f-7be2e40039e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:30.054208 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00246286-3a5b-4ba2-897f-7be2e40039e1 service cinder] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:30.064641 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1008/2034] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:50:29 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:50:30.088482 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1027/2035] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:50:29 2022] PUT /identity/v3/projects/3b435f0d7f1749c9b2b1e222bc8026b1/users/9d415e27d3d845acaa8893423603a422/roles/317f725e26bf43648d8235bb1f7c4cb3 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 14:50:30.100119 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9801d2d6-4810-4f22-bdbd-b08527008a87 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:30.100338 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9801d2d6-4810-4f22-bdbd-b08527008a87 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:30.100620 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9801d2d6-4810-4f22-bdbd-b08527008a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:30.137174 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-9801d2d6-4810-4f22-bdbd-b08527008a87 None None] MFA Rules not processed for user `9d415e27d3d845acaa8893423603a422`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:50:30.139251 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-9801d2d6-4810-4f22-bdbd-b08527008a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:30.154303 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b22dfd-95c8-4dd5-b253-97d3e05a8344 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:30.156794 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:30.215666 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1009/2036] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:50:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:50:30.216101 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b22dfd-95c8-4dd5-b253-97d3e05a8344 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:30.219769 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5444254-dc89-47c8-be2b-af8977a23c28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afbf718dcd9b4741a926b0a2321bd53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:30.220404 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5444254-dc89-47c8-be2b-af8977a23c28 service cinder] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:30.220731 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5444254-dc89-47c8-be2b-af8977a23c28 service cinder] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:30.221134 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5444254-dc89-47c8-be2b-af8977a23c28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:30.222953 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-e5444254-dc89-47c8-be2b-af8977a23c28 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:30.292979 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5444254-dc89-47c8-be2b-af8977a23c28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:30.294491 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5444254-dc89-47c8-be2b-af8977a23c28 service cinder] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:30.305451 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1028/2037] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:50:30 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 14:50:30.333540 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9801d2d6-4810-4f22-bdbd-b08527008a87 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:30.344329 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9801d2d6-4810-4f22-bdbd-b08527008a87 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:30.347589 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444020e0-7ce0-4e31-9a6a-99bcc8de5379 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afbf718dcd9b4741a926b0a2321bd53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:30.348234 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444020e0-7ce0-4e31-9a6a-99bcc8de5379 service cinder] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:30.348581 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444020e0-7ce0-4e31-9a6a-99bcc8de5379 service cinder] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:30.348855 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444020e0-7ce0-4e31-9a6a-99bcc8de5379 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:30.359953 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444020e0-7ce0-4e31-9a6a-99bcc8de5379 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:30.361352 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444020e0-7ce0-4e31-9a6a-99bcc8de5379 service cinder] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:30.371926 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1010/2038] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:50:30 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:50:34.849763 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5444254-dc89-47c8-be2b-af8977a23c28 service cinder] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:34.863292 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:34.913943 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5444254-dc89-47c8-be2b-af8977a23c28 service cinder] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:34.918975 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a17bb94-afc2-480f-94cd-7e8e00633b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:34.919942 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a17bb94-afc2-480f-94cd-7e8e00633b50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:34.920309 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a17bb94-afc2-480f-94cd-7e8e00633b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:34.920600 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a17bb94-afc2-480f-94cd-7e8e00633b50 admin admin] PATH_INFO: `/v3/users/28e35b75d69942f6881eda2319040ae6` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:34.921875 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a17bb94-afc2-480f-94cd-7e8e00633b50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28e35b75d69942f6881eda2319040ae6)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:34.927028 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a17bb94-afc2-480f-94cd-7e8e00633b50 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:35.151198 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-1a17bb94-afc2-480f-94cd-7e8e00633b50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28e35b75d69942f6881eda2319040ae6'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:35.265969 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-1a17bb94-afc2-480f-94cd-7e8e00633b50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28e35b75d69942f6881eda2319040ae6'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:35.266623 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-1a17bb94-afc2-480f-94cd-7e8e00633b50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28e35b75d69942f6881eda2319040ae6'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:35.274527 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-1a17bb94-afc2-480f-94cd-7e8e00633b50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28e35b75d69942f6881eda2319040ae6'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:35.275366 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-1a17bb94-afc2-480f-94cd-7e8e00633b50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28e35b75d69942f6881eda2319040ae6'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:35.312933 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1029/2039] 10.222.0.15 () {58 vars in 1223 bytes} [Tue May 31 14:50:34 2022] DELETE /identity/v3/users/28e35b75d69942f6881eda2319040ae6 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 14:50:35.317251 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c501d6-d9a6-410a-91db-a2e59a8a0f8e None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:35.317685 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c501d6-d9a6-410a-91db-a2e59a8a0f8e None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:35.318015 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c501d6-d9a6-410a-91db-a2e59a8a0f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:35.337701 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-16c501d6-d9a6-410a-91db-a2e59a8a0f8e None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:50:35.340391 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-16c501d6-d9a6-410a-91db-a2e59a8a0f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:35.403919 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1011/2040] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:50:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:50:35.413729 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a17bb94-afc2-480f-94cd-7e8e00633b50 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:35.415265 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-1a17bb94-afc2-480f-94cd-7e8e00633b50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:35.475506 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a17bb94-afc2-480f-94cd-7e8e00633b50 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:35.480771 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf7ebfe-eb3d-41b5-8fde-901a7af26c7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:35.480771 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf7ebfe-eb3d-41b5-8fde-901a7af26c7a service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:35.480771 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf7ebfe-eb3d-41b5-8fde-901a7af26c7a service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:35.480771 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf7ebfe-eb3d-41b5-8fde-901a7af26c7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:35.491971 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf7ebfe-eb3d-41b5-8fde-901a7af26c7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:35.493408 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf7ebfe-eb3d-41b5-8fde-901a7af26c7a service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:35.504163 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1030/2041] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:50:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:50:35.942451 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c501d6-d9a6-410a-91db-a2e59a8a0f8e None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:35.952397 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-16c501d6-d9a6-410a-91db-a2e59a8a0f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:35.960407 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c501d6-d9a6-410a-91db-a2e59a8a0f8e None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:35.965372 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0bff42-e061-4f6d-aafb-7e1d7a9994a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:35.966393 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0bff42-e061-4f6d-aafb-7e1d7a9994a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:35.967149 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0bff42-e061-4f6d-aafb-7e1d7a9994a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:35.967149 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0bff42-e061-4f6d-aafb-7e1d7a9994a0 admin admin] PATH_INFO: `/v3/projects/879c190dc7724153ba2299871e3decc6` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:35.968983 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0bff42-e061-4f6d-aafb-7e1d7a9994a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=879c190dc7724153ba2299871e3decc6)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:35.970959 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0bff42-e061-4f6d-aafb-7e1d7a9994a0 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:36.080037 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-9c0bff42-e061-4f6d-aafb-7e1d7a9994a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '879c190dc7724153ba2299871e3decc6', 'request_id': 'req-9c0bff42-e061-4f6d-aafb-7e1d7a9994a0'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:36.086326 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-9c0bff42-e061-4f6d-aafb-7e1d7a9994a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '879c190dc7724153ba2299871e3decc6', 'request_id': 'req-9c0bff42-e061-4f6d-aafb-7e1d7a9994a0'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:36.187001 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-9c0bff42-e061-4f6d-aafb-7e1d7a9994a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '879c190dc7724153ba2299871e3decc6', 'request_id': 'req-9c0bff42-e061-4f6d-aafb-7e1d7a9994a0'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:36.208218 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-9c0bff42-e061-4f6d-aafb-7e1d7a9994a0 admin admin] The token cache is being invalidate because project 879c190dc7724153ba2299871e3decc6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 14:50:36.208581 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-9c0bff42-e061-4f6d-aafb-7e1d7a9994a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:36.209308 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-9c0bff42-e061-4f6d-aafb-7e1d7a9994a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:36.211201 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1012/2042] 10.222.0.15 () {58 vars in 1232 bytes} [Tue May 31 14:50:35 2022] DELETE /identity/v3/projects/879c190dc7724153ba2299871e3decc6 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:50:36.214861 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf7ebfe-eb3d-41b5-8fde-901a7af26c7a service neutron] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:36.225111 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf7ebfe-eb3d-41b5-8fde-901a7af26c7a service neutron] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:36.260598 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:36.292768 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370b65fa-e007-4602-b73e-3beadbabf279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:36.293733 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b65fa-e007-4602-b73e-3beadbabf279 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:36.294907 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b65fa-e007-4602-b73e-3beadbabf279 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:36.295226 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b65fa-e007-4602-b73e-3beadbabf279 admin admin] PATH_INFO: `/v3/users/ff14741e248540c3871379117c7091ff` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:36.296516 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370b65fa-e007-4602-b73e-3beadbabf279 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff14741e248540c3871379117c7091ff)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:36.298859 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370b65fa-e007-4602-b73e-3beadbabf279 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:36.535758 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-370b65fa-e007-4602-b73e-3beadbabf279 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff14741e248540c3871379117c7091ff'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:36.625881 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-370b65fa-e007-4602-b73e-3beadbabf279 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff14741e248540c3871379117c7091ff'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:36.626738 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-370b65fa-e007-4602-b73e-3beadbabf279 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff14741e248540c3871379117c7091ff'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:36.634952 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-370b65fa-e007-4602-b73e-3beadbabf279 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff14741e248540c3871379117c7091ff'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:36.635760 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-370b65fa-e007-4602-b73e-3beadbabf279 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff14741e248540c3871379117c7091ff'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:36.654103 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1031/2043] 10.222.0.15 () {58 vars in 1223 bytes} [Tue May 31 14:50:36 2022] DELETE /identity/v3/users/ff14741e248540c3871379117c7091ff => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:50:37.136040 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0bff42-e061-4f6d-aafb-7e1d7a9994a0 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:37.140003 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-9c0bff42-e061-4f6d-aafb-7e1d7a9994a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:37.151149 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0bff42-e061-4f6d-aafb-7e1d7a9994a0 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:37.189252 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:37.215072 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bbba08-9ad9-4c49-8a30-4651f347d92f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:37.216005 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bbba08-9ad9-4c49-8a30-4651f347d92f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:37.216372 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bbba08-9ad9-4c49-8a30-4651f347d92f admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:37.217966 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bbba08-9ad9-4c49-8a30-4651f347d92f admin admin] PATH_INFO: `/v3/projects/90679142eccd4bd3acf765940488017c` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:37.218382 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bbba08-9ad9-4c49-8a30-4651f347d92f admin admin] RBAC: Authorizing `identity:delete_project(project_id=90679142eccd4bd3acf765940488017c)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:37.220390 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bbba08-9ad9-4c49-8a30-4651f347d92f admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:37.386496 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-74bbba08-9ad9-4c49-8a30-4651f347d92f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90679142eccd4bd3acf765940488017c', 'request_id': 'req-74bbba08-9ad9-4c49-8a30-4651f347d92f'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:37.401684 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-74bbba08-9ad9-4c49-8a30-4651f347d92f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90679142eccd4bd3acf765940488017c', 'request_id': 'req-74bbba08-9ad9-4c49-8a30-4651f347d92f'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:37.471318 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-74bbba08-9ad9-4c49-8a30-4651f347d92f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90679142eccd4bd3acf765940488017c', 'request_id': 'req-74bbba08-9ad9-4c49-8a30-4651f347d92f'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:37.491499 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-74bbba08-9ad9-4c49-8a30-4651f347d92f admin admin] The token cache is being invalidate because project 90679142eccd4bd3acf765940488017c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 14:50:37.491499 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-74bbba08-9ad9-4c49-8a30-4651f347d92f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:37.491499 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-74bbba08-9ad9-4c49-8a30-4651f347d92f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:37.491499 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1013/2044] 10.222.0.15 () {58 vars in 1232 bytes} [Tue May 31 14:50:37 2022] DELETE /identity/v3/projects/90679142eccd4bd3acf765940488017c => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:50:37.500009 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370b65fa-e007-4602-b73e-3beadbabf279 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:37.501547 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-370b65fa-e007-4602-b73e-3beadbabf279 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:37.515482 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370b65fa-e007-4602-b73e-3beadbabf279 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:37.601582 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8771b250-c4c0-4bf4-a040-1a71cd6240a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:37.602545 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8771b250-c4c0-4bf4-a040-1a71cd6240a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:37.602876 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8771b250-c4c0-4bf4-a040-1a71cd6240a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:37.603157 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8771b250-c4c0-4bf4-a040-1a71cd6240a2 admin admin] PATH_INFO: `/v3/users/2cb2850ec7654464936e7175ac3ef1d2` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:37.604393 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8771b250-c4c0-4bf4-a040-1a71cd6240a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cb2850ec7654464936e7175ac3ef1d2)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:37.606392 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8771b250-c4c0-4bf4-a040-1a71cd6240a2 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:37.805181 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-8771b250-c4c0-4bf4-a040-1a71cd6240a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cb2850ec7654464936e7175ac3ef1d2'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:37.888173 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-8771b250-c4c0-4bf4-a040-1a71cd6240a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cb2850ec7654464936e7175ac3ef1d2'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:37.888897 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-8771b250-c4c0-4bf4-a040-1a71cd6240a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cb2850ec7654464936e7175ac3ef1d2'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:37.890983 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:37.897314 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-8771b250-c4c0-4bf4-a040-1a71cd6240a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cb2850ec7654464936e7175ac3ef1d2'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:37.898099 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-8771b250-c4c0-4bf4-a040-1a71cd6240a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cb2850ec7654464936e7175ac3ef1d2'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:37.916858 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1032/2045] 10.222.0.15 () {58 vars in 1223 bytes} [Tue May 31 14:50:37 2022] DELETE /identity/v3/users/2cb2850ec7654464936e7175ac3ef1d2 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:50:38.029400 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bbba08-9ad9-4c49-8a30-4651f347d92f admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:38.031073 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-74bbba08-9ad9-4c49-8a30-4651f347d92f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:38.044071 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bbba08-9ad9-4c49-8a30-4651f347d92f admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:38.110977 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c587da4-1315-4886-b472-ea15910f8a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:38.111879 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c587da4-1315-4886-b472-ea15910f8a1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:38.112236 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c587da4-1315-4886-b472-ea15910f8a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:38.112588 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c587da4-1315-4886-b472-ea15910f8a1d admin admin] PATH_INFO: `/v3/users/9d415e27d3d845acaa8893423603a422` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:38.114265 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c587da4-1315-4886-b472-ea15910f8a1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d415e27d3d845acaa8893423603a422)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:38.116725 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c587da4-1315-4886-b472-ea15910f8a1d admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:38.324339 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8771b250-c4c0-4bf4-a040-1a71cd6240a2 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:38.325811 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-8771b250-c4c0-4bf4-a040-1a71cd6240a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:38.328683 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-8c587da4-1315-4886-b472-ea15910f8a1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d415e27d3d845acaa8893423603a422'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:38.336648 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-8c587da4-1315-4886-b472-ea15910f8a1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d415e27d3d845acaa8893423603a422'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:38.337631 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-8c587da4-1315-4886-b472-ea15910f8a1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d415e27d3d845acaa8893423603a422'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:38.338702 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-8c587da4-1315-4886-b472-ea15910f8a1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d415e27d3d845acaa8893423603a422'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:38.339772 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8771b250-c4c0-4bf4-a040-1a71cd6240a2 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:38.341841 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:38.345235 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3e4f90-4252-4726-9589-0f64c00b75b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:38.346294 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3e4f90-4252-4726-9589-0f64c00b75b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:38.346596 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3e4f90-4252-4726-9589-0f64c00b75b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:38.346876 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3e4f90-4252-4726-9589-0f64c00b75b7 admin admin] PATH_INFO: `/v3/projects/6fad3cded3484f6580922e6cb85c93b2` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:38.348110 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3e4f90-4252-4726-9589-0f64c00b75b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fad3cded3484f6580922e6cb85c93b2)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:38.350386 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3e4f90-4252-4726-9589-0f64c00b75b7 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:38.359642 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-8c587da4-1315-4886-b472-ea15910f8a1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d415e27d3d845acaa8893423603a422'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:38.465310 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1014/2046] 10.222.0.15 () {58 vars in 1223 bytes} [Tue May 31 14:50:38 2022] DELETE /identity/v3/users/9d415e27d3d845acaa8893423603a422 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:50:38.469643 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd203fb-d64f-4376-b39c-1b586c963d9d None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:38.469935 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd203fb-d64f-4376-b39c-1b586c963d9d None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:38.470222 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd203fb-d64f-4376-b39c-1b586c963d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:38.488438 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-4bd203fb-d64f-4376-b39c-1b586c963d9d None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:50:38.489647 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-4bd203fb-d64f-4376-b39c-1b586c963d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:38.505361 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-0c3e4f90-4252-4726-9589-0f64c00b75b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fad3cded3484f6580922e6cb85c93b2', 'request_id': 'req-0c3e4f90-4252-4726-9589-0f64c00b75b7'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:38.570622 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1015/2047] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:50:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 14:50:38.586798 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd203fb-d64f-4376-b39c-1b586c963d9d None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:38.591822 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-4bd203fb-d64f-4376-b39c-1b586c963d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:38.620500 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-0c3e4f90-4252-4726-9589-0f64c00b75b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fad3cded3484f6580922e6cb85c93b2', 'request_id': 'req-0c3e4f90-4252-4726-9589-0f64c00b75b7'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:38.628178 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-0c3e4f90-4252-4726-9589-0f64c00b75b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fad3cded3484f6580922e6cb85c93b2', 'request_id': 'req-0c3e4f90-4252-4726-9589-0f64c00b75b7'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:38.649167 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-0c3e4f90-4252-4726-9589-0f64c00b75b7 admin admin] The token cache is being invalidate because project 6fad3cded3484f6580922e6cb85c93b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80503) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 14:50:38.649542 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-0c3e4f90-4252-4726-9589-0f64c00b75b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:38.650304 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-0c3e4f90-4252-4726-9589-0f64c00b75b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:38.652988 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1033/2048] 10.222.0.15 () {58 vars in 1232 bytes} [Tue May 31 14:50:38 2022] DELETE /identity/v3/projects/6fad3cded3484f6580922e6cb85c93b2 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 14:50:38.662532 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97428c4f-b21d-4098-81fb-056072614d10 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:38.662851 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97428c4f-b21d-4098-81fb-056072614d10 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:38.664034 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97428c4f-b21d-4098-81fb-056072614d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:38.666885 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd203fb-d64f-4376-b39c-1b586c963d9d None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:38.671900 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e81f71-60ac-492e-ba80-27c0ce5eebf5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:38.672737 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e81f71-60ac-492e-ba80-27c0ce5eebf5 service neutron] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:38.673290 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e81f71-60ac-492e-ba80-27c0ce5eebf5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:38.676457 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e81f71-60ac-492e-ba80-27c0ce5eebf5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:38.676457 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-26e81f71-60ac-492e-ba80-27c0ce5eebf5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:38.700561 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-97428c4f-b21d-4098-81fb-056072614d10 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:50:38.705206 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-97428c4f-b21d-4098-81fb-056072614d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:38.705561 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e81f71-60ac-492e-ba80-27c0ce5eebf5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:38.705561 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e81f71-60ac-492e-ba80-27c0ce5eebf5 service neutron] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:38.710862 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1034/2049] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:50:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:50:38.720065 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb5972-446f-4177-8948-7fcf1f35fc79 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:38.721313 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1016/2050] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:50:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 14:50:38.721760 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb5972-446f-4177-8948-7fcf1f35fc79 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:38.722009 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb5972-446f-4177-8948-7fcf1f35fc79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:38.742102 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-9cdb5972-446f-4177-8948-7fcf1f35fc79 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:50:38.743604 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-9cdb5972-446f-4177-8948-7fcf1f35fc79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:38.752731 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1035/2051] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:50:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:50:38.759803 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e81f71-60ac-492e-ba80-27c0ce5eebf5 service neutron] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:38.770440 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e81f71-60ac-492e-ba80-27c0ce5eebf5 service neutron] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:38.777240 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16fb9ad-e761-4942-ac80-09fa13cde922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:38.777969 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16fb9ad-e761-4942-ac80-09fa13cde922 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:38.780077 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16fb9ad-e761-4942-ac80-09fa13cde922 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:38.781901 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16fb9ad-e761-4942-ac80-09fa13cde922 admin admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:38.783327 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16fb9ad-e761-4942-ac80-09fa13cde922 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:50:38.783715 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16fb9ad-e761-4942-ac80-09fa13cde922 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:38.786568 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16fb9ad-e761-4942-ac80-09fa13cde922 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:38.802583 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1017/2052] 10.222.0.15 () {58 vars in 1152 bytes} [Tue May 31 14:50:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:50:38.804703 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdb5972-446f-4177-8948-7fcf1f35fc79 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:38.815136 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdb5972-446f-4177-8948-7fcf1f35fc79 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:38.820295 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c55c0c-96f5-47c7-8f59-4b6d63e8ad3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:38.821069 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c55c0c-96f5-47c7-8f59-4b6d63e8ad3a admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:38.821428 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c55c0c-96f5-47c7-8f59-4b6d63e8ad3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:38.821803 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c55c0c-96f5-47c7-8f59-4b6d63e8ad3a admin admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:38.822781 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c55c0c-96f5-47c7-8f59-4b6d63e8ad3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:38.824860 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c55c0c-96f5-47c7-8f59-4b6d63e8ad3a admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:38.930011 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1036/2053] 10.222.0.15 () {60 vars in 1152 bytes} [Tue May 31 14:50:38 2022] POST /identity/v3/projects => generated 379 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:50:38.931174 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16fb9ad-e761-4942-ac80-09fa13cde922 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:38.946581 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16fb9ad-e761-4942-ac80-09fa13cde922 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:39.024547 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e6ecc5-0e01-4f29-858e-b00d590e858b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:39.025241 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e6ecc5-0e01-4f29-858e-b00d590e858b admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:39.025536 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e6ecc5-0e01-4f29-858e-b00d590e858b admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:39.025822 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e6ecc5-0e01-4f29-858e-b00d590e858b admin admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:39.026699 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e6ecc5-0e01-4f29-858e-b00d590e858b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:39.029045 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e6ecc5-0e01-4f29-858e-b00d590e858b admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:39.117889 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1018/2054] 10.222.0.15 () {60 vars in 1143 bytes} [Tue May 31 14:50:38 2022] POST /identity/v3/users => generated 290 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:50:39.122166 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c55c0c-96f5-47c7-8f59-4b6d63e8ad3a admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:39.135064 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c55c0c-96f5-47c7-8f59-4b6d63e8ad3a admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:39.140199 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3abd5a-02a6-4b96-8484-5fa52410c5c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:39.140860 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3abd5a-02a6-4b96-8484-5fa52410c5c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:39.145627 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3abd5a-02a6-4b96-8484-5fa52410c5c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:39.145627 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3abd5a-02a6-4b96-8484-5fa52410c5c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:39.145627 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3abd5a-02a6-4b96-8484-5fa52410c5c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:39.145627 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3abd5a-02a6-4b96-8484-5fa52410c5c2 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:39.155156 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1037/2055] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:50:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:50:39.159366 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e6ecc5-0e01-4f29-858e-b00d590e858b admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:39.169556 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e6ecc5-0e01-4f29-858e-b00d590e858b admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:39.174677 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2c0323-0b4d-47fe-9adc-80ff57e68efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:39.175433 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2c0323-0b4d-47fe-9adc-80ff57e68efc admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:39.175711 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2c0323-0b4d-47fe-9adc-80ff57e68efc admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:39.175993 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2c0323-0b4d-47fe-9adc-80ff57e68efc admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:39.176854 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2c0323-0b4d-47fe-9adc-80ff57e68efc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:39.178469 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2c0323-0b4d-47fe-9adc-80ff57e68efc admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:39.190598 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1019/2056] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:50:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:50:39.193480 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2c0323-0b4d-47fe-9adc-80ff57e68efc admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:39.194374 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3abd5a-02a6-4b96-8484-5fa52410c5c2 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:39.195481 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-ab2c0323-0b4d-47fe-9adc-80ff57e68efc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:39.207667 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3abd5a-02a6-4b96-8484-5fa52410c5c2 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:39.213080 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bda2e9f-0d07-4835-8921-e11e7b1f492f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:39.214049 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bda2e9f-0d07-4835-8921-e11e7b1f492f admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:39.214333 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bda2e9f-0d07-4835-8921-e11e7b1f492f admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:39.214645 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bda2e9f-0d07-4835-8921-e11e7b1f492f admin admin] PATH_INFO: `/v3/projects/49e410e554a0461bb8e32d2dba0156bd/users/d90474dc55a4429a91812ec3976b9623/roles/317f725e26bf43648d8235bb1f7c4cb3` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:39.222702 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2c0323-0b4d-47fe-9adc-80ff57e68efc admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:39.228128 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2e8989-f923-499f-ac85-63651b494ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:39.231565 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2e8989-f923-499f-ac85-63651b494ca4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:39.231565 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2e8989-f923-499f-ac85-63651b494ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:39.231565 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2e8989-f923-499f-ac85-63651b494ca4 admin admin] PATH_INFO: `/v3/projects/3b435f0d7f1749c9b2b1e222bc8026b1` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:39.231859 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bda2e9f-0d07-4835-8921-e11e7b1f492f admin admin] RBAC: Authorizing `identity:create_grant(project_id=49e410e554a0461bb8e32d2dba0156bd, user_id=d90474dc55a4429a91812ec3976b9623, role_id=317f725e26bf43648d8235bb1f7c4cb3)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:39.231955 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2e8989-f923-499f-ac85-63651b494ca4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b435f0d7f1749c9b2b1e222bc8026b1)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:39.232608 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2e8989-f923-499f-ac85-63651b494ca4 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:39.232842 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bda2e9f-0d07-4835-8921-e11e7b1f492f admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:39.334606 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1038/2057] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:50:39 2022] PUT /identity/v3/projects/49e410e554a0461bb8e32d2dba0156bd/users/d90474dc55a4429a91812ec3976b9623/roles/317f725e26bf43648d8235bb1f7c4cb3 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 14:50:39.346794 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c9d99d-bda7-4768-a096-7f381f52670f None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:39.347087 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c9d99d-bda7-4768-a096-7f381f52670f None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:39.347368 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c9d99d-bda7-4768-a096-7f381f52670f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:39.375161 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-25c9d99d-bda7-4768-a096-7f381f52670f None None] MFA Rules not processed for user `d90474dc55a4429a91812ec3976b9623`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:50:39.376500 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-25c9d99d-bda7-4768-a096-7f381f52670f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:39.379200 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-3b2e8989-f923-499f-ac85-63651b494ca4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b435f0d7f1749c9b2b1e222bc8026b1', 'request_id': 'req-3b2e8989-f923-499f-ac85-63651b494ca4'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:39.386418 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-3b2e8989-f923-499f-ac85-63651b494ca4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b435f0d7f1749c9b2b1e222bc8026b1', 'request_id': 'req-3b2e8989-f923-499f-ac85-63651b494ca4'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:39.416423 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:39.458063 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1039/2058] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:50:39 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 14:50:39.462070 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c9d99d-bda7-4768-a096-7f381f52670f None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:39.477166 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-3b2e8989-f923-499f-ac85-63651b494ca4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b435f0d7f1749c9b2b1e222bc8026b1', 'request_id': 'req-3b2e8989-f923-499f-ac85-63651b494ca4'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:39.492458 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-3b2e8989-f923-499f-ac85-63651b494ca4 admin admin] The token cache is being invalidate because project 3b435f0d7f1749c9b2b1e222bc8026b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 14:50:39.492662 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-3b2e8989-f923-499f-ac85-63651b494ca4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:39.493382 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-3b2e8989-f923-499f-ac85-63651b494ca4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:39.495289 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1020/2059] 10.222.0.15 () {58 vars in 1232 bytes} [Tue May 31 14:50:39 2022] DELETE /identity/v3/projects/3b435f0d7f1749c9b2b1e222bc8026b1 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:50:39.500622 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcc4a5f-e57e-4e68-9182-157111ec0152 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:39.500850 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcc4a5f-e57e-4e68-9182-157111ec0152 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:39.501107 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcc4a5f-e57e-4e68-9182-157111ec0152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:39.522168 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-efcc4a5f-e57e-4e68-9182-157111ec0152 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:50:39.523841 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-efcc4a5f-e57e-4e68-9182-157111ec0152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:39.532818 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1021/2060] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:50:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:50:39.532927 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c9d99d-bda7-4768-a096-7f381f52670f None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:39.539323 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34837948-0882-4cc6-8121-b5fd0ad557d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:39.539689 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa13eb11-a628-4a92-b6ef-cff5b5b8263b None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:39.539984 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa13eb11-a628-4a92-b6ef-cff5b5b8263b None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:39.540267 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa13eb11-a628-4a92-b6ef-cff5b5b8263b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:39.540580 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34837948-0882-4cc6-8121-b5fd0ad557d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:39.541184 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34837948-0882-4cc6-8121-b5fd0ad557d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:39.541717 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34837948-0882-4cc6-8121-b5fd0ad557d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:39.542511 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34837948-0882-4cc6-8121-b5fd0ad557d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:39.546311 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34837948-0882-4cc6-8121-b5fd0ad557d3 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:39.564591 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-aa13eb11-a628-4a92-b6ef-cff5b5b8263b None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:50:39.566189 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-aa13eb11-a628-4a92-b6ef-cff5b5b8263b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:39.575636 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1022/2061] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:50:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 14:50:39.579738 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa13eb11-a628-4a92-b6ef-cff5b5b8263b None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:39.589694 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa13eb11-a628-4a92-b6ef-cff5b5b8263b None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:39.594658 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94569143-76d0-429f-a7a8-f00ec429479a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:39.595566 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94569143-76d0-429f-a7a8-f00ec429479a admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:39.596047 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94569143-76d0-429f-a7a8-f00ec429479a admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:39.596398 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94569143-76d0-429f-a7a8-f00ec429479a admin admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:39.597199 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94569143-76d0-429f-a7a8-f00ec429479a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:50:39.597509 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94569143-76d0-429f-a7a8-f00ec429479a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:39.599127 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94569143-76d0-429f-a7a8-f00ec429479a admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:39.611114 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1023/2062] 10.222.0.15 () {58 vars in 1152 bytes} [Tue May 31 14:50:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 14:50:39.616077 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94569143-76d0-429f-a7a8-f00ec429479a admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:39.626100 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94569143-76d0-429f-a7a8-f00ec429479a admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:39.630724 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204356c3-33fc-4b63-a5a6-84b7f104500c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:39.631365 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204356c3-33fc-4b63-a5a6-84b7f104500c admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:39.631658 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204356c3-33fc-4b63-a5a6-84b7f104500c admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:39.631929 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204356c3-33fc-4b63-a5a6-84b7f104500c admin admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:39.632609 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204356c3-33fc-4b63-a5a6-84b7f104500c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:39.634484 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204356c3-33fc-4b63-a5a6-84b7f104500c admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:39.666879 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1040/2063] 10.222.0.15 () {60 vars in 1152 bytes} [Tue May 31 14:50:39 2022] POST /identity/v3/projects => generated 381 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 14:50:39.671207 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34837948-0882-4cc6-8121-b5fd0ad557d3 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:39.672826 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-34837948-0882-4cc6-8121-b5fd0ad557d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:39.688874 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:39.742850 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1024/2064] 10.222.0.15 () {60 vars in 1152 bytes} [Tue May 31 14:50:39 2022] POST /identity/v3/projects => generated 377 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 14:50:39.752907 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204356c3-33fc-4b63-a5a6-84b7f104500c admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:39.760633 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34837948-0882-4cc6-8121-b5fd0ad557d3 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:39.823672 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204356c3-33fc-4b63-a5a6-84b7f104500c admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:39.826623 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfd9a6a-d4b0-400e-8dfc-009272f2b5c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:39.827303 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfd9a6a-d4b0-400e-8dfc-009272f2b5c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:39.827592 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfd9a6a-d4b0-400e-8dfc-009272f2b5c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:39.827869 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfd9a6a-d4b0-400e-8dfc-009272f2b5c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:39.828573 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfd9a6a-d4b0-400e-8dfc-009272f2b5c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:39.828996 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8600aebd-b3dd-41ae-94dc-78509d1365b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:39.830296 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8600aebd-b3dd-41ae-94dc-78509d1365b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:39.830296 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8600aebd-b3dd-41ae-94dc-78509d1365b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:39.830296 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8600aebd-b3dd-41ae-94dc-78509d1365b6 admin admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:39.830809 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfd9a6a-d4b0-400e-8dfc-009272f2b5c3 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:39.831016 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8600aebd-b3dd-41ae-94dc-78509d1365b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:39.832978 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8600aebd-b3dd-41ae-94dc-78509d1365b6 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:39.917213 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1025/2065] 10.222.0.15 () {60 vars in 1143 bytes} [Tue May 31 14:50:39 2022] POST /identity/v3/users => generated 289 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:50:39.921771 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8600aebd-b3dd-41ae-94dc-78509d1365b6 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:39.931498 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8600aebd-b3dd-41ae-94dc-78509d1365b6 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:39.936144 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5596267-afa1-444f-a39e-2478851184f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:39.936780 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5596267-afa1-444f-a39e-2478851184f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:39.937066 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5596267-afa1-444f-a39e-2478851184f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:39.937346 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5596267-afa1-444f-a39e-2478851184f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:39.938083 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5596267-afa1-444f-a39e-2478851184f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:39.939695 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5596267-afa1-444f-a39e-2478851184f5 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:39.949390 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1026/2066] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:50:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 14:50:39.953108 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5596267-afa1-444f-a39e-2478851184f5 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:39.963305 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5596267-afa1-444f-a39e-2478851184f5 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:39.964644 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1041/2067] 10.222.0.15 () {60 vars in 1143 bytes} [Tue May 31 14:50:39 2022] POST /identity/v3/users => generated 297 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 14:50:39.968603 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfd9a6a-d4b0-400e-8dfc-009272f2b5c3 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:39.969137 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be64a51-9bdd-4dbc-9468-b174d1c594ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:39.969874 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be64a51-9bdd-4dbc-9468-b174d1c594ac admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:39.970166 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be64a51-9bdd-4dbc-9468-b174d1c594ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:39.970436 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be64a51-9bdd-4dbc-9468-b174d1c594ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:39.971232 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be64a51-9bdd-4dbc-9468-b174d1c594ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:39.972858 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be64a51-9bdd-4dbc-9468-b174d1c594ac admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:39.978480 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfd9a6a-d4b0-400e-8dfc-009272f2b5c3 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:39.983707 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a920d47-2834-4058-baa8-746c784510f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:39.984449 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1027/2068] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:50:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 14:50:39.984590 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a920d47-2834-4058-baa8-746c784510f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:39.984748 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a920d47-2834-4058-baa8-746c784510f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:39.985113 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a920d47-2834-4058-baa8-746c784510f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:39.985846 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a920d47-2834-4058-baa8-746c784510f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:39.987584 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a920d47-2834-4058-baa8-746c784510f1 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:39.988508 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be64a51-9bdd-4dbc-9468-b174d1c594ac admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:39.998146 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be64a51-9bdd-4dbc-9468-b174d1c594ac admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:39.998326 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1042/2069] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:50:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 14:50:40.002919 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb18d750-efcb-4699-bf08-b357e473b270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:40.003798 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb18d750-efcb-4699-bf08-b357e473b270 admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:40.004082 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb18d750-efcb-4699-bf08-b357e473b270 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:40.004360 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb18d750-efcb-4699-bf08-b357e473b270 admin admin] PATH_INFO: `/v3/projects/8f23bf2550564e11b34fdccd23ffddd8/users/e93010e18fbe42abbccbec85c1e56547/roles/317f725e26bf43648d8235bb1f7c4cb3` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:40.004544 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a920d47-2834-4058-baa8-746c784510f1 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:40.014331 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a920d47-2834-4058-baa8-746c784510f1 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:40.019180 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e530ba-be40-4241-a7f6-9f47d62e68fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:40.019421 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb18d750-efcb-4699-bf08-b357e473b270 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f23bf2550564e11b34fdccd23ffddd8, user_id=e93010e18fbe42abbccbec85c1e56547, role_id=317f725e26bf43648d8235bb1f7c4cb3)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:40.020045 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e530ba-be40-4241-a7f6-9f47d62e68fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:40.020326 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e530ba-be40-4241-a7f6-9f47d62e68fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:40.020603 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e530ba-be40-4241-a7f6-9f47d62e68fe admin admin] PATH_INFO: `/v3/projects/d404662d40554ac6afca7037aadf30e8/users/5d52adc7fcc7459c9b32a44f49c19bd7/roles/76c53e2c353644f885028a0226c06146` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:40.022074 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb18d750-efcb-4699-bf08-b357e473b270 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:40.036788 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e530ba-be40-4241-a7f6-9f47d62e68fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=d404662d40554ac6afca7037aadf30e8, user_id=5d52adc7fcc7459c9b32a44f49c19bd7, role_id=76c53e2c353644f885028a0226c06146)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:40.039506 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e530ba-be40-4241-a7f6-9f47d62e68fe admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:40.134869 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1028/2070] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:50:39 2022] PUT /identity/v3/projects/8f23bf2550564e11b34fdccd23ffddd8/users/e93010e18fbe42abbccbec85c1e56547/roles/317f725e26bf43648d8235bb1f7c4cb3 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 14:50:40.150424 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe6d96-2282-4e96-add8-4863a463d746 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:40.150787 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe6d96-2282-4e96-add8-4863a463d746 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:40.151089 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe6d96-2282-4e96-add8-4863a463d746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:40.163216 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1043/2071] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:50:40 2022] PUT /identity/v3/projects/d404662d40554ac6afca7037aadf30e8/users/5d52adc7fcc7459c9b32a44f49c19bd7/roles/76c53e2c353644f885028a0226c06146 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 14:50:40.174285 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e530ba-be40-4241-a7f6-9f47d62e68fe admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:40.182697 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-d2fe6d96-2282-4e96-add8-4863a463d746 None None] MFA Rules not processed for user `e93010e18fbe42abbccbec85c1e56547`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:50:40.183985 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-d2fe6d96-2282-4e96-add8-4863a463d746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:40.236190 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e530ba-be40-4241-a7f6-9f47d62e68fe admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:40.241032 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ee517c-3958-4c37-9a7d-504ace248b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:40.246920 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee517c-3958-4c37-9a7d-504ace248b00 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:40.247735 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee517c-3958-4c37-9a7d-504ace248b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:40.247735 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee517c-3958-4c37-9a7d-504ace248b00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:40.248447 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ee517c-3958-4c37-9a7d-504ace248b00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:40.250228 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ee517c-3958-4c37-9a7d-504ace248b00 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:40.252110 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1029/2072] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:50:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 14:50:40.265261 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1044/2073] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:50:40 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 14:50:40.268219 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fe6d96-2282-4e96-add8-4863a463d746 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:40.273247 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ee517c-3958-4c37-9a7d-504ace248b00 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:40.275296 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-67ee517c-3958-4c37-9a7d-504ace248b00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:40.292844 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fe6d96-2282-4e96-add8-4863a463d746 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:40.301405 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc353383-f552-4887-85e6-6ed17dfa34be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:40.302885 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc353383-f552-4887-85e6-6ed17dfa34be admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:40.302885 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc353383-f552-4887-85e6-6ed17dfa34be admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:40.303330 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc353383-f552-4887-85e6-6ed17dfa34be admin admin] PATH_INFO: `/v3/projects/d404662d40554ac6afca7037aadf30e8/users/5d52adc7fcc7459c9b32a44f49c19bd7/roles/76c53e2c353644f885028a0226c06146` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:40.305518 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc353383-f552-4887-85e6-6ed17dfa34be admin admin] RBAC: Authorizing `identity:create_grant(project_id=d404662d40554ac6afca7037aadf30e8, user_id=5d52adc7fcc7459c9b32a44f49c19bd7, role_id=76c53e2c353644f885028a0226c06146)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:40.308534 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc353383-f552-4887-85e6-6ed17dfa34be admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:40.319339 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1030/2074] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:50:40 2022] PUT /identity/v3/projects/d404662d40554ac6afca7037aadf30e8/users/5d52adc7fcc7459c9b32a44f49c19bd7/roles/76c53e2c353644f885028a0226c06146 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:50:40.331231 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89252adb-cb04-413e-8e43-5e7f103970c2 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:40.331544 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89252adb-cb04-413e-8e43-5e7f103970c2 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:40.332071 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89252adb-cb04-413e-8e43-5e7f103970c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:40.339946 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ee517c-3958-4c37-9a7d-504ace248b00 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:40.358534 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-89252adb-cb04-413e-8e43-5e7f103970c2 None None] MFA Rules not processed for user `5d52adc7fcc7459c9b32a44f49c19bd7`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:50:40.359752 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-89252adb-cb04-413e-8e43-5e7f103970c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:40.389710 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4a3b20-76f4-4bcd-81b9-14a2e9bc6b12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afbf718dcd9b4741a926b0a2321bd53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:40.390378 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4a3b20-76f4-4bcd-81b9-14a2e9bc6b12 service cinder] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:40.390731 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4a3b20-76f4-4bcd-81b9-14a2e9bc6b12 service cinder] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:40.391001 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4a3b20-76f4-4bcd-81b9-14a2e9bc6b12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:40.433565 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1031/2075] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:50:40 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 14:50:40.444581 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89252adb-cb04-413e-8e43-5e7f103970c2 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:40.446260 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-89252adb-cb04-413e-8e43-5e7f103970c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:40.454598 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4a3b20-76f4-4bcd-81b9-14a2e9bc6b12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:40.456237 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4a3b20-76f4-4bcd-81b9-14a2e9bc6b12 service cinder] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:40.458713 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89252adb-cb04-413e-8e43-5e7f103970c2 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:40.462348 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc168c4b-5d01-4b13-bc95-17077440e933 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afbf718dcd9b4741a926b0a2321bd53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:40.463023 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc168c4b-5d01-4b13-bc95-17077440e933 service cinder] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:40.465928 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc168c4b-5d01-4b13-bc95-17077440e933 service cinder] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:40.465928 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc168c4b-5d01-4b13-bc95-17077440e933 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:40.466274 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1045/2076] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:50:40 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 14:50:40.473655 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc168c4b-5d01-4b13-bc95-17077440e933 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:40.475266 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc168c4b-5d01-4b13-bc95-17077440e933 service cinder] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:40.485134 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1032/2077] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:50:40 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 14:50:40.711351 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:40.857454 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:41.049997 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:41.263174 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4a3b20-76f4-4bcd-81b9-14a2e9bc6b12 service cinder] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:41.264699 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-4f4a3b20-76f4-4bcd-81b9-14a2e9bc6b12 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:41.339494 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4a3b20-76f4-4bcd-81b9-14a2e9bc6b12 service cinder] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:41.344707 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b415681-4c76-465a-ab19-de3ff5bdddcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:41.345656 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b415681-4c76-465a-ab19-de3ff5bdddcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:41.345951 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b415681-4c76-465a-ab19-de3ff5bdddcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:41.346737 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b415681-4c76-465a-ab19-de3ff5bdddcc admin admin] PATH_INFO: `/v3/users/5c87ed83c37f4072933055dc82191040` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:41.347584 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b415681-4c76-465a-ab19-de3ff5bdddcc admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c87ed83c37f4072933055dc82191040)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:41.349542 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b415681-4c76-465a-ab19-de3ff5bdddcc admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:41.549162 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc168c4b-5d01-4b13-bc95-17077440e933 service cinder] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:41.560038 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc168c4b-5d01-4b13-bc95-17077440e933 service cinder] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:41.564812 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530f6e44-149f-4ff1-83b8-421ca092d8f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:41.565681 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530f6e44-149f-4ff1-83b8-421ca092d8f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:41.566100 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530f6e44-149f-4ff1-83b8-421ca092d8f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:41.566377 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530f6e44-149f-4ff1-83b8-421ca092d8f1 admin admin] PATH_INFO: `/v3/users/d90474dc55a4429a91812ec3976b9623` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:41.567621 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530f6e44-149f-4ff1-83b8-421ca092d8f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d90474dc55a4429a91812ec3976b9623)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:41.569600 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530f6e44-149f-4ff1-83b8-421ca092d8f1 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:41.573072 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-0b415681-4c76-465a-ab19-de3ff5bdddcc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c87ed83c37f4072933055dc82191040'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:41.574314 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:41.699671 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-0b415681-4c76-465a-ab19-de3ff5bdddcc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c87ed83c37f4072933055dc82191040'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:41.700553 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-0b415681-4c76-465a-ab19-de3ff5bdddcc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c87ed83c37f4072933055dc82191040'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:41.708508 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-0b415681-4c76-465a-ab19-de3ff5bdddcc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c87ed83c37f4072933055dc82191040'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:41.709156 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-0b415681-4c76-465a-ab19-de3ff5bdddcc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c87ed83c37f4072933055dc82191040'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:41.728656 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1046/2078] 10.222.0.15 () {58 vars in 1223 bytes} [Tue May 31 14:50:41 2022] DELETE /identity/v3/users/5c87ed83c37f4072933055dc82191040 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:50:41.732784 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20abc61-10f7-4459-9432-d15eb874613c None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:41.733090 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20abc61-10f7-4459-9432-d15eb874613c None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:41.733370 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20abc61-10f7-4459-9432-d15eb874613c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:41.750335 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-b20abc61-10f7-4459-9432-d15eb874613c None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:50:41.751554 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-b20abc61-10f7-4459-9432-d15eb874613c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:41.792041 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:41.808695 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1047/2079] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:50:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 14:50:41.819062 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20abc61-10f7-4459-9432-d15eb874613c None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:41.820425 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-b20abc61-10f7-4459-9432-d15eb874613c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:41.862991 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-530f6e44-149f-4ff1-83b8-421ca092d8f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd90474dc55a4429a91812ec3976b9623'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:41.870310 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-530f6e44-149f-4ff1-83b8-421ca092d8f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd90474dc55a4429a91812ec3976b9623'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:41.871773 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-530f6e44-149f-4ff1-83b8-421ca092d8f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd90474dc55a4429a91812ec3976b9623'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:41.872973 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-530f6e44-149f-4ff1-83b8-421ca092d8f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd90474dc55a4429a91812ec3976b9623'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:41.876511 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20abc61-10f7-4459-9432-d15eb874613c None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:41.880411 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a74a70-8a88-414c-bf4e-7fd8684351a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:41.881057 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a74a70-8a88-414c-bf4e-7fd8684351a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:41.881337 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a74a70-8a88-414c-bf4e-7fd8684351a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:41.881606 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a74a70-8a88-414c-bf4e-7fd8684351a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:41.883474 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-27a74a70-8a88-414c-bf4e-7fd8684351a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:41.886109 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-530f6e44-149f-4ff1-83b8-421ca092d8f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd90474dc55a4429a91812ec3976b9623'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:41.895868 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a74a70-8a88-414c-bf4e-7fd8684351a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:41.897307 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a74a70-8a88-414c-bf4e-7fd8684351a6 service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:41.907514 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1048/2080] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:50:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 14:50:42.031776 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1033/2081] 10.222.0.15 () {58 vars in 1223 bytes} [Tue May 31 14:50:41 2022] DELETE /identity/v3/users/d90474dc55a4429a91812ec3976b9623 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 14:50:42.036420 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11203a9d-cfde-4499-999f-7150d806e3cc None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:42.036711 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11203a9d-cfde-4499-999f-7150d806e3cc None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:42.036991 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11203a9d-cfde-4499-999f-7150d806e3cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:42.054790 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-11203a9d-cfde-4499-999f-7150d806e3cc None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:50:42.055914 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-11203a9d-cfde-4499-999f-7150d806e3cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:42.120544 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1049/2082] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:50:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:50:42.174155 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530f6e44-149f-4ff1-83b8-421ca092d8f1 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:42.175646 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-530f6e44-149f-4ff1-83b8-421ca092d8f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:42.192464 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11203a9d-cfde-4499-999f-7150d806e3cc None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:42.192464 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-11203a9d-cfde-4499-999f-7150d806e3cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:42.215626 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530f6e44-149f-4ff1-83b8-421ca092d8f1 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:42.229100 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fab025-a952-4058-bbbf-34ec7ee1284c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:42.230352 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fab025-a952-4058-bbbf-34ec7ee1284c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:42.230904 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fab025-a952-4058-bbbf-34ec7ee1284c admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:42.230904 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fab025-a952-4058-bbbf-34ec7ee1284c admin admin] PATH_INFO: `/v3/users/76afe593701f4ff0b73660e7622eca69` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:42.232729 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fab025-a952-4058-bbbf-34ec7ee1284c admin admin] RBAC: Authorizing `identity:delete_user(user_id=76afe593701f4ff0b73660e7622eca69)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:42.234714 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fab025-a952-4058-bbbf-34ec7ee1284c admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:42.278650 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11203a9d-cfde-4499-999f-7150d806e3cc None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:42.286214 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd657b7-3286-4c8a-ba46-ae071db5d8a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:42.287154 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd657b7-3286-4c8a-ba46-ae071db5d8a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:42.287641 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd657b7-3286-4c8a-ba46-ae071db5d8a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:42.288070 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd657b7-3286-4c8a-ba46-ae071db5d8a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:42.312720 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd657b7-3286-4c8a-ba46-ae071db5d8a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:42.314456 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd657b7-3286-4c8a-ba46-ae071db5d8a0 service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:42.324676 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1050/2083] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:50:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:50:42.325583 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd657b7-3286-4c8a-ba46-ae071db5d8a0 service neutron] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:42.327608 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-3dd657b7-3286-4c8a-ba46-ae071db5d8a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:42.340520 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd657b7-3286-4c8a-ba46-ae071db5d8a0 service neutron] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:42.345390 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8f0061-8e76-41ae-a7b7-e206819c8263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:42.346270 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8f0061-8e76-41ae-a7b7-e206819c8263 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:42.346574 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8f0061-8e76-41ae-a7b7-e206819c8263 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:42.353582 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8f0061-8e76-41ae-a7b7-e206819c8263 admin admin] PATH_INFO: `/v3/users/bfc7559a4b8c4449b0513f5b7a7e9211` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:42.353582 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8f0061-8e76-41ae-a7b7-e206819c8263 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfc7559a4b8c4449b0513f5b7a7e9211)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:42.353582 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8f0061-8e76-41ae-a7b7-e206819c8263 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:42.461623 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:42.502066 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-26fab025-a952-4058-bbbf-34ec7ee1284c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76afe593701f4ff0b73660e7622eca69'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:42.509871 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-26fab025-a952-4058-bbbf-34ec7ee1284c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76afe593701f4ff0b73660e7622eca69'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:42.511004 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-26fab025-a952-4058-bbbf-34ec7ee1284c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76afe593701f4ff0b73660e7622eca69'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:42.511706 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-26fab025-a952-4058-bbbf-34ec7ee1284c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76afe593701f4ff0b73660e7622eca69'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:42.524107 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-26fab025-a952-4058-bbbf-34ec7ee1284c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76afe593701f4ff0b73660e7622eca69'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:42.559295 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-4f8f0061-8e76-41ae-a7b7-e206819c8263 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfc7559a4b8c4449b0513f5b7a7e9211'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:42.629032 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1034/2084] 10.222.0.15 () {58 vars in 1223 bytes} [Tue May 31 14:50:42 2022] DELETE /identity/v3/users/76afe593701f4ff0b73660e7622eca69 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:50:42.629032 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fab025-a952-4058-bbbf-34ec7ee1284c admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:42.633446 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-26fab025-a952-4058-bbbf-34ec7ee1284c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:42.707366 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:42.712593 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fab025-a952-4058-bbbf-34ec7ee1284c admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:42.717502 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a88d6c9-d356-4be0-a484-a13726a6593f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:42.718376 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88d6c9-d356-4be0-a484-a13726a6593f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:42.718697 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88d6c9-d356-4be0-a484-a13726a6593f admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:42.718982 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88d6c9-d356-4be0-a484-a13726a6593f admin admin] PATH_INFO: `/v3/projects/be1022533b9d42d38f7cccf2a0f7eeff` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:42.720183 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a88d6c9-d356-4be0-a484-a13726a6593f admin admin] RBAC: Authorizing `identity:delete_project(project_id=be1022533b9d42d38f7cccf2a0f7eeff)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:42.722654 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a88d6c9-d356-4be0-a484-a13726a6593f admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:42.723813 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-4f8f0061-8e76-41ae-a7b7-e206819c8263 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfc7559a4b8c4449b0513f5b7a7e9211'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:42.724833 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-4f8f0061-8e76-41ae-a7b7-e206819c8263 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfc7559a4b8c4449b0513f5b7a7e9211'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:42.737499 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-4f8f0061-8e76-41ae-a7b7-e206819c8263 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfc7559a4b8c4449b0513f5b7a7e9211'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:42.741052 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-4f8f0061-8e76-41ae-a7b7-e206819c8263 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfc7559a4b8c4449b0513f5b7a7e9211'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:42.761177 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1051/2085] 10.222.0.15 () {58 vars in 1223 bytes} [Tue May 31 14:50:42 2022] DELETE /identity/v3/users/bfc7559a4b8c4449b0513f5b7a7e9211 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:50:42.762836 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2b2c2c-13a3-47f6-9251-f26fdf82e2e1 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:42.763158 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2b2c2c-13a3-47f6-9251-f26fdf82e2e1 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:42.763466 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2b2c2c-13a3-47f6-9251-f26fdf82e2e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:42.780983 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-dc2b2c2c-13a3-47f6-9251-f26fdf82e2e1 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:50:42.782178 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-dc2b2c2c-13a3-47f6-9251-f26fdf82e2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:42.839156 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1052/2086] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:50:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:50:42.840371 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe6494-d5bc-4966-9b4e-a7d7ed8730b7 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:42.840657 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe6494-d5bc-4966-9b4e-a7d7ed8730b7 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:42.840934 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe6494-d5bc-4966-9b4e-a7d7ed8730b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:42.859101 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-50fe6494-d5bc-4966-9b4e-a7d7ed8730b7 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:50:42.860284 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-50fe6494-d5bc-4966-9b4e-a7d7ed8730b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:42.869032 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1053/2087] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:50:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:50:42.872215 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fe6494-d5bc-4966-9b4e-a7d7ed8730b7 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:42.872215 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-50fe6494-d5bc-4966-9b4e-a7d7ed8730b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:42.890419 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-1a88d6c9-d356-4be0-a484-a13726a6593f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be1022533b9d42d38f7cccf2a0f7eeff', 'request_id': 'req-1a88d6c9-d356-4be0-a484-a13726a6593f'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:42.897530 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-1a88d6c9-d356-4be0-a484-a13726a6593f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be1022533b9d42d38f7cccf2a0f7eeff', 'request_id': 'req-1a88d6c9-d356-4be0-a484-a13726a6593f'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:42.937562 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fe6494-d5bc-4966-9b4e-a7d7ed8730b7 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:42.962900 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-1a88d6c9-d356-4be0-a484-a13726a6593f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be1022533b9d42d38f7cccf2a0f7eeff', 'request_id': 'req-1a88d6c9-d356-4be0-a484-a13726a6593f'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:42.976733 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-1a88d6c9-d356-4be0-a484-a13726a6593f admin admin] The token cache is being invalidate because project be1022533b9d42d38f7cccf2a0f7eeff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 14:50:42.978765 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-1a88d6c9-d356-4be0-a484-a13726a6593f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:42.979461 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-1a88d6c9-d356-4be0-a484-a13726a6593f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:42.981119 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1035/2088] 10.222.0.15 () {58 vars in 1232 bytes} [Tue May 31 14:50:42 2022] DELETE /identity/v3/projects/be1022533b9d42d38f7cccf2a0f7eeff => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:50:42.982025 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a88d6c9-d356-4be0-a484-a13726a6593f admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:42.984106 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-1a88d6c9-d356-4be0-a484-a13726a6593f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:42.989442 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cfe477-c2c0-496e-b0b5-4f2180a44fe6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:42.990085 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cfe477-c2c0-496e-b0b5-4f2180a44fe6 service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:42.990370 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cfe477-c2c0-496e-b0b5-4f2180a44fe6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:42.990672 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cfe477-c2c0-496e-b0b5-4f2180a44fe6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:42.992486 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-f5cfe477-c2c0-496e-b0b5-4f2180a44fe6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:43.050177 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a88d6c9-d356-4be0-a484-a13726a6593f admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:43.055802 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926c887a-534e-402c-9ac9-c0b2037338ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:43.056318 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cfe477-c2c0-496e-b0b5-4f2180a44fe6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:43.056915 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926c887a-534e-402c-9ac9-c0b2037338ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:43.057298 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926c887a-534e-402c-9ac9-c0b2037338ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:43.057672 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926c887a-534e-402c-9ac9-c0b2037338ef admin admin] PATH_INFO: `/v3/projects/49e410e554a0461bb8e32d2dba0156bd` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:43.057785 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cfe477-c2c0-496e-b0b5-4f2180a44fe6 service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:43.059221 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926c887a-534e-402c-9ac9-c0b2037338ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=49e410e554a0461bb8e32d2dba0156bd)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:43.061258 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926c887a-534e-402c-9ac9-c0b2037338ef admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:43.074736 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1054/2089] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:50:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:50:43.076086 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cfe477-c2c0-496e-b0b5-4f2180a44fe6 service neutron] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:43.077571 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-f5cfe477-c2c0-496e-b0b5-4f2180a44fe6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:43.090528 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cfe477-c2c0-496e-b0b5-4f2180a44fe6 service neutron] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:43.094979 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:43.096879 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234a70eb-1aa9-42d2-b6b6-0add76f736a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:43.097540 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a70eb-1aa9-42d2-b6b6-0add76f736a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:43.097869 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a70eb-1aa9-42d2-b6b6-0add76f736a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:43.098240 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a70eb-1aa9-42d2-b6b6-0add76f736a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:43.100150 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-234a70eb-1aa9-42d2-b6b6-0add76f736a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:43.115464 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234a70eb-1aa9-42d2-b6b6-0add76f736a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:43.115464 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234a70eb-1aa9-42d2-b6b6-0add76f736a9 service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:43.124379 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1055/2090] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:50:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:50:43.125172 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234a70eb-1aa9-42d2-b6b6-0add76f736a9 service neutron] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:43.126428 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-234a70eb-1aa9-42d2-b6b6-0add76f736a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:43.138135 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234a70eb-1aa9-42d2-b6b6-0add76f736a9 service neutron] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:43.143542 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb2c3eb-e3b9-4be4-b380-96ed0d850630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:43.144519 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb2c3eb-e3b9-4be4-b380-96ed0d850630 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:43.144798 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb2c3eb-e3b9-4be4-b380-96ed0d850630 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:43.145079 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb2c3eb-e3b9-4be4-b380-96ed0d850630 admin admin] PATH_INFO: `/v3/users/122fb6defa8b49b08843dbf6f9c67312` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:43.146325 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb2c3eb-e3b9-4be4-b380-96ed0d850630 admin admin] RBAC: Authorizing `identity:delete_user(user_id=122fb6defa8b49b08843dbf6f9c67312)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:43.148279 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb2c3eb-e3b9-4be4-b380-96ed0d850630 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:43.178609 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-926c887a-534e-402c-9ac9-c0b2037338ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49e410e554a0461bb8e32d2dba0156bd', 'request_id': 'req-926c887a-534e-402c-9ac9-c0b2037338ef'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:43.185356 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-926c887a-534e-402c-9ac9-c0b2037338ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49e410e554a0461bb8e32d2dba0156bd', 'request_id': 'req-926c887a-534e-402c-9ac9-c0b2037338ef'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:43.248639 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-926c887a-534e-402c-9ac9-c0b2037338ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49e410e554a0461bb8e32d2dba0156bd', 'request_id': 'req-926c887a-534e-402c-9ac9-c0b2037338ef'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:43.260021 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-926c887a-534e-402c-9ac9-c0b2037338ef admin admin] The token cache is being invalidate because project 49e410e554a0461bb8e32d2dba0156bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 14:50:43.260424 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-926c887a-534e-402c-9ac9-c0b2037338ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:43.261152 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-926c887a-534e-402c-9ac9-c0b2037338ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:43.266485 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1036/2091] 10.222.0.15 () {58 vars in 1232 bytes} [Tue May 31 14:50:42 2022] DELETE /identity/v3/projects/49e410e554a0461bb8e32d2dba0156bd => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:50:43.267528 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926c887a-534e-402c-9ac9-c0b2037338ef admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:43.268919 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-926c887a-534e-402c-9ac9-c0b2037338ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:43.313719 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-dcb2c3eb-e3b9-4be4-b380-96ed0d850630 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '122fb6defa8b49b08843dbf6f9c67312'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:43.322003 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:43.360558 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926c887a-534e-402c-9ac9-c0b2037338ef admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:43.366479 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a4a8e4-c790-4e50-abb3-f6941ebeb707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:43.370135 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4a8e4-c790-4e50-abb3-f6941ebeb707 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:43.370135 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4a8e4-c790-4e50-abb3-f6941ebeb707 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:43.370135 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4a8e4-c790-4e50-abb3-f6941ebeb707 admin admin] PATH_INFO: `/v3/users/5d52adc7fcc7459c9b32a44f49c19bd7` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:43.370135 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a4a8e4-c790-4e50-abb3-f6941ebeb707 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d52adc7fcc7459c9b32a44f49c19bd7)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:43.371735 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a4a8e4-c790-4e50-abb3-f6941ebeb707 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:43.411186 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-dcb2c3eb-e3b9-4be4-b380-96ed0d850630 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '122fb6defa8b49b08843dbf6f9c67312'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:43.411186 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-dcb2c3eb-e3b9-4be4-b380-96ed0d850630 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '122fb6defa8b49b08843dbf6f9c67312'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:43.418134 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-dcb2c3eb-e3b9-4be4-b380-96ed0d850630 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '122fb6defa8b49b08843dbf6f9c67312'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:43.418987 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-dcb2c3eb-e3b9-4be4-b380-96ed0d850630 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '122fb6defa8b49b08843dbf6f9c67312'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:43.437365 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1056/2092] 10.222.0.15 () {58 vars in 1223 bytes} [Tue May 31 14:50:43 2022] DELETE /identity/v3/users/122fb6defa8b49b08843dbf6f9c67312 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:50:43.577943 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-f7a4a8e4-c790-4e50-abb3-f6941ebeb707 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d52adc7fcc7459c9b32a44f49c19bd7'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:43.584976 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-f7a4a8e4-c790-4e50-abb3-f6941ebeb707 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d52adc7fcc7459c9b32a44f49c19bd7'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:43.585726 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-f7a4a8e4-c790-4e50-abb3-f6941ebeb707 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d52adc7fcc7459c9b32a44f49c19bd7'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:43.586348 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-f7a4a8e4-c790-4e50-abb3-f6941ebeb707 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d52adc7fcc7459c9b32a44f49c19bd7'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:43.600446 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-f7a4a8e4-c790-4e50-abb3-f6941ebeb707 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d52adc7fcc7459c9b32a44f49c19bd7'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:43.628682 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb2c3eb-e3b9-4be4-b380-96ed0d850630 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:43.630134 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-dcb2c3eb-e3b9-4be4-b380-96ed0d850630 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:43.695505 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1037/2093] 10.222.0.15 () {58 vars in 1223 bytes} [Tue May 31 14:50:43 2022] DELETE /identity/v3/users/5d52adc7fcc7459c9b32a44f49c19bd7 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 14:50:43.699187 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a4a8e4-c790-4e50-abb3-f6941ebeb707 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:43.703688 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-f7a4a8e4-c790-4e50-abb3-f6941ebeb707 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:43.719794 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb2c3eb-e3b9-4be4-b380-96ed0d850630 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:43.742296 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:43.806910 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18594f62-ae09-4423-a52f-9a2050d2311f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:43.807852 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18594f62-ae09-4423-a52f-9a2050d2311f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:43.808146 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18594f62-ae09-4423-a52f-9a2050d2311f admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:43.808552 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18594f62-ae09-4423-a52f-9a2050d2311f admin admin] PATH_INFO: `/v3/projects/79d80f978ac24af083ebabc052f34f4c` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:43.810207 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18594f62-ae09-4423-a52f-9a2050d2311f admin admin] RBAC: Authorizing `identity:delete_project(project_id=79d80f978ac24af083ebabc052f34f4c)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:43.813007 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18594f62-ae09-4423-a52f-9a2050d2311f admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:43.838643 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a4a8e4-c790-4e50-abb3-f6941ebeb707 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:43.845126 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db72009f-f4f0-40c9-835b-76ba72cd6997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:43.846256 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db72009f-f4f0-40c9-835b-76ba72cd6997 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:43.846579 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db72009f-f4f0-40c9-835b-76ba72cd6997 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:43.846861 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db72009f-f4f0-40c9-835b-76ba72cd6997 admin admin] PATH_INFO: `/v3/projects/6cdab2d3fc5944aca688265d2bfcc7ba` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:43.848214 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db72009f-f4f0-40c9-835b-76ba72cd6997 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cdab2d3fc5944aca688265d2bfcc7ba)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:43.851097 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db72009f-f4f0-40c9-835b-76ba72cd6997 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:43.959171 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-18594f62-ae09-4423-a52f-9a2050d2311f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79d80f978ac24af083ebabc052f34f4c', 'request_id': 'req-18594f62-ae09-4423-a52f-9a2050d2311f'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:44.023359 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-db72009f-f4f0-40c9-835b-76ba72cd6997 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cdab2d3fc5944aca688265d2bfcc7ba', 'request_id': 'req-db72009f-f4f0-40c9-835b-76ba72cd6997'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:44.031462 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-db72009f-f4f0-40c9-835b-76ba72cd6997 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cdab2d3fc5944aca688265d2bfcc7ba', 'request_id': 'req-db72009f-f4f0-40c9-835b-76ba72cd6997'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:44.040635 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-18594f62-ae09-4423-a52f-9a2050d2311f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79d80f978ac24af083ebabc052f34f4c', 'request_id': 'req-18594f62-ae09-4423-a52f-9a2050d2311f'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:44.058865 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-18594f62-ae09-4423-a52f-9a2050d2311f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79d80f978ac24af083ebabc052f34f4c', 'request_id': 'req-18594f62-ae09-4423-a52f-9a2050d2311f'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:44.067711 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-18594f62-ae09-4423-a52f-9a2050d2311f admin admin] The token cache is being invalidate because project 79d80f978ac24af083ebabc052f34f4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80503) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 14:50:44.068177 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-18594f62-ae09-4423-a52f-9a2050d2311f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:44.068858 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-18594f62-ae09-4423-a52f-9a2050d2311f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:44.070493 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1057/2094] 10.222.0.15 () {58 vars in 1232 bytes} [Tue May 31 14:50:43 2022] DELETE /identity/v3/projects/79d80f978ac24af083ebabc052f34f4c => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 14:50:44.073751 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18594f62-ae09-4423-a52f-9a2050d2311f admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:44.073751 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-18594f62-ae09-4423-a52f-9a2050d2311f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:44.141151 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18594f62-ae09-4423-a52f-9a2050d2311f admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:44.162760 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-db72009f-f4f0-40c9-835b-76ba72cd6997 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cdab2d3fc5944aca688265d2bfcc7ba', 'request_id': 'req-db72009f-f4f0-40c9-835b-76ba72cd6997'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:44.174073 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-db72009f-f4f0-40c9-835b-76ba72cd6997 admin admin] The token cache is being invalidate because project 6cdab2d3fc5944aca688265d2bfcc7ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 14:50:44.174363 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-db72009f-f4f0-40c9-835b-76ba72cd6997 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:44.175048 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-db72009f-f4f0-40c9-835b-76ba72cd6997 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:44.176892 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1038/2095] 10.222.0.15 () {58 vars in 1232 bytes} [Tue May 31 14:50:43 2022] DELETE /identity/v3/projects/6cdab2d3fc5944aca688265d2bfcc7ba => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:50:44.179389 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db72009f-f4f0-40c9-835b-76ba72cd6997 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:44.182225 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-db72009f-f4f0-40c9-835b-76ba72cd6997 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:44.199610 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2121d6c0-8c48-4c14-8132-c99ea588852c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:44.200886 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2121d6c0-8c48-4c14-8132-c99ea588852c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:44.201069 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2121d6c0-8c48-4c14-8132-c99ea588852c admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:44.201428 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2121d6c0-8c48-4c14-8132-c99ea588852c admin admin] PATH_INFO: `/v3/projects/e46eec614a0b4be39df20f564e8f0fe1` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:44.203880 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2121d6c0-8c48-4c14-8132-c99ea588852c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e46eec614a0b4be39df20f564e8f0fe1)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:44.206636 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2121d6c0-8c48-4c14-8132-c99ea588852c admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:44.278568 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db72009f-f4f0-40c9-835b-76ba72cd6997 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:44.281179 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:44.299466 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8400ae-5428-4b29-9e49-dad57836c7cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:44.300614 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8400ae-5428-4b29-9e49-dad57836c7cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:44.300914 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8400ae-5428-4b29-9e49-dad57836c7cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:44.301172 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8400ae-5428-4b29-9e49-dad57836c7cb admin admin] PATH_INFO: `/v3/users/5d1ac0295d81410caa1a66345973876b` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:44.302661 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8400ae-5428-4b29-9e49-dad57836c7cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d1ac0295d81410caa1a66345973876b)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:44.307970 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8400ae-5428-4b29-9e49-dad57836c7cb admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:44.326006 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-2121d6c0-8c48-4c14-8132-c99ea588852c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e46eec614a0b4be39df20f564e8f0fe1', 'request_id': 'req-2121d6c0-8c48-4c14-8132-c99ea588852c'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:44.374630 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-2121d6c0-8c48-4c14-8132-c99ea588852c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e46eec614a0b4be39df20f564e8f0fe1', 'request_id': 'req-2121d6c0-8c48-4c14-8132-c99ea588852c'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:44.381060 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-2121d6c0-8c48-4c14-8132-c99ea588852c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e46eec614a0b4be39df20f564e8f0fe1', 'request_id': 'req-2121d6c0-8c48-4c14-8132-c99ea588852c'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:44.392955 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-2121d6c0-8c48-4c14-8132-c99ea588852c admin admin] The token cache is being invalidate because project e46eec614a0b4be39df20f564e8f0fe1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80503) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 14:50:44.393168 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-2121d6c0-8c48-4c14-8132-c99ea588852c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:44.393837 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-2121d6c0-8c48-4c14-8132-c99ea588852c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:44.395617 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1058/2096] 10.222.0.15 () {58 vars in 1232 bytes} [Tue May 31 14:50:44 2022] DELETE /identity/v3/projects/e46eec614a0b4be39df20f564e8f0fe1 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:50:44.396527 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2121d6c0-8c48-4c14-8132-c99ea588852c admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:44.397803 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-2121d6c0-8c48-4c14-8132-c99ea588852c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:44.466288 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2121d6c0-8c48-4c14-8132-c99ea588852c admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:44.471998 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2120378a-6191-4163-b21a-9df85b250fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:44.472922 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2120378a-6191-4163-b21a-9df85b250fa1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:44.473234 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2120378a-6191-4163-b21a-9df85b250fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:44.473512 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2120378a-6191-4163-b21a-9df85b250fa1 admin admin] PATH_INFO: `/v3/projects/d404662d40554ac6afca7037aadf30e8` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:44.474731 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2120378a-6191-4163-b21a-9df85b250fa1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d404662d40554ac6afca7037aadf30e8)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:44.476711 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2120378a-6191-4163-b21a-9df85b250fa1 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:44.506279 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-1d8400ae-5428-4b29-9e49-dad57836c7cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d1ac0295d81410caa1a66345973876b'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:44.513550 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-1d8400ae-5428-4b29-9e49-dad57836c7cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d1ac0295d81410caa1a66345973876b'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:44.524314 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-1d8400ae-5428-4b29-9e49-dad57836c7cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d1ac0295d81410caa1a66345973876b'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:44.524314 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-1d8400ae-5428-4b29-9e49-dad57836c7cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d1ac0295d81410caa1a66345973876b'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:44.526695 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-1d8400ae-5428-4b29-9e49-dad57836c7cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d1ac0295d81410caa1a66345973876b'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:44.588340 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1039/2097] 10.222.0.15 () {58 vars in 1223 bytes} [Tue May 31 14:50:44 2022] DELETE /identity/v3/users/5d1ac0295d81410caa1a66345973876b => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:50:44.591351 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0094e34-674e-4a6e-80e8-fd328fe5fe09 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:44.592142 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0094e34-674e-4a6e-80e8-fd328fe5fe09 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:44.592574 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0094e34-674e-4a6e-80e8-fd328fe5fe09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:44.610183 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-2120378a-6191-4163-b21a-9df85b250fa1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd404662d40554ac6afca7037aadf30e8', 'request_id': 'req-2120378a-6191-4163-b21a-9df85b250fa1'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:44.617930 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-f0094e34-674e-4a6e-80e8-fd328fe5fe09 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:50:44.619690 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-f0094e34-674e-4a6e-80e8-fd328fe5fe09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:44.654221 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-2120378a-6191-4163-b21a-9df85b250fa1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd404662d40554ac6afca7037aadf30e8', 'request_id': 'req-2120378a-6191-4163-b21a-9df85b250fa1'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:44.666477 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-2120378a-6191-4163-b21a-9df85b250fa1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd404662d40554ac6afca7037aadf30e8', 'request_id': 'req-2120378a-6191-4163-b21a-9df85b250fa1'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:44.684710 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-2120378a-6191-4163-b21a-9df85b250fa1 admin admin] The token cache is being invalidate because project d404662d40554ac6afca7037aadf30e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80503) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 14:50:44.685193 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-2120378a-6191-4163-b21a-9df85b250fa1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:44.686044 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-2120378a-6191-4163-b21a-9df85b250fa1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:44.688871 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1059/2098] 10.222.0.15 () {58 vars in 1232 bytes} [Tue May 31 14:50:44 2022] DELETE /identity/v3/projects/d404662d40554ac6afca7037aadf30e8 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:50:44.694637 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b404e6ca-64fa-4a44-9df6-5c5cd3591e24 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:44.695010 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b404e6ca-64fa-4a44-9df6-5c5cd3591e24 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:44.695391 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b404e6ca-64fa-4a44-9df6-5c5cd3591e24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:44.707540 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1040/2099] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:50:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:50:44.716278 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffe2f42-8b54-4387-863a-c706faba9ae7 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:44.716731 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffe2f42-8b54-4387-863a-c706faba9ae7 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:44.717404 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffe2f42-8b54-4387-863a-c706faba9ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:44.723099 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-b404e6ca-64fa-4a44-9df6-5c5cd3591e24 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:50:44.724416 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-b404e6ca-64fa-4a44-9df6-5c5cd3591e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:44.733339 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1060/2100] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:50:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:50:44.736809 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-6ffe2f42-8b54-4387-863a-c706faba9ae7 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:50:44.738767 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-6ffe2f42-8b54-4387-863a-c706faba9ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:44.745773 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa90422-0cef-4155-acf3-474ba42b802d None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:44.746288 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa90422-0cef-4155-acf3-474ba42b802d None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:44.746462 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa90422-0cef-4155-acf3-474ba42b802d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:44.750050 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1041/2101] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:50:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:50:44.751391 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffe2f42-8b54-4387-863a-c706faba9ae7 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:44.758089 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:44.760431 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffe2f42-8b54-4387-863a-c706faba9ae7 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:44.765111 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450863a4-737d-4392-b02c-c8b66caca608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:44.765759 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450863a4-737d-4392-b02c-c8b66caca608 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:44.766039 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450863a4-737d-4392-b02c-c8b66caca608 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:44.766315 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450863a4-737d-4392-b02c-c8b66caca608 admin admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:44.767517 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450863a4-737d-4392-b02c-c8b66caca608 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:50:44.767517 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450863a4-737d-4392-b02c-c8b66caca608 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:44.767811 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-9aa90422-0cef-4155-acf3-474ba42b802d None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:50:44.768843 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-9aa90422-0cef-4155-acf3-474ba42b802d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:44.769175 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450863a4-737d-4392-b02c-c8b66caca608 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:44.776979 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1061/2102] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:50:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 14:50:44.784081 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1042/2103] 10.222.0.15 () {58 vars in 1152 bytes} [Tue May 31 14:50:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 14:50:44.784219 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa90422-0cef-4155-acf3-474ba42b802d None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:44.790631 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa90422-0cef-4155-acf3-474ba42b802d None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:44.791561 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450863a4-737d-4392-b02c-c8b66caca608 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:44.796740 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6c383b-e9f3-4cba-8751-7300ce20c1d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:44.797647 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6c383b-e9f3-4cba-8751-7300ce20c1d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:44.797647 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6c383b-e9f3-4cba-8751-7300ce20c1d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:44.797846 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6c383b-e9f3-4cba-8751-7300ce20c1d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:44.798948 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6c383b-e9f3-4cba-8751-7300ce20c1d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:50:44.799313 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6c383b-e9f3-4cba-8751-7300ce20c1d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:44.800965 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6c383b-e9f3-4cba-8751-7300ce20c1d2 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:44.805755 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450863a4-737d-4392-b02c-c8b66caca608 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:44.810987 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f65398-4f16-409f-92c9-6caae41fad63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:44.811917 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f65398-4f16-409f-92c9-6caae41fad63 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:44.812209 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f65398-4f16-409f-92c9-6caae41fad63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:44.812521 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f65398-4f16-409f-92c9-6caae41fad63 admin admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:44.813167 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f65398-4f16-409f-92c9-6caae41fad63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:44.818130 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1062/2104] 10.222.0.15 () {58 vars in 1152 bytes} [Tue May 31 14:50:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 14:50:44.818302 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f65398-4f16-409f-92c9-6caae41fad63 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:44.819941 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6c383b-e9f3-4cba-8751-7300ce20c1d2 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:44.831118 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6c383b-e9f3-4cba-8751-7300ce20c1d2 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:44.836855 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13c8db3-c92d-430d-9db6-af83ab2af5fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:44.837529 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c8db3-c92d-430d-9db6-af83ab2af5fb admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:44.837818 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c8db3-c92d-430d-9db6-af83ab2af5fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:44.838103 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c8db3-c92d-430d-9db6-af83ab2af5fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:44.842237 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13c8db3-c92d-430d-9db6-af83ab2af5fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:44.842237 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13c8db3-c92d-430d-9db6-af83ab2af5fb admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:44.926316 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1043/2105] 10.222.0.15 () {60 vars in 1152 bytes} [Tue May 31 14:50:44 2022] POST /identity/v3/projects => generated 363 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 14:50:44.930885 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f65398-4f16-409f-92c9-6caae41fad63 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:44.958426 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1063/2106] 10.222.0.15 () {60 vars in 1152 bytes} [Tue May 31 14:50:44 2022] POST /identity/v3/projects => generated 381 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:50:44.969920 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13c8db3-c92d-430d-9db6-af83ab2af5fb admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:44.994012 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f65398-4f16-409f-92c9-6caae41fad63 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:45.033392 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13c8db3-c92d-430d-9db6-af83ab2af5fb admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:45.038193 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f97ede-02e4-4136-8e27-54d01687a169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:45.038896 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f97ede-02e4-4136-8e27-54d01687a169 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:45.039186 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f97ede-02e4-4136-8e27-54d01687a169 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:45.039467 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f97ede-02e4-4136-8e27-54d01687a169 admin admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:45.040169 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f97ede-02e4-4136-8e27-54d01687a169 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:45.042099 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f97ede-02e4-4136-8e27-54d01687a169 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:45.052961 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab13677-03eb-4eef-b66d-4b3510454285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:45.055746 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab13677-03eb-4eef-b66d-4b3510454285 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:45.055746 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab13677-03eb-4eef-b66d-4b3510454285 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:45.055746 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab13677-03eb-4eef-b66d-4b3510454285 admin admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:45.055746 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab13677-03eb-4eef-b66d-4b3510454285 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:45.057194 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab13677-03eb-4eef-b66d-4b3510454285 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:45.117370 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1064/2107] 10.222.0.15 () {60 vars in 1143 bytes} [Tue May 31 14:50:44 2022] POST /identity/v3/users => generated 291 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 14:50:45.121301 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f97ede-02e4-4136-8e27-54d01687a169 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:45.122973 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-e8f97ede-02e4-4136-8e27-54d01687a169 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:45.135615 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f97ede-02e4-4136-8e27-54d01687a169 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:45.138450 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:45.140990 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4175baef-8e6b-4415-9794-dac2b8862718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:45.141851 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4175baef-8e6b-4415-9794-dac2b8862718 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:45.142135 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4175baef-8e6b-4415-9794-dac2b8862718 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:45.142429 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4175baef-8e6b-4415-9794-dac2b8862718 admin admin] PATH_INFO: `/v3/projects/8960b8aa4b804a9095ddc849688824f7` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:45.144823 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1044/2108] 10.222.0.15 () {60 vars in 1143 bytes} [Tue May 31 14:50:44 2022] POST /identity/v3/users => generated 282 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 14:50:45.145468 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab13677-03eb-4eef-b66d-4b3510454285 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:45.152942 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4175baef-8e6b-4415-9794-dac2b8862718 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8960b8aa4b804a9095ddc849688824f7)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:45.155364 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4175baef-8e6b-4415-9794-dac2b8862718 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:45.155478 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab13677-03eb-4eef-b66d-4b3510454285 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:45.160294 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a23b033-f438-405d-993d-91040fabbaae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:45.160960 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a23b033-f438-405d-993d-91040fabbaae admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:45.161249 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a23b033-f438-405d-993d-91040fabbaae admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:45.162107 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a23b033-f438-405d-993d-91040fabbaae admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:45.162242 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a23b033-f438-405d-993d-91040fabbaae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:45.163892 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a23b033-f438-405d-993d-91040fabbaae admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:45.175365 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1045/2109] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:50:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:50:45.176251 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a23b033-f438-405d-993d-91040fabbaae admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:45.186710 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a23b033-f438-405d-993d-91040fabbaae admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:45.191351 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8d1905-e1d7-40ff-8fc1-4161b15a33a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:45.192015 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8d1905-e1d7-40ff-8fc1-4161b15a33a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:45.192299 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8d1905-e1d7-40ff-8fc1-4161b15a33a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:45.192578 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8d1905-e1d7-40ff-8fc1-4161b15a33a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:45.193296 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8d1905-e1d7-40ff-8fc1-4161b15a33a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:45.194935 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8d1905-e1d7-40ff-8fc1-4161b15a33a4 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:45.207447 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1046/2110] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:50:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:50:45.208292 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8d1905-e1d7-40ff-8fc1-4161b15a33a4 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:45.219879 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8d1905-e1d7-40ff-8fc1-4161b15a33a4 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:45.224417 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc5abbc-9993-4fa8-9e52-31b88841d6fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:45.225065 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc5abbc-9993-4fa8-9e52-31b88841d6fe admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:45.225351 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc5abbc-9993-4fa8-9e52-31b88841d6fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:45.225628 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc5abbc-9993-4fa8-9e52-31b88841d6fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:45.226406 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc5abbc-9993-4fa8-9e52-31b88841d6fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:45.228292 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc5abbc-9993-4fa8-9e52-31b88841d6fe admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:45.238998 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1047/2111] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:50:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:50:45.239857 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc5abbc-9993-4fa8-9e52-31b88841d6fe admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:45.253890 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc5abbc-9993-4fa8-9e52-31b88841d6fe admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:45.264011 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-4175baef-8e6b-4415-9794-dac2b8862718 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8960b8aa4b804a9095ddc849688824f7', 'request_id': 'req-4175baef-8e6b-4415-9794-dac2b8862718'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:45.318935 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d13ba12-d05d-4e85-b075-7f2dde16400d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:45.319620 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d13ba12-d05d-4e85-b075-7f2dde16400d admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:45.319908 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d13ba12-d05d-4e85-b075-7f2dde16400d admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:45.320185 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d13ba12-d05d-4e85-b075-7f2dde16400d admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:45.320911 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d13ba12-d05d-4e85-b075-7f2dde16400d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:45.323565 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d13ba12-d05d-4e85-b075-7f2dde16400d admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:45.336784 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1048/2112] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:50:45 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:50:45.336784 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d13ba12-d05d-4e85-b075-7f2dde16400d admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:45.339769 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-4175baef-8e6b-4415-9794-dac2b8862718 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8960b8aa4b804a9095ddc849688824f7', 'request_id': 'req-4175baef-8e6b-4415-9794-dac2b8862718'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:45.347962 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d13ba12-d05d-4e85-b075-7f2dde16400d admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:45.348438 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-4175baef-8e6b-4415-9794-dac2b8862718 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8960b8aa4b804a9095ddc849688824f7', 'request_id': 'req-4175baef-8e6b-4415-9794-dac2b8862718'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:45.353095 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bf1dcb-5ac8-4549-8404-7affb397309d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:45.354059 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bf1dcb-5ac8-4549-8404-7affb397309d admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:45.354416 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bf1dcb-5ac8-4549-8404-7affb397309d admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:45.355413 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bf1dcb-5ac8-4549-8404-7affb397309d admin admin] PATH_INFO: `/v3/projects/f316a7fa8dd041f991e22ff8b2b2d88e/users/3cdb4211a0bb4ef6a2a90c4d1fa2a034/roles/317f725e26bf43648d8235bb1f7c4cb3` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:45.365543 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-4175baef-8e6b-4415-9794-dac2b8862718 admin admin] The token cache is being invalidate because project 8960b8aa4b804a9095ddc849688824f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80503) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 14:50:45.365850 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-4175baef-8e6b-4415-9794-dac2b8862718 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:45.366821 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-4175baef-8e6b-4415-9794-dac2b8862718 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:45.368321 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1065/2113] 10.222.0.15 () {58 vars in 1232 bytes} [Tue May 31 14:50:45 2022] DELETE /identity/v3/projects/8960b8aa4b804a9095ddc849688824f7 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:50:45.369054 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4175baef-8e6b-4415-9794-dac2b8862718 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:45.370386 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-4175baef-8e6b-4415-9794-dac2b8862718 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:45.376478 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bf1dcb-5ac8-4549-8404-7affb397309d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f316a7fa8dd041f991e22ff8b2b2d88e, user_id=3cdb4211a0bb4ef6a2a90c4d1fa2a034, role_id=317f725e26bf43648d8235bb1f7c4cb3)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:45.385359 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bf1dcb-5ac8-4549-8404-7affb397309d admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:45.385472 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4175baef-8e6b-4415-9794-dac2b8862718 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:45.388537 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb9a2bd-469a-4c1e-8bec-862ef3d114d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:45.389520 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb9a2bd-469a-4c1e-8bec-862ef3d114d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:45.389898 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb9a2bd-469a-4c1e-8bec-862ef3d114d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:45.390175 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb9a2bd-469a-4c1e-8bec-862ef3d114d7 admin admin] PATH_INFO: `/v3/projects/1ae99ee21af74f71b584d0f0554291d7/users/39347b6f6cdf48f2a26d5dad5d8d52cc/roles/317f725e26bf43648d8235bb1f7c4cb3` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:45.404557 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb9a2bd-469a-4c1e-8bec-862ef3d114d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ae99ee21af74f71b584d0f0554291d7, user_id=39347b6f6cdf48f2a26d5dad5d8d52cc, role_id=317f725e26bf43648d8235bb1f7c4cb3)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:45.407405 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb9a2bd-469a-4c1e-8bec-862ef3d114d7 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:45.438108 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1049/2114] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:50:45 2022] PUT /identity/v3/projects/f316a7fa8dd041f991e22ff8b2b2d88e/users/3cdb4211a0bb4ef6a2a90c4d1fa2a034/roles/317f725e26bf43648d8235bb1f7c4cb3 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:50:45.443666 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608385f2-026d-4c9e-8dcc-183058228c2d None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:45.443666 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608385f2-026d-4c9e-8dcc-183058228c2d None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:45.443666 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608385f2-026d-4c9e-8dcc-183058228c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:45.457437 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-608385f2-026d-4c9e-8dcc-183058228c2d None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:50:45.458687 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-608385f2-026d-4c9e-8dcc-183058228c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:45.464011 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1066/2115] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:50:45 2022] PUT /identity/v3/projects/1ae99ee21af74f71b584d0f0554291d7/users/39347b6f6cdf48f2a26d5dad5d8d52cc/roles/317f725e26bf43648d8235bb1f7c4cb3 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:50:45.464011 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e42c0-08a9-4263-a6b4-b9fe61224efe None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:45.464011 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e42c0-08a9-4263-a6b4-b9fe61224efe None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:45.464011 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e42c0-08a9-4263-a6b4-b9fe61224efe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:45.495103 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-cb3e42c0-08a9-4263-a6b4-b9fe61224efe None None] MFA Rules not processed for user `3cdb4211a0bb4ef6a2a90c4d1fa2a034`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:50:45.496417 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-cb3e42c0-08a9-4263-a6b4-b9fe61224efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:45.521394 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1050/2116] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:50:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:50:45.527973 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7309dbf4-b411-4eff-ac8d-5ae5c5890719 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:45.528264 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7309dbf4-b411-4eff-ac8d-5ae5c5890719 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:45.528597 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7309dbf4-b411-4eff-ac8d-5ae5c5890719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:45.556116 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-7309dbf4-b411-4eff-ac8d-5ae5c5890719 None None] MFA Rules not processed for user `39347b6f6cdf48f2a26d5dad5d8d52cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:50:45.557388 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-7309dbf4-b411-4eff-ac8d-5ae5c5890719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:45.564711 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1067/2117] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:50:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:50:45.566102 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dd71eb-56e3-48bd-b091-e49dc0e52535 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:45.566489 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dd71eb-56e3-48bd-b091-e49dc0e52535 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:45.566975 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dd71eb-56e3-48bd-b091-e49dc0e52535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:45.585367 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-b5dd71eb-56e3-48bd-b091-e49dc0e52535 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:50:45.586759 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-b5dd71eb-56e3-48bd-b091-e49dc0e52535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:45.595589 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1068/2118] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:50:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:50:45.596132 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dd71eb-56e3-48bd-b091-e49dc0e52535 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:45.597424 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-b5dd71eb-56e3-48bd-b091-e49dc0e52535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:45.609812 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dd71eb-56e3-48bd-b091-e49dc0e52535 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:45.620770 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadfb011-b6aa-47a0-bc2e-e615ccaa65e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:45.621513 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadfb011-b6aa-47a0-bc2e-e615ccaa65e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:45.621798 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadfb011-b6aa-47a0-bc2e-e615ccaa65e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:45.622113 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadfb011-b6aa-47a0-bc2e-e615ccaa65e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:45.623046 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadfb011-b6aa-47a0-bc2e-e615ccaa65e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:45.625934 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadfb011-b6aa-47a0-bc2e-e615ccaa65e7 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:45.627047 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1051/2119] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:50:45 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:50:45.627967 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7309dbf4-b411-4eff-ac8d-5ae5c5890719 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:45.640482 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7309dbf4-b411-4eff-ac8d-5ae5c5890719 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:45.646023 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2902f61-c81a-464b-975b-aa69f1a9413b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:45.647009 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2902f61-c81a-464b-975b-aa69f1a9413b admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:45.647402 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2902f61-c81a-464b-975b-aa69f1a9413b admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:45.647571 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2902f61-c81a-464b-975b-aa69f1a9413b admin admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:45.648323 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2902f61-c81a-464b-975b-aa69f1a9413b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:50:45.648629 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2902f61-c81a-464b-975b-aa69f1a9413b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:45.650212 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2902f61-c81a-464b-975b-aa69f1a9413b admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:45.665921 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1052/2120] 10.222.0.15 () {58 vars in 1152 bytes} [Tue May 31 14:50:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:50:45.665921 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2902f61-c81a-464b-975b-aa69f1a9413b admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:45.674897 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2902f61-c81a-464b-975b-aa69f1a9413b admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:45.680335 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585d3109-85b3-4768-8e58-c1342684a267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:45.680998 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d3109-85b3-4768-8e58-c1342684a267 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:45.681351 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d3109-85b3-4768-8e58-c1342684a267 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:45.681630 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d3109-85b3-4768-8e58-c1342684a267 admin admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:45.682308 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585d3109-85b3-4768-8e58-c1342684a267 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:45.684307 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585d3109-85b3-4768-8e58-c1342684a267 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:45.724274 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1069/2121] 10.222.0.15 () {60 vars in 1152 bytes} [Tue May 31 14:50:45 2022] POST /identity/v3/projects => generated 383 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:50:45.725380 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadfb011-b6aa-47a0-bc2e-e615ccaa65e7 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:45.776025 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1053/2122] 10.222.0.15 () {60 vars in 1152 bytes} [Tue May 31 14:50:45 2022] POST /identity/v3/projects => generated 363 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:50:45.776025 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585d3109-85b3-4768-8e58-c1342684a267 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:45.791664 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadfb011-b6aa-47a0-bc2e-e615ccaa65e7 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:45.800458 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:45.845223 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585d3109-85b3-4768-8e58-c1342684a267 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:45.852932 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dab81d6-c062-4949-a9d1-d9e90b0926ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:45.853732 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dab81d6-c062-4949-a9d1-d9e90b0926ba admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:45.854190 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dab81d6-c062-4949-a9d1-d9e90b0926ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:45.854537 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dab81d6-c062-4949-a9d1-d9e90b0926ba admin admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:45.855622 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dab81d6-c062-4949-a9d1-d9e90b0926ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:45.857232 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac072ea-9882-468c-a34e-3381bdb6f470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:45.858532 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac072ea-9882-468c-a34e-3381bdb6f470 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:45.858915 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac072ea-9882-468c-a34e-3381bdb6f470 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:45.859757 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dab81d6-c062-4949-a9d1-d9e90b0926ba admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:45.859989 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac072ea-9882-468c-a34e-3381bdb6f470 admin admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:45.860095 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac072ea-9882-468c-a34e-3381bdb6f470 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:45.862063 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac072ea-9882-468c-a34e-3381bdb6f470 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:45.928980 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1054/2123] 10.222.0.15 () {60 vars in 1143 bytes} [Tue May 31 14:50:45 2022] POST /identity/v3/users => generated 298 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:50:45.929805 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dab81d6-c062-4949-a9d1-d9e90b0926ba admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:45.939624 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dab81d6-c062-4949-a9d1-d9e90b0926ba admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:45.944303 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44a711e-13cb-4a80-8e77-8decbda6421e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:45.944943 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a711e-13cb-4a80-8e77-8decbda6421e admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:45.945228 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a711e-13cb-4a80-8e77-8decbda6421e admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:45.945526 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a711e-13cb-4a80-8e77-8decbda6421e admin admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:45.946185 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44a711e-13cb-4a80-8e77-8decbda6421e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:45.948159 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44a711e-13cb-4a80-8e77-8decbda6421e admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:45.970617 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1070/2124] 10.222.0.15 () {60 vars in 1152 bytes} [Tue May 31 14:50:45 2022] POST /identity/v3/projects => generated 379 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:50:45.971651 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac072ea-9882-468c-a34e-3381bdb6f470 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:46.026100 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1055/2125] 10.222.0.15 () {60 vars in 1143 bytes} [Tue May 31 14:50:45 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:50:46.026894 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44a711e-13cb-4a80-8e77-8decbda6421e admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:46.032649 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac072ea-9882-468c-a34e-3381bdb6f470 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:46.037068 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44a711e-13cb-4a80-8e77-8decbda6421e admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:46.037397 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ffa5c2-fec9-4c2e-a582-8d001aa7340e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:46.038065 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ffa5c2-fec9-4c2e-a582-8d001aa7340e admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:46.038352 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ffa5c2-fec9-4c2e-a582-8d001aa7340e admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:46.038687 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ffa5c2-fec9-4c2e-a582-8d001aa7340e admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:46.039414 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ffa5c2-fec9-4c2e-a582-8d001aa7340e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:46.041118 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ffa5c2-fec9-4c2e-a582-8d001aa7340e admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:46.042019 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1a9013-c9fa-4a6e-88ca-37bb1ea0d169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:46.042724 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a9013-c9fa-4a6e-88ca-37bb1ea0d169 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:46.043027 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a9013-c9fa-4a6e-88ca-37bb1ea0d169 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:46.043287 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a9013-c9fa-4a6e-88ca-37bb1ea0d169 admin admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:46.043989 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1a9013-c9fa-4a6e-88ca-37bb1ea0d169 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:46.046474 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1a9013-c9fa-4a6e-88ca-37bb1ea0d169 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:46.052662 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1071/2126] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:50:45 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:50:46.053486 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ffa5c2-fec9-4c2e-a582-8d001aa7340e admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:46.063054 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ffa5c2-fec9-4c2e-a582-8d001aa7340e admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:46.067846 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c070903-4eb1-40b0-b835-775bb707bd87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:46.068481 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c070903-4eb1-40b0-b835-775bb707bd87 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:46.068769 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c070903-4eb1-40b0-b835-775bb707bd87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:46.069058 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c070903-4eb1-40b0-b835-775bb707bd87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:46.069848 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c070903-4eb1-40b0-b835-775bb707bd87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:46.071440 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c070903-4eb1-40b0-b835-775bb707bd87 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:46.081324 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1072/2127] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:50:46 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:50:46.082151 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c070903-4eb1-40b0-b835-775bb707bd87 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:46.091661 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c070903-4eb1-40b0-b835-775bb707bd87 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:46.096747 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b983e1d-a630-4881-a8b9-6f6d1d1948f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:46.097585 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b983e1d-a630-4881-a8b9-6f6d1d1948f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:46.097865 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b983e1d-a630-4881-a8b9-6f6d1d1948f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:46.098141 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b983e1d-a630-4881-a8b9-6f6d1d1948f0 admin admin] PATH_INFO: `/v3/projects/f7265a142411448aa0e0536123187875/users/fd4de4b86fcb4e9aa65e169f7fb0bc00/roles/76c53e2c353644f885028a0226c06146` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:46.105926 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:46.112405 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b983e1d-a630-4881-a8b9-6f6d1d1948f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7265a142411448aa0e0536123187875, user_id=fd4de4b86fcb4e9aa65e169f7fb0bc00, role_id=76c53e2c353644f885028a0226c06146)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:46.115236 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b983e1d-a630-4881-a8b9-6f6d1d1948f0 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:46.151098 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1056/2128] 10.222.0.15 () {60 vars in 1143 bytes} [Tue May 31 14:50:46 2022] POST /identity/v3/users => generated 290 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:50:46.152027 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1a9013-c9fa-4a6e-88ca-37bb1ea0d169 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:46.161392 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1a9013-c9fa-4a6e-88ca-37bb1ea0d169 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:46.166120 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9437b4-0251-413d-8201-340df9ea7295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:46.166969 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9437b4-0251-413d-8201-340df9ea7295 admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:46.167254 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9437b4-0251-413d-8201-340df9ea7295 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:46.167535 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9437b4-0251-413d-8201-340df9ea7295 admin admin] PATH_INFO: `/v3/projects/0b1bddc31d09476d8877ab643ccbee6f/users/fe75d32d90d9454abec16f46b34725f5/roles/76c53e2c353644f885028a0226c06146` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:46.183185 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1073/2129] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:50:46 2022] PUT /identity/v3/projects/f7265a142411448aa0e0536123187875/users/fd4de4b86fcb4e9aa65e169f7fb0bc00/roles/76c53e2c353644f885028a0226c06146 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:50:46.183185 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b983e1d-a630-4881-a8b9-6f6d1d1948f0 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:46.183515 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9437b4-0251-413d-8201-340df9ea7295 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b1bddc31d09476d8877ab643ccbee6f, user_id=fe75d32d90d9454abec16f46b34725f5, role_id=76c53e2c353644f885028a0226c06146)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:46.186871 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9437b4-0251-413d-8201-340df9ea7295 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:46.241893 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b983e1d-a630-4881-a8b9-6f6d1d1948f0 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:46.246649 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664ab61c-1d5b-47e4-a8fe-2228a5293cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:46.247424 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664ab61c-1d5b-47e4-a8fe-2228a5293cf1 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:46.247714 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664ab61c-1d5b-47e4-a8fe-2228a5293cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:46.247995 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664ab61c-1d5b-47e4-a8fe-2228a5293cf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:46.248988 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664ab61c-1d5b-47e4-a8fe-2228a5293cf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:46.252065 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664ab61c-1d5b-47e4-a8fe-2228a5293cf1 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:46.263750 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1074/2130] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:50:46 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:50:46.265183 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664ab61c-1d5b-47e4-a8fe-2228a5293cf1 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:46.275265 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664ab61c-1d5b-47e4-a8fe-2228a5293cf1 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:46.280654 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d8c808-44b0-46d3-b722-2d5d879c7e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:46.281303 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d8c808-44b0-46d3-b722-2d5d879c7e89 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:46.281593 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d8c808-44b0-46d3-b722-2d5d879c7e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:46.281879 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d8c808-44b0-46d3-b722-2d5d879c7e89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:46.282623 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d8c808-44b0-46d3-b722-2d5d879c7e89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:46.284277 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d8c808-44b0-46d3-b722-2d5d879c7e89 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:46.294991 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1057/2131] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:50:46 2022] PUT /identity/v3/projects/0b1bddc31d09476d8877ab643ccbee6f/users/fe75d32d90d9454abec16f46b34725f5/roles/76c53e2c353644f885028a0226c06146 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:50:46.295422 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1075/2132] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:50:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:50:46.296372 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9437b4-0251-413d-8201-340df9ea7295 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:46.299127 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d8c808-44b0-46d3-b722-2d5d879c7e89 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:46.308942 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d8c808-44b0-46d3-b722-2d5d879c7e89 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:46.360667 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9437b4-0251-413d-8201-340df9ea7295 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:46.363873 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:46.365721 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea34b6f-661b-44ee-acf3-a48fe4b7d778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:46.366385 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea34b6f-661b-44ee-acf3-a48fe4b7d778 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:46.366708 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea34b6f-661b-44ee-acf3-a48fe4b7d778 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:46.366985 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea34b6f-661b-44ee-acf3-a48fe4b7d778 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:46.367302 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c510f5e-263e-47c2-8e7a-9bdeaba9213c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:46.367740 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea34b6f-661b-44ee-acf3-a48fe4b7d778 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:46.367966 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c510f5e-263e-47c2-8e7a-9bdeaba9213c admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:46.368312 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c510f5e-263e-47c2-8e7a-9bdeaba9213c admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:46.368591 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c510f5e-263e-47c2-8e7a-9bdeaba9213c admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:46.369312 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c510f5e-263e-47c2-8e7a-9bdeaba9213c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:46.369415 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea34b6f-661b-44ee-acf3-a48fe4b7d778 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:46.370944 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c510f5e-263e-47c2-8e7a-9bdeaba9213c admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:46.379204 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1058/2133] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:50:46 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:50:46.380070 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea34b6f-661b-44ee-acf3-a48fe4b7d778 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:46.384949 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1076/2134] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:50:46 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 14:50:46.384949 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c510f5e-263e-47c2-8e7a-9bdeaba9213c admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:46.390618 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea34b6f-661b-44ee-acf3-a48fe4b7d778 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:46.393681 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c510f5e-263e-47c2-8e7a-9bdeaba9213c admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:46.395599 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a761a96-f134-4f40-9253-1c014c1ac748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:46.396858 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a761a96-f134-4f40-9253-1c014c1ac748 admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:46.397401 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a761a96-f134-4f40-9253-1c014c1ac748 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:46.398411 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812cfec4-05ee-46de-abbd-f04d7aad6997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:46.398798 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:46.399945 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a761a96-f134-4f40-9253-1c014c1ac748 admin admin] PATH_INFO: `/v3/projects/f7265a142411448aa0e0536123187875/users/fd4de4b86fcb4e9aa65e169f7fb0bc00/roles/76c53e2c353644f885028a0226c06146` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:46.400051 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812cfec4-05ee-46de-abbd-f04d7aad6997 admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:46.400051 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812cfec4-05ee-46de-abbd-f04d7aad6997 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:46.400051 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812cfec4-05ee-46de-abbd-f04d7aad6997 admin admin] PATH_INFO: `/v3/projects/1ead722a62514df585dafc59cb789685/users/d9bb799081bd4ec49375d5518e35adfb/roles/317f725e26bf43648d8235bb1f7c4cb3` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:46.401331 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a761a96-f134-4f40-9253-1c014c1ac748 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7265a142411448aa0e0536123187875, user_id=fd4de4b86fcb4e9aa65e169f7fb0bc00, role_id=76c53e2c353644f885028a0226c06146)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:46.404030 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a761a96-f134-4f40-9253-1c014c1ac748 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:46.414861 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1059/2135] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:50:46 2022] PUT /identity/v3/projects/f7265a142411448aa0e0536123187875/users/fd4de4b86fcb4e9aa65e169f7fb0bc00/roles/76c53e2c353644f885028a0226c06146 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:50:46.415071 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812cfec4-05ee-46de-abbd-f04d7aad6997 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ead722a62514df585dafc59cb789685, user_id=d9bb799081bd4ec49375d5518e35adfb, role_id=317f725e26bf43648d8235bb1f7c4cb3)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:46.417730 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812cfec4-05ee-46de-abbd-f04d7aad6997 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:46.418680 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a761a96-f134-4f40-9253-1c014c1ac748 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:46.481690 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a761a96-f134-4f40-9253-1c014c1ac748 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:46.484155 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1077/2136] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:50:46 2022] PUT /identity/v3/projects/1ead722a62514df585dafc59cb789685/users/d9bb799081bd4ec49375d5518e35adfb/roles/317f725e26bf43648d8235bb1f7c4cb3 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 14:50:46.485526 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afafd7a6-597b-4a82-8410-aa8d98250633 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:46.485941 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afafd7a6-597b-4a82-8410-aa8d98250633 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:46.486894 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afafd7a6-597b-4a82-8410-aa8d98250633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:46.514297 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-afafd7a6-597b-4a82-8410-aa8d98250633 None None] MFA Rules not processed for user `fd4de4b86fcb4e9aa65e169f7fb0bc00`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:50:46.515558 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-afafd7a6-597b-4a82-8410-aa8d98250633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:46.539602 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2129641c-3582-4495-8f62-3048b2e6f25a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:46.540461 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2129641c-3582-4495-8f62-3048b2e6f25a admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:46.540748 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2129641c-3582-4495-8f62-3048b2e6f25a admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:46.541021 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2129641c-3582-4495-8f62-3048b2e6f25a admin admin] PATH_INFO: `/v3/projects/0b1bddc31d09476d8877ab643ccbee6f/users/fe75d32d90d9454abec16f46b34725f5/roles/76c53e2c353644f885028a0226c06146` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:46.543058 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2129641c-3582-4495-8f62-3048b2e6f25a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b1bddc31d09476d8877ab643ccbee6f, user_id=fe75d32d90d9454abec16f46b34725f5, role_id=76c53e2c353644f885028a0226c06146)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:46.546322 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2129641c-3582-4495-8f62-3048b2e6f25a admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:46.559750 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1060/2137] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:50:46 2022] PUT /identity/v3/projects/0b1bddc31d09476d8877ab643ccbee6f/users/fe75d32d90d9454abec16f46b34725f5/roles/76c53e2c353644f885028a0226c06146 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:50:46.562056 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ced2c6d-f5fe-441c-9e4b-a335bf4e4488 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:46.562351 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ced2c6d-f5fe-441c-9e4b-a335bf4e4488 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:46.562655 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ced2c6d-f5fe-441c-9e4b-a335bf4e4488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:46.593276 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-1ced2c6d-f5fe-441c-9e4b-a335bf4e4488 None None] MFA Rules not processed for user `d9bb799081bd4ec49375d5518e35adfb`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:50:46.594510 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-1ced2c6d-f5fe-441c-9e4b-a335bf4e4488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:46.600727 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1078/2138] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:50:46 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:50:46.606734 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb4cb53-2f68-44c2-9a13-f064f45e6af2 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:46.607334 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb4cb53-2f68-44c2-9a13-f064f45e6af2 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:46.607483 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb4cb53-2f68-44c2-9a13-f064f45e6af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:46.636909 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-fdb4cb53-2f68-44c2-9a13-f064f45e6af2 None None] MFA Rules not processed for user `fe75d32d90d9454abec16f46b34725f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:50:46.638480 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-fdb4cb53-2f68-44c2-9a13-f064f45e6af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:46.661371 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1061/2139] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:50:46 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:50:46.662293 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ced2c6d-f5fe-441c-9e4b-a335bf4e4488 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:46.663701 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-1ced2c6d-f5fe-441c-9e4b-a335bf4e4488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:46.715686 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1079/2140] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:50:46 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:50:46.719760 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb4cb53-2f68-44c2-9a13-f064f45e6af2 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:46.728674 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ced2c6d-f5fe-441c-9e4b-a335bf4e4488 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:46.732560 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eb107f-d051-448a-8324-a68345cc85b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afbf718dcd9b4741a926b0a2321bd53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:46.733291 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eb107f-d051-448a-8324-a68345cc85b2 service cinder] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:46.733676 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eb107f-d051-448a-8324-a68345cc85b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:46.734012 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eb107f-d051-448a-8324-a68345cc85b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:46.754486 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=89,keystone:INSERT=11 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:46.782797 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb4cb53-2f68-44c2-9a13-f064f45e6af2 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:46.787642 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840543ac-4a8c-47de-81de-f5c6e46293c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:46.788399 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840543ac-4a8c-47de-81de-f5c6e46293c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:46.788711 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840543ac-4a8c-47de-81de-f5c6e46293c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:46.788948 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840543ac-4a8c-47de-81de-f5c6e46293c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:46.789774 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840543ac-4a8c-47de-81de-f5c6e46293c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:46.791677 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840543ac-4a8c-47de-81de-f5c6e46293c9 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:46.796727 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09eb107f-d051-448a-8324-a68345cc85b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:46.798231 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09eb107f-d051-448a-8324-a68345cc85b2 service cinder] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:46.808222 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1062/2141] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:50:46 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:50:46.808378 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:46.809790 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eb107f-d051-448a-8324-a68345cc85b2 service cinder] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:46.811855 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-09eb107f-d051-448a-8324-a68345cc85b2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:46.822439 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eb107f-d051-448a-8324-a68345cc85b2 service cinder] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:46.826255 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9851aa6-1b5f-46f4-a25f-f5561db705ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afbf718dcd9b4741a926b0a2321bd53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:46.826963 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9851aa6-1b5f-46f4-a25f-f5561db705ca service cinder] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:46.827245 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9851aa6-1b5f-46f4-a25f-f5561db705ca service cinder] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:46.827524 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9851aa6-1b5f-46f4-a25f-f5561db705ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:46.837986 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9851aa6-1b5f-46f4-a25f-f5561db705ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:46.839436 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9851aa6-1b5f-46f4-a25f-f5561db705ca service cinder] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:46.849723 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1063/2142] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:50:46 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:50:46.867030 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1080/2143] 10.222.0.15 () {60 vars in 1152 bytes} [Tue May 31 14:50:46 2022] POST /identity/v3/projects => generated 377 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:50:46.868456 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9851aa6-1b5f-46f4-a25f-f5561db705ca service cinder] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:46.880709 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9851aa6-1b5f-46f4-a25f-f5561db705ca service cinder] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:46.937867 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fb828e-0344-4e5a-8c49-618f10923b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:46.938571 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb828e-0344-4e5a-8c49-618f10923b66 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:46.938909 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb828e-0344-4e5a-8c49-618f10923b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:46.939144 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb828e-0344-4e5a-8c49-618f10923b66 admin admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:46.939855 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fb828e-0344-4e5a-8c49-618f10923b66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:46.941803 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fb828e-0344-4e5a-8c49-618f10923b66 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:46.991910 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840543ac-4a8c-47de-81de-f5c6e46293c9 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:47.028827 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1064/2144] 10.222.0.15 () {60 vars in 1143 bytes} [Tue May 31 14:50:46 2022] POST /identity/v3/users => generated 295 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 14:50:47.030267 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fb828e-0344-4e5a-8c49-618f10923b66 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:47.040288 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fb828e-0344-4e5a-8c49-618f10923b66 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:47.047570 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a5158b-28bc-4a94-bfa9-2ff7c2e7cd2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:47.048721 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a5158b-28bc-4a94-bfa9-2ff7c2e7cd2d admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:47.050079 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:47.050600 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a5158b-28bc-4a94-bfa9-2ff7c2e7cd2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:47.050993 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a5158b-28bc-4a94-bfa9-2ff7c2e7cd2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:47.051968 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a5158b-28bc-4a94-bfa9-2ff7c2e7cd2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:47.053637 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a5158b-28bc-4a94-bfa9-2ff7c2e7cd2d admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:47.064944 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1065/2145] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:50:47 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 14:50:47.066034 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840543ac-4a8c-47de-81de-f5c6e46293c9 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:47.069816 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf143542-ff18-42d7-807b-381fa77db0eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afbf718dcd9b4741a926b0a2321bd53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:47.070458 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf143542-ff18-42d7-807b-381fa77db0eb service cinder] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:47.070972 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf143542-ff18-42d7-807b-381fa77db0eb service cinder] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:47.071255 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf143542-ff18-42d7-807b-381fa77db0eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:47.078427 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a5158b-28bc-4a94-bfa9-2ff7c2e7cd2d admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:47.089195 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a5158b-28bc-4a94-bfa9-2ff7c2e7cd2d admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:47.100050 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766e7ea0-2e80-4783-90d5-512d43745cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:47.100982 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e7ea0-2e80-4783-90d5-512d43745cd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:47.101264 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e7ea0-2e80-4783-90d5-512d43745cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:47.102078 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e7ea0-2e80-4783-90d5-512d43745cd1 admin admin] PATH_INFO: `/v3/projects/ecbd89c46aa74279a76a4bd50df169d5/users/176a0df213614c859ab8edd01c0f7aa4/roles/76c53e2c353644f885028a0226c06146` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:47.120240 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766e7ea0-2e80-4783-90d5-512d43745cd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecbd89c46aa74279a76a4bd50df169d5, user_id=176a0df213614c859ab8edd01c0f7aa4, role_id=76c53e2c353644f885028a0226c06146)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:47.123443 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766e7ea0-2e80-4783-90d5-512d43745cd1 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:47.148464 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf143542-ff18-42d7-807b-381fa77db0eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:47.149911 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf143542-ff18-42d7-807b-381fa77db0eb service cinder] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:47.158972 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1081/2146] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:50:46 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:50:47.175195 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:47.226744 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1066/2147] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:50:47 2022] PUT /identity/v3/projects/ecbd89c46aa74279a76a4bd50df169d5/users/176a0df213614c859ab8edd01c0f7aa4/roles/76c53e2c353644f885028a0226c06146 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:50:47.233549 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf143542-ff18-42d7-807b-381fa77db0eb service cinder] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:47.251365 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf143542-ff18-42d7-807b-381fa77db0eb service cinder] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:47.329581 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a50779-4e1a-4f1d-9a19-6d970a5f0d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:47.330282 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a50779-4e1a-4f1d-9a19-6d970a5f0d25 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:47.330629 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a50779-4e1a-4f1d-9a19-6d970a5f0d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:47.337413 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a50779-4e1a-4f1d-9a19-6d970a5f0d25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:47.337413 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a50779-4e1a-4f1d-9a19-6d970a5f0d25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:47.337413 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a50779-4e1a-4f1d-9a19-6d970a5f0d25 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:47.346599 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1082/2148] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:50:47 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:50:47.348620 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766e7ea0-2e80-4783-90d5-512d43745cd1 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:47.361538 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766e7ea0-2e80-4783-90d5-512d43745cd1 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:47.368319 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b7b591-52f4-41dd-a98c-7f6f2f24d603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:47.368319 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b7b591-52f4-41dd-a98c-7f6f2f24d603 admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:47.368319 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b7b591-52f4-41dd-a98c-7f6f2f24d603 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:47.368319 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b7b591-52f4-41dd-a98c-7f6f2f24d603 admin admin] PATH_INFO: `/v3/projects/ecbd89c46aa74279a76a4bd50df169d5/users/176a0df213614c859ab8edd01c0f7aa4/roles/76c53e2c353644f885028a0226c06146` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:47.370368 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b7b591-52f4-41dd-a98c-7f6f2f24d603 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecbd89c46aa74279a76a4bd50df169d5, user_id=176a0df213614c859ab8edd01c0f7aa4, role_id=76c53e2c353644f885028a0226c06146)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:47.373101 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b7b591-52f4-41dd-a98c-7f6f2f24d603 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:47.394013 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1067/2149] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:50:47 2022] PUT /identity/v3/projects/ecbd89c46aa74279a76a4bd50df169d5/users/176a0df213614c859ab8edd01c0f7aa4/roles/76c53e2c353644f885028a0226c06146 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 14:50:47.396422 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e819e0da-9344-404e-a0f9-ff31bda4ab0c None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:47.396772 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e819e0da-9344-404e-a0f9-ff31bda4ab0c None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:47.397056 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e819e0da-9344-404e-a0f9-ff31bda4ab0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:47.420175 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:47.423823 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-e819e0da-9344-404e-a0f9-ff31bda4ab0c None None] MFA Rules not processed for user `176a0df213614c859ab8edd01c0f7aa4`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:50:47.425049 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-e819e0da-9344-404e-a0f9-ff31bda4ab0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:47.489526 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:47.498019 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1083/2150] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:50:47 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:50:47.511156 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b7b591-52f4-41dd-a98c-7f6f2f24d603 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:47.568697 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b7b591-52f4-41dd-a98c-7f6f2f24d603 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:47.572558 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0995888-8257-4839-be7a-8e1eb50cd770 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afbf718dcd9b4741a926b0a2321bd53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:47.573228 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0995888-8257-4839-be7a-8e1eb50cd770 service cinder] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:47.573516 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0995888-8257-4839-be7a-8e1eb50cd770 service cinder] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:47.573791 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0995888-8257-4839-be7a-8e1eb50cd770 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:47.629460 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0995888-8257-4839-be7a-8e1eb50cd770 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:47.630854 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0995888-8257-4839-be7a-8e1eb50cd770 service cinder] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:47.640657 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1068/2151] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:50:47 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:50:47.696199 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e819e0da-9344-404e-a0f9-ff31bda4ab0c None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:47.769086 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:47.774576 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e819e0da-9344-404e-a0f9-ff31bda4ab0c None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:47.785698 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38b29b1-4a59-4bd6-abbc-4190cfc5af2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:47.785698 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38b29b1-4a59-4bd6-abbc-4190cfc5af2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:47.785698 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38b29b1-4a59-4bd6-abbc-4190cfc5af2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:47.785698 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38b29b1-4a59-4bd6-abbc-4190cfc5af2e admin admin] PATH_INFO: `/v3/users/3cdb4211a0bb4ef6a2a90c4d1fa2a034` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:47.786041 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38b29b1-4a59-4bd6-abbc-4190cfc5af2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cdb4211a0bb4ef6a2a90c4d1fa2a034)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:47.786041 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38b29b1-4a59-4bd6-abbc-4190cfc5af2e admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:47.965001 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-f38b29b1-4a59-4bd6-abbc-4190cfc5af2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cdb4211a0bb4ef6a2a90c4d1fa2a034'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:48.008522 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0995888-8257-4839-be7a-8e1eb50cd770 service cinder] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:48.020988 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0995888-8257-4839-be7a-8e1eb50cd770 service cinder] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:48.031346 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db580466-0c87-4caf-b5c3-30136cc174d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:48.032353 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db580466-0c87-4caf-b5c3-30136cc174d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:48.032707 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db580466-0c87-4caf-b5c3-30136cc174d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:48.033337 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db580466-0c87-4caf-b5c3-30136cc174d5 admin admin] PATH_INFO: `/v3/users/39347b6f6cdf48f2a26d5dad5d8d52cc` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:48.062861 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-f38b29b1-4a59-4bd6-abbc-4190cfc5af2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cdb4211a0bb4ef6a2a90c4d1fa2a034'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:48.062861 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-f38b29b1-4a59-4bd6-abbc-4190cfc5af2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cdb4211a0bb4ef6a2a90c4d1fa2a034'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:48.063295 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db580466-0c87-4caf-b5c3-30136cc174d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39347b6f6cdf48f2a26d5dad5d8d52cc)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:48.063472 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-f38b29b1-4a59-4bd6-abbc-4190cfc5af2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cdb4211a0bb4ef6a2a90c4d1fa2a034'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:48.063472 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-f38b29b1-4a59-4bd6-abbc-4190cfc5af2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cdb4211a0bb4ef6a2a90c4d1fa2a034'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:48.063618 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db580466-0c87-4caf-b5c3-30136cc174d5 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:48.077983 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1084/2152] 10.222.0.15 () {58 vars in 1223 bytes} [Tue May 31 14:50:47 2022] DELETE /identity/v3/users/3cdb4211a0bb4ef6a2a90c4d1fa2a034 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:50:48.083028 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed7cd8e-dc63-4b84-a9d8-eed6d1aaa7e5 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:48.083457 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed7cd8e-dc63-4b84-a9d8-eed6d1aaa7e5 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:48.083746 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed7cd8e-dc63-4b84-a9d8-eed6d1aaa7e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:48.107289 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-2ed7cd8e-dc63-4b84-a9d8-eed6d1aaa7e5 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:50:48.111619 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-2ed7cd8e-dc63-4b84-a9d8-eed6d1aaa7e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:48.114438 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:48.172512 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1085/2153] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:50:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 14:50:48.183328 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed7cd8e-dc63-4b84-a9d8-eed6d1aaa7e5 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:48.184783 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-2ed7cd8e-dc63-4b84-a9d8-eed6d1aaa7e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:48.243390 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed7cd8e-dc63-4b84-a9d8-eed6d1aaa7e5 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:48.247162 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847663ed-ba2b-4f9d-aafe-2d90c8164771 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:48.247809 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847663ed-ba2b-4f9d-aafe-2d90c8164771 service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:48.248097 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847663ed-ba2b-4f9d-aafe-2d90c8164771 service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:48.248397 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847663ed-ba2b-4f9d-aafe-2d90c8164771 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:48.258250 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847663ed-ba2b-4f9d-aafe-2d90c8164771 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:48.259655 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847663ed-ba2b-4f9d-aafe-2d90c8164771 service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:48.269888 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1086/2154] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:50:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 14:50:48.451005 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-db580466-0c87-4caf-b5c3-30136cc174d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39347b6f6cdf48f2a26d5dad5d8d52cc'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:48.476668 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-db580466-0c87-4caf-b5c3-30136cc174d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39347b6f6cdf48f2a26d5dad5d8d52cc'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:48.479379 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-db580466-0c87-4caf-b5c3-30136cc174d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39347b6f6cdf48f2a26d5dad5d8d52cc'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:48.479379 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-db580466-0c87-4caf-b5c3-30136cc174d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39347b6f6cdf48f2a26d5dad5d8d52cc'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:48.491846 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-db580466-0c87-4caf-b5c3-30136cc174d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39347b6f6cdf48f2a26d5dad5d8d52cc'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:48.586198 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1069/2155] 10.222.0.15 () {58 vars in 1223 bytes} [Tue May 31 14:50:48 2022] DELETE /identity/v3/users/39347b6f6cdf48f2a26d5dad5d8d52cc => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 14:50:48.590461 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab71782-0f19-46b3-a2b7-41b28b9c5d41 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:48.590783 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab71782-0f19-46b3-a2b7-41b28b9c5d41 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:48.591069 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab71782-0f19-46b3-a2b7-41b28b9c5d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:48.619144 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-5ab71782-0f19-46b3-a2b7-41b28b9c5d41 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:50:48.622879 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-5ab71782-0f19-46b3-a2b7-41b28b9c5d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:48.696411 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1087/2156] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:50:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:50:48.705949 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db580466-0c87-4caf-b5c3-30136cc174d5 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:48.707466 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-db580466-0c87-4caf-b5c3-30136cc174d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:48.738094 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:48.769032 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db580466-0c87-4caf-b5c3-30136cc174d5 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:48.772441 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490c4c6f-a312-44f3-9eae-304a3d94fad7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:48.773110 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c4c6f-a312-44f3-9eae-304a3d94fad7 service neutron] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:48.773387 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c4c6f-a312-44f3-9eae-304a3d94fad7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:48.773665 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c4c6f-a312-44f3-9eae-304a3d94fad7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:48.782855 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490c4c6f-a312-44f3-9eae-304a3d94fad7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:48.784319 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490c4c6f-a312-44f3-9eae-304a3d94fad7 service neutron] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:48.793657 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1070/2157] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:50:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:50:48.855694 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab71782-0f19-46b3-a2b7-41b28b9c5d41 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:48.857401 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-5ab71782-0f19-46b3-a2b7-41b28b9c5d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:48.870591 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab71782-0f19-46b3-a2b7-41b28b9c5d41 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:48.876146 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd08355-e491-45fa-892f-7152accd4158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:48.882029 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd08355-e491-45fa-892f-7152accd4158 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:48.882029 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd08355-e491-45fa-892f-7152accd4158 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:48.882029 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd08355-e491-45fa-892f-7152accd4158 admin admin] PATH_INFO: `/v3/projects/f316a7fa8dd041f991e22ff8b2b2d88e` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:48.882029 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd08355-e491-45fa-892f-7152accd4158 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f316a7fa8dd041f991e22ff8b2b2d88e)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:48.882029 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd08355-e491-45fa-892f-7152accd4158 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:49.003642 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-9fd08355-e491-45fa-892f-7152accd4158 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f316a7fa8dd041f991e22ff8b2b2d88e', 'request_id': 'req-9fd08355-e491-45fa-892f-7152accd4158'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:49.006408 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:49.111636 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-9fd08355-e491-45fa-892f-7152accd4158 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f316a7fa8dd041f991e22ff8b2b2d88e', 'request_id': 'req-9fd08355-e491-45fa-892f-7152accd4158'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:49.118410 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-9fd08355-e491-45fa-892f-7152accd4158 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f316a7fa8dd041f991e22ff8b2b2d88e', 'request_id': 'req-9fd08355-e491-45fa-892f-7152accd4158'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:49.133359 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-9fd08355-e491-45fa-892f-7152accd4158 admin admin] The token cache is being invalidate because project f316a7fa8dd041f991e22ff8b2b2d88e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80503) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 14:50:49.133714 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-9fd08355-e491-45fa-892f-7152accd4158 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:49.134478 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-9fd08355-e491-45fa-892f-7152accd4158 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:49.136182 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1088/2158] 10.222.0.15 () {58 vars in 1232 bytes} [Tue May 31 14:50:48 2022] DELETE /identity/v3/projects/f316a7fa8dd041f991e22ff8b2b2d88e => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 14:50:49.141415 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490c4c6f-a312-44f3-9eae-304a3d94fad7 service neutron] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:49.151546 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490c4c6f-a312-44f3-9eae-304a3d94fad7 service neutron] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:49.211294 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1996ae-c5b5-41bd-823d-825c894ac972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:49.212188 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1996ae-c5b5-41bd-823d-825c894ac972 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:49.212455 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1996ae-c5b5-41bd-823d-825c894ac972 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:49.212732 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1996ae-c5b5-41bd-823d-825c894ac972 admin admin] PATH_INFO: `/v3/users/fd4de4b86fcb4e9aa65e169f7fb0bc00` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:49.213957 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1996ae-c5b5-41bd-823d-825c894ac972 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd4de4b86fcb4e9aa65e169f7fb0bc00)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:49.215948 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1996ae-c5b5-41bd-823d-825c894ac972 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:49.261711 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd08355-e491-45fa-892f-7152accd4158 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:49.266672 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-9fd08355-e491-45fa-892f-7152accd4158 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:49.282861 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd08355-e491-45fa-892f-7152accd4158 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:49.290093 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333b1d66-e507-4b60-923d-89b5d6fd1107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:49.290649 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b1d66-e507-4b60-923d-89b5d6fd1107 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:49.290649 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b1d66-e507-4b60-923d-89b5d6fd1107 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:49.290914 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b1d66-e507-4b60-923d-89b5d6fd1107 admin admin] PATH_INFO: `/v3/projects/1ae99ee21af74f71b584d0f0554291d7` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:49.292044 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333b1d66-e507-4b60-923d-89b5d6fd1107 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ae99ee21af74f71b584d0f0554291d7)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:49.297854 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333b1d66-e507-4b60-923d-89b5d6fd1107 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:49.393840 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-5a1996ae-c5b5-41bd-823d-825c894ac972 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd4de4b86fcb4e9aa65e169f7fb0bc00'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:49.400998 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-5a1996ae-c5b5-41bd-823d-825c894ac972 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd4de4b86fcb4e9aa65e169f7fb0bc00'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:49.401969 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-5a1996ae-c5b5-41bd-823d-825c894ac972 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd4de4b86fcb4e9aa65e169f7fb0bc00'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:49.404513 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-5a1996ae-c5b5-41bd-823d-825c894ac972 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd4de4b86fcb4e9aa65e169f7fb0bc00'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:49.418116 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-5a1996ae-c5b5-41bd-823d-825c894ac972 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd4de4b86fcb4e9aa65e169f7fb0bc00'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:49.421517 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-333b1d66-e507-4b60-923d-89b5d6fd1107 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ae99ee21af74f71b584d0f0554291d7', 'request_id': 'req-333b1d66-e507-4b60-923d-89b5d6fd1107'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:49.477844 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1071/2159] 10.222.0.15 () {58 vars in 1223 bytes} [Tue May 31 14:50:49 2022] DELETE /identity/v3/users/fd4de4b86fcb4e9aa65e169f7fb0bc00 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:50:49.528649 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-333b1d66-e507-4b60-923d-89b5d6fd1107 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ae99ee21af74f71b584d0f0554291d7', 'request_id': 'req-333b1d66-e507-4b60-923d-89b5d6fd1107'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:49.540190 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-333b1d66-e507-4b60-923d-89b5d6fd1107 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ae99ee21af74f71b584d0f0554291d7', 'request_id': 'req-333b1d66-e507-4b60-923d-89b5d6fd1107'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:49.552784 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-333b1d66-e507-4b60-923d-89b5d6fd1107 admin admin] The token cache is being invalidate because project 1ae99ee21af74f71b584d0f0554291d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80503) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 14:50:49.553166 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-333b1d66-e507-4b60-923d-89b5d6fd1107 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:49.553906 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-333b1d66-e507-4b60-923d-89b5d6fd1107 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:49.555554 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1089/2160] 10.222.0.15 () {58 vars in 1232 bytes} [Tue May 31 14:50:49 2022] DELETE /identity/v3/projects/1ae99ee21af74f71b584d0f0554291d7 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 14:50:49.559604 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1996ae-c5b5-41bd-823d-825c894ac972 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:49.561720 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-5a1996ae-c5b5-41bd-823d-825c894ac972 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:49.612940 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:49.632564 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1996ae-c5b5-41bd-823d-825c894ac972 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:49.637433 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eed6c68-695d-4dea-ac2c-17028483537b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:49.638310 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eed6c68-695d-4dea-ac2c-17028483537b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:49.638686 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eed6c68-695d-4dea-ac2c-17028483537b admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:49.638930 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eed6c68-695d-4dea-ac2c-17028483537b admin admin] PATH_INFO: `/v3/users/fe75d32d90d9454abec16f46b34725f5` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:49.640767 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eed6c68-695d-4dea-ac2c-17028483537b admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe75d32d90d9454abec16f46b34725f5)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:49.642879 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eed6c68-695d-4dea-ac2c-17028483537b admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:49.803365 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-1eed6c68-695d-4dea-ac2c-17028483537b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe75d32d90d9454abec16f46b34725f5'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:49.812973 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-1eed6c68-695d-4dea-ac2c-17028483537b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe75d32d90d9454abec16f46b34725f5'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:49.813931 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-1eed6c68-695d-4dea-ac2c-17028483537b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe75d32d90d9454abec16f46b34725f5'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:49.814697 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-1eed6c68-695d-4dea-ac2c-17028483537b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe75d32d90d9454abec16f46b34725f5'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:49.827364 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-1eed6c68-695d-4dea-ac2c-17028483537b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe75d32d90d9454abec16f46b34725f5'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:49.844158 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333b1d66-e507-4b60-923d-89b5d6fd1107 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:49.845653 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-333b1d66-e507-4b60-923d-89b5d6fd1107 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:49.907964 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1072/2161] 10.222.0.15 () {58 vars in 1223 bytes} [Tue May 31 14:50:49 2022] DELETE /identity/v3/users/fe75d32d90d9454abec16f46b34725f5 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 14:50:49.941073 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333b1d66-e507-4b60-923d-89b5d6fd1107 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:50.007923 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60177cbd-5e6f-4253-8372-0942c0e7cca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:50.008563 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60177cbd-5e6f-4253-8372-0942c0e7cca8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:50.008667 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60177cbd-5e6f-4253-8372-0942c0e7cca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:50.008947 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60177cbd-5e6f-4253-8372-0942c0e7cca8 admin admin] PATH_INFO: `/v3/projects/f7265a142411448aa0e0536123187875` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:50.010289 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60177cbd-5e6f-4253-8372-0942c0e7cca8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7265a142411448aa0e0536123187875)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:50.021026 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60177cbd-5e6f-4253-8372-0942c0e7cca8 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:50.024613 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:50.031146 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eed6c68-695d-4dea-ac2c-17028483537b admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:50.032559 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-1eed6c68-695d-4dea-ac2c-17028483537b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:50.099760 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eed6c68-695d-4dea-ac2c-17028483537b admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:50.106381 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5523c676-42d7-4cd9-bd92-06699c7ccef8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afbf718dcd9b4741a926b0a2321bd53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:50.107246 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5523c676-42d7-4cd9-bd92-06699c7ccef8 service cinder] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:50.107536 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5523c676-42d7-4cd9-bd92-06699c7ccef8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:50.107816 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5523c676-42d7-4cd9-bd92-06699c7ccef8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:50.110362 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-5523c676-42d7-4cd9-bd92-06699c7ccef8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:50.143480 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-60177cbd-5e6f-4253-8372-0942c0e7cca8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7265a142411448aa0e0536123187875', 'request_id': 'req-60177cbd-5e6f-4253-8372-0942c0e7cca8'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:50.189147 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5523c676-42d7-4cd9-bd92-06699c7ccef8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:50.190664 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5523c676-42d7-4cd9-bd92-06699c7ccef8 service cinder] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:50.200925 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1073/2162] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:50:50 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:50:50.231364 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-60177cbd-5e6f-4253-8372-0942c0e7cca8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7265a142411448aa0e0536123187875', 'request_id': 'req-60177cbd-5e6f-4253-8372-0942c0e7cca8'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:50.240223 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-60177cbd-5e6f-4253-8372-0942c0e7cca8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7265a142411448aa0e0536123187875', 'request_id': 'req-60177cbd-5e6f-4253-8372-0942c0e7cca8'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:50.257389 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-60177cbd-5e6f-4253-8372-0942c0e7cca8 admin admin] The token cache is being invalidate because project f7265a142411448aa0e0536123187875 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80503) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 14:50:50.257389 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-60177cbd-5e6f-4253-8372-0942c0e7cca8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:50.258170 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-60177cbd-5e6f-4253-8372-0942c0e7cca8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:50.259954 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1090/2163] 10.222.0.15 () {58 vars in 1232 bytes} [Tue May 31 14:50:49 2022] DELETE /identity/v3/projects/f7265a142411448aa0e0536123187875 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:50:50.265654 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f77bd6d-f22b-478b-8938-559780796832 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:50.265953 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f77bd6d-f22b-478b-8938-559780796832 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:50.266236 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f77bd6d-f22b-478b-8938-559780796832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:50.285422 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-9f77bd6d-f22b-478b-8938-559780796832 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:50:50.286671 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-9f77bd6d-f22b-478b-8938-559780796832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:50.295790 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:50.338088 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60177cbd-5e6f-4253-8372-0942c0e7cca8 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:50.340051 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-60177cbd-5e6f-4253-8372-0942c0e7cca8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:50.368195 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1074/2164] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:50:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:50:50.378390 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67343a2-6e89-4479-94a8-9b7186029746 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:50.381465 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67343a2-6e89-4479-94a8-9b7186029746 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:50.381465 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67343a2-6e89-4479-94a8-9b7186029746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:50.402610 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-a67343a2-6e89-4479-94a8-9b7186029746 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:50:50.404654 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-a67343a2-6e89-4479-94a8-9b7186029746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:50.418425 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1075/2165] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:50:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:50:50.425603 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67343a2-6e89-4479-94a8-9b7186029746 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:50.439330 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60177cbd-5e6f-4253-8372-0942c0e7cca8 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:50.439712 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67343a2-6e89-4479-94a8-9b7186029746 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:50.445536 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645f39ec-ce35-450f-84b8-5ddfccbe1eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:50.447296 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f39ec-ce35-450f-84b8-5ddfccbe1eff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:50.449786 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f39ec-ce35-450f-84b8-5ddfccbe1eff admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:50.449786 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f39ec-ce35-450f-84b8-5ddfccbe1eff admin admin] PATH_INFO: `/v3/projects/0b1bddc31d09476d8877ab643ccbee6f` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:50.449786 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645f39ec-ce35-450f-84b8-5ddfccbe1eff admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b1bddc31d09476d8877ab643ccbee6f)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:50.450782 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971d74aa-7da3-4437-9edb-f5a2d1585c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:50.452743 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971d74aa-7da3-4437-9edb-f5a2d1585c0b admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:50.453148 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645f39ec-ce35-450f-84b8-5ddfccbe1eff admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:50.453352 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971d74aa-7da3-4437-9edb-f5a2d1585c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:50.453782 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971d74aa-7da3-4437-9edb-f5a2d1585c0b admin admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:50.454765 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971d74aa-7da3-4437-9edb-f5a2d1585c0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:50:50.455399 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971d74aa-7da3-4437-9edb-f5a2d1585c0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:50.457691 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971d74aa-7da3-4437-9edb-f5a2d1585c0b admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:50.475084 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1076/2166] 10.222.0.15 () {58 vars in 1152 bytes} [Tue May 31 14:50:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 14:50:50.483734 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971d74aa-7da3-4437-9edb-f5a2d1585c0b admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:50.511678 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971d74aa-7da3-4437-9edb-f5a2d1585c0b admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:50.515229 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad171e9e-b4d8-499c-b045-ba056dbda6da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:50.516055 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad171e9e-b4d8-499c-b045-ba056dbda6da admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:50.516350 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad171e9e-b4d8-499c-b045-ba056dbda6da admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:50.516974 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad171e9e-b4d8-499c-b045-ba056dbda6da admin admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:50.517615 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad171e9e-b4d8-499c-b045-ba056dbda6da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:50.519857 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad171e9e-b4d8-499c-b045-ba056dbda6da admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:50.593255 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-645f39ec-ce35-450f-84b8-5ddfccbe1eff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b1bddc31d09476d8877ab643ccbee6f', 'request_id': 'req-645f39ec-ce35-450f-84b8-5ddfccbe1eff'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:50.605271 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1077/2167] 10.222.0.15 () {60 vars in 1152 bytes} [Tue May 31 14:50:50 2022] POST /identity/v3/projects => generated 375 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:50:50.609952 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad171e9e-b4d8-499c-b045-ba056dbda6da admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:50.673081 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad171e9e-b4d8-499c-b045-ba056dbda6da admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:50.678255 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27a560b-f053-49da-8fd6-62edf249eef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:50.678950 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a560b-f053-49da-8fd6-62edf249eef0 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:50.679234 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a560b-f053-49da-8fd6-62edf249eef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:50.679508 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a560b-f053-49da-8fd6-62edf249eef0 admin admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:50.680192 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27a560b-f053-49da-8fd6-62edf249eef0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:50.682129 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27a560b-f053-49da-8fd6-62edf249eef0 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:50.711441 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-645f39ec-ce35-450f-84b8-5ddfccbe1eff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b1bddc31d09476d8877ab643ccbee6f', 'request_id': 'req-645f39ec-ce35-450f-84b8-5ddfccbe1eff'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:50.718701 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-645f39ec-ce35-450f-84b8-5ddfccbe1eff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b1bddc31d09476d8877ab643ccbee6f', 'request_id': 'req-645f39ec-ce35-450f-84b8-5ddfccbe1eff'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:50.730288 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-645f39ec-ce35-450f-84b8-5ddfccbe1eff admin admin] The token cache is being invalidate because project 0b1bddc31d09476d8877ab643ccbee6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80503) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 14:50:50.730617 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-645f39ec-ce35-450f-84b8-5ddfccbe1eff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:50.731295 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-645f39ec-ce35-450f-84b8-5ddfccbe1eff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:50.732882 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1091/2168] 10.222.0.15 () {58 vars in 1232 bytes} [Tue May 31 14:50:50 2022] DELETE /identity/v3/projects/0b1bddc31d09476d8877ab643ccbee6f => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:50:50.737765 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a90f539-d046-44eb-ab1f-bc19e6c9a22a None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:50.738944 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a90f539-d046-44eb-ab1f-bc19e6c9a22a None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:50.738944 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a90f539-d046-44eb-ab1f-bc19e6c9a22a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:50.756555 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-0a90f539-d046-44eb-ab1f-bc19e6c9a22a None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:50:50.757758 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-0a90f539-d046-44eb-ab1f-bc19e6c9a22a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:50.766485 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1092/2169] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:50:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 14:50:50.774024 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c070b6d4-607c-4711-810b-136076edc151 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:50.774317 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c070b6d4-607c-4711-810b-136076edc151 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:50.774627 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c070b6d4-607c-4711-810b-136076edc151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:50.795141 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1078/2170] 10.222.0.15 () {60 vars in 1143 bytes} [Tue May 31 14:50:50 2022] POST /identity/v3/users => generated 288 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 14:50:50.795354 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-c070b6d4-607c-4711-810b-136076edc151 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:50:50.795354 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-c070b6d4-607c-4711-810b-136076edc151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:50.796297 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27a560b-f053-49da-8fd6-62edf249eef0 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:50.798169 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-f27a560b-f053-49da-8fd6-62edf249eef0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:50.803568 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1093/2171] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:50:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 14:50:50.807653 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c070b6d4-607c-4711-810b-136076edc151 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:50.810882 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27a560b-f053-49da-8fd6-62edf249eef0 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:50.817638 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c070b6d4-607c-4711-810b-136076edc151 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:50.822473 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563be426-330e-4cc3-a495-67727b4fbc71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:50.823305 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563be426-330e-4cc3-a495-67727b4fbc71 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:50.823689 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563be426-330e-4cc3-a495-67727b4fbc71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:50.824133 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563be426-330e-4cc3-a495-67727b4fbc71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:50.824953 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563be426-330e-4cc3-a495-67727b4fbc71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:50.827190 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563be426-330e-4cc3-a495-67727b4fbc71 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:50.836828 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddca2edd-e8fe-43b7-ab69-5baa28ba182e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:50.837578 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddca2edd-e8fe-43b7-ab69-5baa28ba182e admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:50.837787 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddca2edd-e8fe-43b7-ab69-5baa28ba182e admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:50.838058 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddca2edd-e8fe-43b7-ab69-5baa28ba182e admin admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:50.838809 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddca2edd-e8fe-43b7-ab69-5baa28ba182e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:50:50.839117 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddca2edd-e8fe-43b7-ab69-5baa28ba182e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:50.840693 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddca2edd-e8fe-43b7-ab69-5baa28ba182e admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:50.849777 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1079/2172] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:50:50 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:50:50.850836 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563be426-330e-4cc3-a495-67727b4fbc71 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:50.858381 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1094/2173] 10.222.0.15 () {58 vars in 1152 bytes} [Tue May 31 14:50:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 14:50:50.858959 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddca2edd-e8fe-43b7-ab69-5baa28ba182e admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:50.862201 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563be426-330e-4cc3-a495-67727b4fbc71 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:50.864409 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:50.866203 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a1aa57-da35-47c4-86fe-3093257449e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:50.867530 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a1aa57-da35-47c4-86fe-3093257449e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:50.867817 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a1aa57-da35-47c4-86fe-3093257449e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:50.868208 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a1aa57-da35-47c4-86fe-3093257449e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:50.868852 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a1aa57-da35-47c4-86fe-3093257449e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:50.870495 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a1aa57-da35-47c4-86fe-3093257449e8 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:50.870871 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddca2edd-e8fe-43b7-ab69-5baa28ba182e admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:50.876839 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e848102b-6947-4d97-bcd1-d5c8c92a2bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:50.877641 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e848102b-6947-4d97-bcd1-d5c8c92a2bf1 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:50.878058 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e848102b-6947-4d97-bcd1-d5c8c92a2bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:50.878696 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e848102b-6947-4d97-bcd1-d5c8c92a2bf1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:50.879469 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e848102b-6947-4d97-bcd1-d5c8c92a2bf1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:50.881571 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e848102b-6947-4d97-bcd1-d5c8c92a2bf1 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:50.882588 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1080/2174] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:50:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 14:50:50.886191 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a1aa57-da35-47c4-86fe-3093257449e8 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:50.898070 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a1aa57-da35-47c4-86fe-3093257449e8 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:50.903535 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac08463-ca31-40d4-81f5-130e90353e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:50.904467 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac08463-ca31-40d4-81f5-130e90353e67 admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:50.905465 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac08463-ca31-40d4-81f5-130e90353e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:50.905752 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac08463-ca31-40d4-81f5-130e90353e67 admin admin] PATH_INFO: `/v3/projects/7540639f2b044cdab7958e343db0f768/users/93f71b153790435dbf337424c40106c8/roles/317f725e26bf43648d8235bb1f7c4cb3` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:50.922153 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac08463-ca31-40d4-81f5-130e90353e67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7540639f2b044cdab7958e343db0f768, user_id=93f71b153790435dbf337424c40106c8, role_id=317f725e26bf43648d8235bb1f7c4cb3)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:50.925149 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac08463-ca31-40d4-81f5-130e90353e67 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:50.979017 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1095/2175] 10.222.0.15 () {60 vars in 1152 bytes} [Tue May 31 14:50:50 2022] POST /identity/v3/projects => generated 383 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 14:50:50.983888 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e848102b-6947-4d97-bcd1-d5c8c92a2bf1 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:50.985086 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1081/2176] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:50:50 2022] PUT /identity/v3/projects/7540639f2b044cdab7958e343db0f768/users/93f71b153790435dbf337424c40106c8/roles/317f725e26bf43648d8235bb1f7c4cb3 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 14:50:50.995617 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9537446d-a618-4282-a14c-5fb7f9b80232 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:50.995914 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9537446d-a618-4282-a14c-5fb7f9b80232 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:50.996202 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9537446d-a618-4282-a14c-5fb7f9b80232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:51.030881 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-9537446d-a618-4282-a14c-5fb7f9b80232 None None] MFA Rules not processed for user `93f71b153790435dbf337424c40106c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:50:51.032107 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-9537446d-a618-4282-a14c-5fb7f9b80232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:51.036499 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:51.087423 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e848102b-6947-4d97-bcd1-d5c8c92a2bf1 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:51.092703 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e0a375-59e2-453a-8d17-5d364cd3b93f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:51.093380 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e0a375-59e2-453a-8d17-5d364cd3b93f admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:51.093669 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e0a375-59e2-453a-8d17-5d364cd3b93f admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:51.093973 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e0a375-59e2-453a-8d17-5d364cd3b93f admin admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:51.094667 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e0a375-59e2-453a-8d17-5d364cd3b93f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:51.096600 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e0a375-59e2-453a-8d17-5d364cd3b93f admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:51.108708 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1082/2177] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:50:50 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 14:50:51.109853 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9537446d-a618-4282-a14c-5fb7f9b80232 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:51.120531 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9537446d-a618-4282-a14c-5fb7f9b80232 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:51.125749 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d776fe-dc52-4d84-a758-46f192c8a5ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:51.126404 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d776fe-dc52-4d84-a758-46f192c8a5ec admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:51.126729 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d776fe-dc52-4d84-a758-46f192c8a5ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:51.127175 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d776fe-dc52-4d84-a758-46f192c8a5ec admin admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:51.131689 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d776fe-dc52-4d84-a758-46f192c8a5ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:51.131689 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d776fe-dc52-4d84-a758-46f192c8a5ec admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:51.210579 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1096/2178] 10.222.0.15 () {60 vars in 1143 bytes} [Tue May 31 14:50:50 2022] POST /identity/v3/users => generated 292 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 14:50:51.213822 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e0a375-59e2-453a-8d17-5d364cd3b93f admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:51.224728 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1083/2179] 10.222.0.15 () {60 vars in 1152 bytes} [Tue May 31 14:50:51 2022] POST /identity/v3/projects => generated 377 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 14:50:51.225282 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e0a375-59e2-453a-8d17-5d364cd3b93f admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:51.225751 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d776fe-dc52-4d84-a758-46f192c8a5ec admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:51.301844 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983b5301-b1b0-4a49-be05-f08f78102952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:51.302802 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b5301-b1b0-4a49-be05-f08f78102952 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:51.303376 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d776fe-dc52-4d84-a758-46f192c8a5ec admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:51.303713 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b5301-b1b0-4a49-be05-f08f78102952 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:51.304116 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b5301-b1b0-4a49-be05-f08f78102952 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:51.304853 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983b5301-b1b0-4a49-be05-f08f78102952 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:51.306452 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983b5301-b1b0-4a49-be05-f08f78102952 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:51.308462 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65df4ffc-3446-4053-a29a-749a4aa04392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:51.309210 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df4ffc-3446-4053-a29a-749a4aa04392 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:51.309567 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df4ffc-3446-4053-a29a-749a4aa04392 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:51.309920 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df4ffc-3446-4053-a29a-749a4aa04392 admin admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:51.310713 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65df4ffc-3446-4053-a29a-749a4aa04392 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:51.316366 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65df4ffc-3446-4053-a29a-749a4aa04392 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:51.318354 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1097/2180] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:50:51 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 14:50:51.321753 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983b5301-b1b0-4a49-be05-f08f78102952 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:51.334029 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983b5301-b1b0-4a49-be05-f08f78102952 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:51.339050 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d7602e-670a-456d-9824-eddd0d0057cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:51.342888 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d7602e-670a-456d-9824-eddd0d0057cf admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:51.342888 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d7602e-670a-456d-9824-eddd0d0057cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:51.342888 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d7602e-670a-456d-9824-eddd0d0057cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:51.342888 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d7602e-670a-456d-9824-eddd0d0057cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:51.342888 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d7602e-670a-456d-9824-eddd0d0057cf admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:51.353011 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1098/2181] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:50:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:50:51.357152 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d7602e-670a-456d-9824-eddd0d0057cf admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:51.371507 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d7602e-670a-456d-9824-eddd0d0057cf admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:51.371996 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218f258c-2ae0-4b74-bff2-1228c4f5cbe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:51.372871 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f258c-2ae0-4b74-bff2-1228c4f5cbe5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:51.373232 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f258c-2ae0-4b74-bff2-1228c4f5cbe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:51.374052 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f258c-2ae0-4b74-bff2-1228c4f5cbe5 admin admin] PATH_INFO: `/v3/projects/e66366587beb45fcab17a6b01d3192d7/users/bef8fdb80efd4c09b66a09c4dc8e22d9/roles/317f725e26bf43648d8235bb1f7c4cb3` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:51.388944 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218f258c-2ae0-4b74-bff2-1228c4f5cbe5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e66366587beb45fcab17a6b01d3192d7, user_id=bef8fdb80efd4c09b66a09c4dc8e22d9, role_id=317f725e26bf43648d8235bb1f7c4cb3)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:51.397250 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218f258c-2ae0-4b74-bff2-1228c4f5cbe5 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:51.398497 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1084/2182] 10.222.0.15 () {60 vars in 1143 bytes} [Tue May 31 14:50:51 2022] POST /identity/v3/users => generated 289 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:50:51.402167 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65df4ffc-3446-4053-a29a-749a4aa04392 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:51.412129 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65df4ffc-3446-4053-a29a-749a4aa04392 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:51.417166 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33abc0e7-c2bd-4500-858a-25184d696ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:51.417821 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33abc0e7-c2bd-4500-858a-25184d696ed0 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:51.418102 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33abc0e7-c2bd-4500-858a-25184d696ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:51.418393 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33abc0e7-c2bd-4500-858a-25184d696ed0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:51.419159 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33abc0e7-c2bd-4500-858a-25184d696ed0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:51.421275 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33abc0e7-c2bd-4500-858a-25184d696ed0 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:51.431891 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1085/2183] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:50:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 14:50:51.435895 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33abc0e7-c2bd-4500-858a-25184d696ed0 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:51.446218 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33abc0e7-c2bd-4500-858a-25184d696ed0 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:51.451162 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b8d4ea-a812-4e31-97bf-712e4e2cd839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:51.457184 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b8d4ea-a812-4e31-97bf-712e4e2cd839 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:51.457184 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b8d4ea-a812-4e31-97bf-712e4e2cd839 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:51.457184 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b8d4ea-a812-4e31-97bf-712e4e2cd839 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:51.457184 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b8d4ea-a812-4e31-97bf-712e4e2cd839 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:51.457184 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b8d4ea-a812-4e31-97bf-712e4e2cd839 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:51.466450 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1086/2184] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:50:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:50:51.471102 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b8d4ea-a812-4e31-97bf-712e4e2cd839 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:51.481173 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b8d4ea-a812-4e31-97bf-712e4e2cd839 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:51.486660 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1099/2185] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:50:51 2022] PUT /identity/v3/projects/e66366587beb45fcab17a6b01d3192d7/users/bef8fdb80efd4c09b66a09c4dc8e22d9/roles/317f725e26bf43648d8235bb1f7c4cb3 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 14:50:51.498022 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3397e0e-aaea-42fb-bbf0-c55d800b6359 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:51.498319 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3397e0e-aaea-42fb-bbf0-c55d800b6359 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:51.498634 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3397e0e-aaea-42fb-bbf0-c55d800b6359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:51.533648 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:51.540668 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-a3397e0e-aaea-42fb-bbf0-c55d800b6359 None None] MFA Rules not processed for user `bef8fdb80efd4c09b66a09c4dc8e22d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:50:51.542313 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-a3397e0e-aaea-42fb-bbf0-c55d800b6359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:51.546152 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583ae022-84bd-4a42-848b-67c8c478f4d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:51.547374 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583ae022-84bd-4a42-848b-67c8c478f4d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:51.549156 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583ae022-84bd-4a42-848b-67c8c478f4d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:51.551271 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583ae022-84bd-4a42-848b-67c8c478f4d7 admin admin] PATH_INFO: `/v3/projects/a5aa80cba0da4ae7b2924df7cb42ac5f/users/c92881612aab4a9cb0a21e186256839f/roles/317f725e26bf43648d8235bb1f7c4cb3` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:51.567080 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:51.570938 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583ae022-84bd-4a42-848b-67c8c478f4d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5aa80cba0da4ae7b2924df7cb42ac5f, user_id=c92881612aab4a9cb0a21e186256839f, role_id=317f725e26bf43648d8235bb1f7c4cb3)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:51.573971 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583ae022-84bd-4a42-848b-67c8c478f4d7 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:51.619571 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1100/2186] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:50:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:50:51.642888 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3397e0e-aaea-42fb-bbf0-c55d800b6359 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:51.644294 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-a3397e0e-aaea-42fb-bbf0-c55d800b6359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:51.666151 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1087/2187] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:50:51 2022] PUT /identity/v3/projects/a5aa80cba0da4ae7b2924df7cb42ac5f/users/c92881612aab4a9cb0a21e186256839f/roles/317f725e26bf43648d8235bb1f7c4cb3 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 14:50:51.677623 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a61ee73-b536-4de0-91f9-059bd50b6098 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:51.677994 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a61ee73-b536-4de0-91f9-059bd50b6098 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:51.678238 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a61ee73-b536-4de0-91f9-059bd50b6098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:51.706341 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-4a61ee73-b536-4de0-91f9-059bd50b6098 None None] MFA Rules not processed for user `c92881612aab4a9cb0a21e186256839f`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:50:51.706820 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3397e0e-aaea-42fb-bbf0-c55d800b6359 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:51.707588 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-4a61ee73-b536-4de0-91f9-059bd50b6098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:51.755305 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65f3bdb-065b-4845-adf5-ea7a17224656 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afbf718dcd9b4741a926b0a2321bd53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:51.755953 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f3bdb-065b-4845-adf5-ea7a17224656 service cinder] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:51.756875 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f3bdb-065b-4845-adf5-ea7a17224656 service cinder] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:51.757165 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f3bdb-065b-4845-adf5-ea7a17224656 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:51.772374 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1088/2188] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:50:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 14:50:51.776842 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a61ee73-b536-4de0-91f9-059bd50b6098 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:51.813199 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65f3bdb-065b-4845-adf5-ea7a17224656 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:51.815151 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65f3bdb-065b-4845-adf5-ea7a17224656 service cinder] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:51.825352 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1101/2189] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:50:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 14:50:51.841798 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a61ee73-b536-4de0-91f9-059bd50b6098 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:51.846307 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65f3bdb-065b-4845-adf5-ea7a17224656 service cinder] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:51.849560 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae837806-7cf3-42d0-bce0-34835f945636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:51.850331 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae837806-7cf3-42d0-bce0-34835f945636 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:51.850658 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae837806-7cf3-42d0-bce0-34835f945636 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:51.852128 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae837806-7cf3-42d0-bce0-34835f945636 admin admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:51.856259 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae837806-7cf3-42d0-bce0-34835f945636 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:51.856259 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae837806-7cf3-42d0-bce0-34835f945636 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:51.859250 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65f3bdb-065b-4845-adf5-ea7a17224656 service cinder] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:51.865900 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ac3e29-1fe6-4288-8bf3-0a85d39c6a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:51.866821 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ac3e29-1fe6-4288-8bf3-0a85d39c6a0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:51.867547 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ac3e29-1fe6-4288-8bf3-0a85d39c6a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:51.867837 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ac3e29-1fe6-4288-8bf3-0a85d39c6a0d admin admin] PATH_INFO: `/v3/users/bef8fdb80efd4c09b66a09c4dc8e22d9` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:51.869626 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ac3e29-1fe6-4288-8bf3-0a85d39c6a0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=bef8fdb80efd4c09b66a09c4dc8e22d9)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:51.871956 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ac3e29-1fe6-4288-8bf3-0a85d39c6a0d admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:51.930850 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1089/2190] 10.222.0.15 () {60 vars in 1152 bytes} [Tue May 31 14:50:51 2022] POST /identity/v3/projects => generated 377 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 14:50:51.934871 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae837806-7cf3-42d0-bce0-34835f945636 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:51.984265 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:51.997670 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae837806-7cf3-42d0-bce0-34835f945636 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:52.002975 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73be4ab1-f66a-48d8-86e8-b7acbfe8b95b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:52.003649 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73be4ab1-f66a-48d8-86e8-b7acbfe8b95b admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:52.003937 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73be4ab1-f66a-48d8-86e8-b7acbfe8b95b admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:52.004218 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73be4ab1-f66a-48d8-86e8-b7acbfe8b95b admin admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:52.005083 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73be4ab1-f66a-48d8-86e8-b7acbfe8b95b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:52.007320 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73be4ab1-f66a-48d8-86e8-b7acbfe8b95b admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:52.009543 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:52.113375 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1090/2191] 10.222.0.15 () {60 vars in 1143 bytes} [Tue May 31 14:50:51 2022] POST /identity/v3/users => generated 295 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 14:50:52.117304 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73be4ab1-f66a-48d8-86e8-b7acbfe8b95b admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:52.123024 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-69ac3e29-1fe6-4288-8bf3-0a85d39c6a0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bef8fdb80efd4c09b66a09c4dc8e22d9'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:52.128138 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73be4ab1-f66a-48d8-86e8-b7acbfe8b95b admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:52.133045 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6389a2e9-e89d-41db-82e6-9ce2fe4b4ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:52.133827 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6389a2e9-e89d-41db-82e6-9ce2fe4b4ae7 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:52.134176 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6389a2e9-e89d-41db-82e6-9ce2fe4b4ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:52.134518 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6389a2e9-e89d-41db-82e6-9ce2fe4b4ae7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:52.135366 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6389a2e9-e89d-41db-82e6-9ce2fe4b4ae7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:52.137080 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6389a2e9-e89d-41db-82e6-9ce2fe4b4ae7 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:52.148917 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1091/2192] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:50:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:50:52.153092 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6389a2e9-e89d-41db-82e6-9ce2fe4b4ae7 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:52.162841 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6389a2e9-e89d-41db-82e6-9ce2fe4b4ae7 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:52.176029 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f65c00f-09bf-4802-a846-485f95312795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:52.177079 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f65c00f-09bf-4802-a846-485f95312795 admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:52.177326 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f65c00f-09bf-4802-a846-485f95312795 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:52.177540 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f65c00f-09bf-4802-a846-485f95312795 admin admin] PATH_INFO: `/v3/projects/de038ea7076841c7b1a17ad3d73516f2/users/1cf4ec662ff34885b177e74344f2db2d/roles/76c53e2c353644f885028a0226c06146` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:52.189979 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-69ac3e29-1fe6-4288-8bf3-0a85d39c6a0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bef8fdb80efd4c09b66a09c4dc8e22d9'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:52.189979 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-69ac3e29-1fe6-4288-8bf3-0a85d39c6a0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bef8fdb80efd4c09b66a09c4dc8e22d9'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:52.203822 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-69ac3e29-1fe6-4288-8bf3-0a85d39c6a0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bef8fdb80efd4c09b66a09c4dc8e22d9'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:52.204271 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-69ac3e29-1fe6-4288-8bf3-0a85d39c6a0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bef8fdb80efd4c09b66a09c4dc8e22d9'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:52.222026 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f65c00f-09bf-4802-a846-485f95312795 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de038ea7076841c7b1a17ad3d73516f2, user_id=1cf4ec662ff34885b177e74344f2db2d, role_id=76c53e2c353644f885028a0226c06146)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:52.226119 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f65c00f-09bf-4802-a846-485f95312795 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:52.226816 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1102/2193] 10.222.0.15 () {58 vars in 1223 bytes} [Tue May 31 14:50:51 2022] DELETE /identity/v3/users/bef8fdb80efd4c09b66a09c4dc8e22d9 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 14:50:52.231002 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01550cc5-2287-40b0-ab03-8fbd7f31f491 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:52.231615 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01550cc5-2287-40b0-ab03-8fbd7f31f491 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:52.231977 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01550cc5-2287-40b0-ab03-8fbd7f31f491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:52.263921 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-01550cc5-2287-40b0-ab03-8fbd7f31f491 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:50:52.265471 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-01550cc5-2287-40b0-ab03-8fbd7f31f491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:52.281946 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1092/2194] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:50:52 2022] PUT /identity/v3/projects/de038ea7076841c7b1a17ad3d73516f2/users/1cf4ec662ff34885b177e74344f2db2d/roles/76c53e2c353644f885028a0226c06146 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 14:50:52.301602 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f65c00f-09bf-4802-a846-485f95312795 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:52.303441 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-3f65c00f-09bf-4802-a846-485f95312795 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:52.346757 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1103/2195] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:50:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:50:52.360336 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01550cc5-2287-40b0-ab03-8fbd7f31f491 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:52.360336 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-01550cc5-2287-40b0-ab03-8fbd7f31f491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:52.387817 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f65c00f-09bf-4802-a846-485f95312795 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:52.393027 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb579e1-4e60-4b69-95a3-7f076c5ecded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:52.393699 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb579e1-4e60-4b69-95a3-7f076c5ecded admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:52.393986 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb579e1-4e60-4b69-95a3-7f076c5ecded admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:52.394267 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb579e1-4e60-4b69-95a3-7f076c5ecded admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:52.395042 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb579e1-4e60-4b69-95a3-7f076c5ecded admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:52.396718 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb579e1-4e60-4b69-95a3-7f076c5ecded admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:52.408063 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1093/2196] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:50:52 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:50:52.412203 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb579e1-4e60-4b69-95a3-7f076c5ecded admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:52.421784 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb579e1-4e60-4b69-95a3-7f076c5ecded admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:52.421939 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01550cc5-2287-40b0-ab03-8fbd7f31f491 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:52.426773 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f9fda0-df8c-45a4-a807-57fee67a1e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:52.427763 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f9fda0-df8c-45a4-a807-57fee67a1e8d admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:52.428051 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f9fda0-df8c-45a4-a807-57fee67a1e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:52.428327 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f9fda0-df8c-45a4-a807-57fee67a1e8d admin admin] PATH_INFO: `/v3/projects/de038ea7076841c7b1a17ad3d73516f2/users/1cf4ec662ff34885b177e74344f2db2d/roles/76c53e2c353644f885028a0226c06146` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:52.430317 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f9fda0-df8c-45a4-a807-57fee67a1e8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=de038ea7076841c7b1a17ad3d73516f2, user_id=1cf4ec662ff34885b177e74344f2db2d, role_id=76c53e2c353644f885028a0226c06146)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:52.432961 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f9fda0-df8c-45a4-a807-57fee67a1e8d admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:52.444430 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1094/2197] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:50:52 2022] PUT /identity/v3/projects/de038ea7076841c7b1a17ad3d73516f2/users/1cf4ec662ff34885b177e74344f2db2d/roles/76c53e2c353644f885028a0226c06146 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 14:50:52.495966 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69759058-91f2-4ad0-8308-29a43bf27213 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:52.497299 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69759058-91f2-4ad0-8308-29a43bf27213 service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:52.497589 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69759058-91f2-4ad0-8308-29a43bf27213 service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:52.497866 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69759058-91f2-4ad0-8308-29a43bf27213 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:52.508525 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69759058-91f2-4ad0-8308-29a43bf27213 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:52.510328 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69759058-91f2-4ad0-8308-29a43bf27213 service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:52.517971 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad214ee-f7c4-4371-a5b0-bf193ff70a0b None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:52.518266 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad214ee-f7c4-4371-a5b0-bf193ff70a0b None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:52.518573 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad214ee-f7c4-4371-a5b0-bf193ff70a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:52.522484 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1104/2198] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:50:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 14:50:52.546667 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-2ad214ee-f7c4-4371-a5b0-bf193ff70a0b None None] MFA Rules not processed for user `1cf4ec662ff34885b177e74344f2db2d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:50:52.547946 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-2ad214ee-f7c4-4371-a5b0-bf193ff70a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:52.636438 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1095/2199] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:50:52 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 14:50:52.644145 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69759058-91f2-4ad0-8308-29a43bf27213 service neutron] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:52.645548 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-69759058-91f2-4ad0-8308-29a43bf27213 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:52.650805 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:52.703281 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69759058-91f2-4ad0-8308-29a43bf27213 service neutron] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:52.755827 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3da6bf-5e52-4c07-a39f-46d5dcbcc1ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afbf718dcd9b4741a926b0a2321bd53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:52.756478 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3da6bf-5e52-4c07-a39f-46d5dcbcc1ce service cinder] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:52.756760 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3da6bf-5e52-4c07-a39f-46d5dcbcc1ce service cinder] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:52.757036 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3da6bf-5e52-4c07-a39f-46d5dcbcc1ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:52.758983 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-5a3da6bf-5e52-4c07-a39f-46d5dcbcc1ce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:52.820158 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3da6bf-5e52-4c07-a39f-46d5dcbcc1ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:52.821691 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3da6bf-5e52-4c07-a39f-46d5dcbcc1ce service cinder] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:52.832466 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1105/2200] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:50:52 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:50:52.914821 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad214ee-f7c4-4371-a5b0-bf193ff70a0b None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:52.916741 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-2ad214ee-f7c4-4371-a5b0-bf193ff70a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:52.933543 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:52.996640 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad214ee-f7c4-4371-a5b0-bf193ff70a0b None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:53.001330 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee976467-6afe-4ea8-82aa-f6da5a1f0e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:53.006111 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee976467-6afe-4ea8-82aa-f6da5a1f0e95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:53.006111 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee976467-6afe-4ea8-82aa-f6da5a1f0e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:53.006111 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee976467-6afe-4ea8-82aa-f6da5a1f0e95 admin admin] PATH_INFO: `/v3/projects/e66366587beb45fcab17a6b01d3192d7` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:53.006111 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee976467-6afe-4ea8-82aa-f6da5a1f0e95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e66366587beb45fcab17a6b01d3192d7)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:53.006111 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee976467-6afe-4ea8-82aa-f6da5a1f0e95 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:53.134805 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-ee976467-6afe-4ea8-82aa-f6da5a1f0e95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e66366587beb45fcab17a6b01d3192d7', 'request_id': 'req-ee976467-6afe-4ea8-82aa-f6da5a1f0e95'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:53.141734 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-ee976467-6afe-4ea8-82aa-f6da5a1f0e95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e66366587beb45fcab17a6b01d3192d7', 'request_id': 'req-ee976467-6afe-4ea8-82aa-f6da5a1f0e95'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:53.272291 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-ee976467-6afe-4ea8-82aa-f6da5a1f0e95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e66366587beb45fcab17a6b01d3192d7', 'request_id': 'req-ee976467-6afe-4ea8-82aa-f6da5a1f0e95'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:53.295841 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-ee976467-6afe-4ea8-82aa-f6da5a1f0e95 admin admin] The token cache is being invalidate because project e66366587beb45fcab17a6b01d3192d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 14:50:53.296266 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-ee976467-6afe-4ea8-82aa-f6da5a1f0e95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:53.297278 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-ee976467-6afe-4ea8-82aa-f6da5a1f0e95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:53.300568 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1096/2201] 10.222.0.15 () {58 vars in 1232 bytes} [Tue May 31 14:50:52 2022] DELETE /identity/v3/projects/e66366587beb45fcab17a6b01d3192d7 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 14:50:53.308329 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81cb774-6bac-4492-8442-055b9b9d6022 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:53.308329 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81cb774-6bac-4492-8442-055b9b9d6022 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:53.308329 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81cb774-6bac-4492-8442-055b9b9d6022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:53.336065 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-c81cb774-6bac-4492-8442-055b9b9d6022 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:50:53.337544 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-c81cb774-6bac-4492-8442-055b9b9d6022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:53.416353 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1106/2202] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:50:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:50:53.424464 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0602d6-e168-45e5-83a8-e5d62cbefb3c None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:53.428861 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0602d6-e168-45e5-83a8-e5d62cbefb3c None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:53.428861 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0602d6-e168-45e5-83a8-e5d62cbefb3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:53.443765 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-fd0602d6-e168-45e5-83a8-e5d62cbefb3c None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:50:53.444972 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-fd0602d6-e168-45e5-83a8-e5d62cbefb3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:53.454481 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1097/2203] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:50:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:50:53.458174 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81cb774-6bac-4492-8442-055b9b9d6022 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:53.468108 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81cb774-6bac-4492-8442-055b9b9d6022 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:53.484244 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2bbf94-9d1d-4b23-b115-8f6f1727208c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:53.484244 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2bbf94-9d1d-4b23-b115-8f6f1727208c admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:53.484244 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2bbf94-9d1d-4b23-b115-8f6f1727208c admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:53.484244 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2bbf94-9d1d-4b23-b115-8f6f1727208c admin admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:53.484585 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2bbf94-9d1d-4b23-b115-8f6f1727208c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:50:53.484585 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2bbf94-9d1d-4b23-b115-8f6f1727208c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:53.484585 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2bbf94-9d1d-4b23-b115-8f6f1727208c admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:53.490141 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:53.497129 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1107/2204] 10.222.0.15 () {58 vars in 1152 bytes} [Tue May 31 14:50:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:50:53.499783 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0602d6-e168-45e5-83a8-e5d62cbefb3c None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:53.510225 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0602d6-e168-45e5-83a8-e5d62cbefb3c None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:53.516287 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48cc2bb-895d-45e2-912a-87356439dfc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:53.516986 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48cc2bb-895d-45e2-912a-87356439dfc0 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:53.517300 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48cc2bb-895d-45e2-912a-87356439dfc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:53.517585 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48cc2bb-895d-45e2-912a-87356439dfc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:53.518294 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48cc2bb-895d-45e2-912a-87356439dfc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:53.520304 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48cc2bb-895d-45e2-912a-87356439dfc0 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:53.594444 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1098/2205] 10.222.0.15 () {60 vars in 1152 bytes} [Tue May 31 14:50:53 2022] POST /identity/v3/projects => generated 361 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:50:53.595420 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2bbf94-9d1d-4b23-b115-8f6f1727208c admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:53.607505 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2bbf94-9d1d-4b23-b115-8f6f1727208c admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:53.687087 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75850d8-9021-4335-859b-70eef6274492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:53.687780 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75850d8-9021-4335-859b-70eef6274492 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:53.688270 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75850d8-9021-4335-859b-70eef6274492 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:53.688557 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75850d8-9021-4335-859b-70eef6274492 admin admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:53.689417 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75850d8-9021-4335-859b-70eef6274492 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:53.691519 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75850d8-9021-4335-859b-70eef6274492 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:53.815577 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1108/2206] 10.222.0.15 () {60 vars in 1143 bytes} [Tue May 31 14:50:53 2022] POST /identity/v3/users => generated 281 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 14:50:53.819767 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48cc2bb-895d-45e2-912a-87356439dfc0 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:53.829892 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48cc2bb-895d-45e2-912a-87356439dfc0 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:53.834387 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1662c267-c78f-41b0-9be2-a12bc8e48525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:53.835077 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662c267-c78f-41b0-9be2-a12bc8e48525 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:53.835363 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662c267-c78f-41b0-9be2-a12bc8e48525 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:53.835646 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662c267-c78f-41b0-9be2-a12bc8e48525 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:53.836436 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1662c267-c78f-41b0-9be2-a12bc8e48525 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:53.838042 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1662c267-c78f-41b0-9be2-a12bc8e48525 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:53.848292 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1099/2207] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:50:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:50:53.852437 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75850d8-9021-4335-859b-70eef6274492 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:53.862915 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75850d8-9021-4335-859b-70eef6274492 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:53.867530 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc2497a-9545-44a4-9a16-e1d4670d3173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:53.868172 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc2497a-9545-44a4-9a16-e1d4670d3173 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:53.868454 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc2497a-9545-44a4-9a16-e1d4670d3173 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:53.868744 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc2497a-9545-44a4-9a16-e1d4670d3173 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:53.869442 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc2497a-9545-44a4-9a16-e1d4670d3173 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:53.871126 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc2497a-9545-44a4-9a16-e1d4670d3173 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:53.881462 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1109/2208] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:50:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:50:53.885524 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1662c267-c78f-41b0-9be2-a12bc8e48525 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:53.895399 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1662c267-c78f-41b0-9be2-a12bc8e48525 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:53.900467 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e7d0c2-99a9-4e67-bb64-6c25eaa0c685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:53.901418 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e7d0c2-99a9-4e67-bb64-6c25eaa0c685 admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:53.907490 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e7d0c2-99a9-4e67-bb64-6c25eaa0c685 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:53.907490 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e7d0c2-99a9-4e67-bb64-6c25eaa0c685 admin admin] PATH_INFO: `/v3/projects/32d16ff096cf42ab84abe7710b47380a/users/14c5894c7dd24675bb80259ec78af781/roles/317f725e26bf43648d8235bb1f7c4cb3` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:53.918977 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e7d0c2-99a9-4e67-bb64-6c25eaa0c685 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32d16ff096cf42ab84abe7710b47380a, user_id=14c5894c7dd24675bb80259ec78af781, role_id=317f725e26bf43648d8235bb1f7c4cb3)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:53.922315 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e7d0c2-99a9-4e67-bb64-6c25eaa0c685 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:53.986413 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1100/2209] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:50:53 2022] PUT /identity/v3/projects/32d16ff096cf42ab84abe7710b47380a/users/14c5894c7dd24675bb80259ec78af781/roles/317f725e26bf43648d8235bb1f7c4cb3 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 14:50:53.996970 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4170eed8-be01-4b87-836d-3bd54036ddf5 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:53.997268 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4170eed8-be01-4b87-836d-3bd54036ddf5 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:53.997555 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4170eed8-be01-4b87-836d-3bd54036ddf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:54.025073 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-4170eed8-be01-4b87-836d-3bd54036ddf5 None None] MFA Rules not processed for user `14c5894c7dd24675bb80259ec78af781`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:50:54.026357 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-4170eed8-be01-4b87-836d-3bd54036ddf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:54.093350 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1110/2210] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:50:53 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:50:54.126130 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e7d0c2-99a9-4e67-bb64-6c25eaa0c685 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:54.127952 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-85e7d0c2-99a9-4e67-bb64-6c25eaa0c685 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:54.170349 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:54.186009 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e7d0c2-99a9-4e67-bb64-6c25eaa0c685 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:54.189691 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd218117-27be-4e42-a520-6290944f22e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afbf718dcd9b4741a926b0a2321bd53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:54.190383 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd218117-27be-4e42-a520-6290944f22e9 service cinder] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:54.190713 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd218117-27be-4e42-a520-6290944f22e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:54.190996 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd218117-27be-4e42-a520-6290944f22e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:54.199285 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd218117-27be-4e42-a520-6290944f22e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:54.200717 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd218117-27be-4e42-a520-6290944f22e9 service cinder] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:54.209523 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1101/2211] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:50:54 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:50:54.224356 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4170eed8-be01-4b87-836d-3bd54036ddf5 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:54.291135 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4170eed8-be01-4b87-836d-3bd54036ddf5 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:54.296822 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b28b4d-18bd-46c7-bfed-c7c623906fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:54.297697 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b28b4d-18bd-46c7-bfed-c7c623906fbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:54.297987 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b28b4d-18bd-46c7-bfed-c7c623906fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:54.298312 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b28b4d-18bd-46c7-bfed-c7c623906fbf admin admin] PATH_INFO: `/v3/users/14c5894c7dd24675bb80259ec78af781` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:54.300087 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b28b4d-18bd-46c7-bfed-c7c623906fbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=14c5894c7dd24675bb80259ec78af781)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:54.301900 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b28b4d-18bd-46c7-bfed-c7c623906fbf admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:54.314144 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:54.457719 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-96b28b4d-18bd-46c7-bfed-c7c623906fbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14c5894c7dd24675bb80259ec78af781'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:54.512112 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-96b28b4d-18bd-46c7-bfed-c7c623906fbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14c5894c7dd24675bb80259ec78af781'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:54.512768 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-96b28b4d-18bd-46c7-bfed-c7c623906fbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14c5894c7dd24675bb80259ec78af781'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:54.521637 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-96b28b4d-18bd-46c7-bfed-c7c623906fbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14c5894c7dd24675bb80259ec78af781'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:54.522404 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-96b28b4d-18bd-46c7-bfed-c7c623906fbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14c5894c7dd24675bb80259ec78af781'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:54.541655 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1111/2212] 10.222.0.15 () {58 vars in 1223 bytes} [Tue May 31 14:50:54 2022] DELETE /identity/v3/users/14c5894c7dd24675bb80259ec78af781 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:50:54.545991 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2121b1a-91e0-489f-a94c-85caeefb244c None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:54.548901 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2121b1a-91e0-489f-a94c-85caeefb244c None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:54.548901 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2121b1a-91e0-489f-a94c-85caeefb244c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:54.563969 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-f2121b1a-91e0-489f-a94c-85caeefb244c None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:50:54.565177 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-f2121b1a-91e0-489f-a94c-85caeefb244c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:54.626899 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1102/2213] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:50:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:50:54.636624 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b28b4d-18bd-46c7-bfed-c7c623906fbf admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:54.638027 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-96b28b4d-18bd-46c7-bfed-c7c623906fbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:54.694704 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b28b4d-18bd-46c7-bfed-c7c623906fbf admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:54.698617 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b26175c-631e-4426-9b58-10022b5b2d33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:54.700024 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b26175c-631e-4426-9b58-10022b5b2d33 service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:54.700024 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b26175c-631e-4426-9b58-10022b5b2d33 service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:54.700024 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b26175c-631e-4426-9b58-10022b5b2d33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:54.710502 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b26175c-631e-4426-9b58-10022b5b2d33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:54.711968 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b26175c-631e-4426-9b58-10022b5b2d33 service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:54.723141 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1112/2214] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:50:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:50:54.906792 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2121b1a-91e0-489f-a94c-85caeefb244c None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:54.908191 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-f2121b1a-91e0-489f-a94c-85caeefb244c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:54.969620 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2121b1a-91e0-489f-a94c-85caeefb244c None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:54.973376 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3407afce-8874-462e-9e4d-f5abaee3bbe5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afbf718dcd9b4741a926b0a2321bd53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:54.974043 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3407afce-8874-462e-9e4d-f5abaee3bbe5 service cinder] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:54.974369 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3407afce-8874-462e-9e4d-f5abaee3bbe5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:54.974684 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3407afce-8874-462e-9e4d-f5abaee3bbe5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:54.976502 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-3407afce-8874-462e-9e4d-f5abaee3bbe5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:55.043613 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3407afce-8874-462e-9e4d-f5abaee3bbe5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:55.045130 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3407afce-8874-462e-9e4d-f5abaee3bbe5 service cinder] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:55.058939 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1103/2215] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:50:54 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:50:55.126808 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b26175c-631e-4426-9b58-10022b5b2d33 service neutron] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:55.128316 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-3b26175c-631e-4426-9b58-10022b5b2d33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:55.142658 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3407afce-8874-462e-9e4d-f5abaee3bbe5 service cinder] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:55.143631 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b26175c-631e-4426-9b58-10022b5b2d33 service neutron] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:55.145071 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-3407afce-8874-462e-9e4d-f5abaee3bbe5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:55.149167 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c1d4e4-1acf-49d6-9510-904af9ff7f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:55.149873 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c1d4e4-1acf-49d6-9510-904af9ff7f69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:55.150584 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c1d4e4-1acf-49d6-9510-904af9ff7f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:55.150584 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c1d4e4-1acf-49d6-9510-904af9ff7f69 admin admin] PATH_INFO: `/v3/users/d9bb799081bd4ec49375d5518e35adfb` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:55.151710 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c1d4e4-1acf-49d6-9510-904af9ff7f69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9bb799081bd4ec49375d5518e35adfb)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:55.153709 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c1d4e4-1acf-49d6-9510-904af9ff7f69 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:55.164183 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3407afce-8874-462e-9e4d-f5abaee3bbe5 service cinder] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:55.169927 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d98fe1-82d8-4b52-8b94-737b94f36c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:55.171456 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d98fe1-82d8-4b52-8b94-737b94f36c9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:55.171456 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d98fe1-82d8-4b52-8b94-737b94f36c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:55.171843 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d98fe1-82d8-4b52-8b94-737b94f36c9e admin admin] PATH_INFO: `/v3/projects/32d16ff096cf42ab84abe7710b47380a` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:55.174368 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d98fe1-82d8-4b52-8b94-737b94f36c9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=32d16ff096cf42ab84abe7710b47380a)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:55.176648 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d98fe1-82d8-4b52-8b94-737b94f36c9e admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:55.365074 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:55.378018 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-56c1d4e4-1acf-49d6-9510-904af9ff7f69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9bb799081bd4ec49375d5518e35adfb'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:55.378662 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-86d98fe1-82d8-4b52-8b94-737b94f36c9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32d16ff096cf42ab84abe7710b47380a', 'request_id': 'req-86d98fe1-82d8-4b52-8b94-737b94f36c9e'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:55.384959 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-86d98fe1-82d8-4b52-8b94-737b94f36c9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32d16ff096cf42ab84abe7710b47380a', 'request_id': 'req-86d98fe1-82d8-4b52-8b94-737b94f36c9e'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:55.471534 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-56c1d4e4-1acf-49d6-9510-904af9ff7f69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9bb799081bd4ec49375d5518e35adfb'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:55.472276 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-56c1d4e4-1acf-49d6-9510-904af9ff7f69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9bb799081bd4ec49375d5518e35adfb'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:55.481599 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-56c1d4e4-1acf-49d6-9510-904af9ff7f69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9bb799081bd4ec49375d5518e35adfb'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:55.482430 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-56c1d4e4-1acf-49d6-9510-904af9ff7f69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9bb799081bd4ec49375d5518e35adfb'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:55.499947 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1113/2216] 10.222.0.15 () {58 vars in 1223 bytes} [Tue May 31 14:50:55 2022] DELETE /identity/v3/users/d9bb799081bd4ec49375d5518e35adfb => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:50:55.504393 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2cae35-0f10-4512-ba28-c18ea238c136 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:55.504702 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2cae35-0f10-4512-ba28-c18ea238c136 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:55.504990 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2cae35-0f10-4512-ba28-c18ea238c136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:55.510513 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:DELETE=20,keystone:SELECT=78,keystone:INSERT=2 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:55.523105 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-0d2cae35-0f10-4512-ba28-c18ea238c136 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:50:55.525172 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-0d2cae35-0f10-4512-ba28-c18ea238c136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:55.551787 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-86d98fe1-82d8-4b52-8b94-737b94f36c9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32d16ff096cf42ab84abe7710b47380a', 'request_id': 'req-86d98fe1-82d8-4b52-8b94-737b94f36c9e'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:55.569399 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-86d98fe1-82d8-4b52-8b94-737b94f36c9e admin admin] The token cache is being invalidate because project 32d16ff096cf42ab84abe7710b47380a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 14:50:55.569776 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-86d98fe1-82d8-4b52-8b94-737b94f36c9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:55.570456 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-86d98fe1-82d8-4b52-8b94-737b94f36c9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:55.577530 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1104/2217] 10.222.0.15 () {58 vars in 1232 bytes} [Tue May 31 14:50:55 2022] DELETE /identity/v3/projects/32d16ff096cf42ab84abe7710b47380a => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 14:50:55.579273 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf999f0-5684-4484-817b-0471a26c0c1a None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:55.585291 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf999f0-5684-4484-817b-0471a26c0c1a None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:55.585291 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf999f0-5684-4484-817b-0471a26c0c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:55.592779 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1114/2218] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:50:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 14:50:55.600725 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-ecf999f0-5684-4484-817b-0471a26c0c1a None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:50:55.602603 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-ecf999f0-5684-4484-817b-0471a26c0c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:55.603674 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2cae35-0f10-4512-ba28-c18ea238c136 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:55.606043 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-0d2cae35-0f10-4512-ba28-c18ea238c136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:55.612580 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1105/2219] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:50:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:50:55.622634 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c608ac21-1034-4a77-9e7c-b79b1db6e048 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:55.622932 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c608ac21-1034-4a77-9e7c-b79b1db6e048 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:55.623215 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c608ac21-1034-4a77-9e7c-b79b1db6e048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:55.645181 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-c608ac21-1034-4a77-9e7c-b79b1db6e048 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:50:55.647060 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-c608ac21-1034-4a77-9e7c-b79b1db6e048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:55.659560 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1106/2220] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:50:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 14:50:55.663814 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c608ac21-1034-4a77-9e7c-b79b1db6e048 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:55.673585 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2cae35-0f10-4512-ba28-c18ea238c136 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:55.674771 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c608ac21-1034-4a77-9e7c-b79b1db6e048 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:55.678437 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0c123d-a644-4ccc-a02c-62c5ba4a5996 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:55.679127 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0c123d-a644-4ccc-a02c-62c5ba4a5996 service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:55.679434 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0c123d-a644-4ccc-a02c-62c5ba4a5996 service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:55.679698 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0c123d-a644-4ccc-a02c-62c5ba4a5996 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:55.679870 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a84c9a-f957-48e2-beb5-9a66435eeab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:55.680537 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a84c9a-f957-48e2-beb5-9a66435eeab1 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:55.680826 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a84c9a-f957-48e2-beb5-9a66435eeab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:55.681107 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a84c9a-f957-48e2-beb5-9a66435eeab1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:55.681877 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a84c9a-f957-48e2-beb5-9a66435eeab1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:50:55.682182 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a84c9a-f957-48e2-beb5-9a66435eeab1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:55.688472 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a84c9a-f957-48e2-beb5-9a66435eeab1 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:55.691343 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0c123d-a644-4ccc-a02c-62c5ba4a5996 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:55.693552 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0c123d-a644-4ccc-a02c-62c5ba4a5996 service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:55.700433 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1107/2221] 10.222.0.15 () {58 vars in 1152 bytes} [Tue May 31 14:50:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:50:55.703699 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a84c9a-f957-48e2-beb5-9a66435eeab1 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:55.705477 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1115/2222] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:50:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:50:55.715770 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a84c9a-f957-48e2-beb5-9a66435eeab1 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:55.721920 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6651258f-324a-4a36-9cdb-cdd77d49f087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:55.722987 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6651258f-324a-4a36-9cdb-cdd77d49f087 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:55.723284 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6651258f-324a-4a36-9cdb-cdd77d49f087 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:55.723565 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6651258f-324a-4a36-9cdb-cdd77d49f087 admin admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:55.724257 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6651258f-324a-4a36-9cdb-cdd77d49f087 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:55.726623 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6651258f-324a-4a36-9cdb-cdd77d49f087 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:55.839336 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1108/2223] 10.222.0.15 () {60 vars in 1152 bytes} [Tue May 31 14:50:55 2022] POST /identity/v3/projects => generated 371 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:50:55.843429 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0c123d-a644-4ccc-a02c-62c5ba4a5996 service neutron] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:55.854030 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0c123d-a644-4ccc-a02c-62c5ba4a5996 service neutron] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:55.909983 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0950bf0d-3919-45e2-893b-286e3fa7f2f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:55.910710 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0950bf0d-3919-45e2-893b-286e3fa7f2f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:55.910999 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0950bf0d-3919-45e2-893b-286e3fa7f2f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:55.911275 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0950bf0d-3919-45e2-893b-286e3fa7f2f3 admin admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:55.912067 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0950bf0d-3919-45e2-893b-286e3fa7f2f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:55.914086 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0950bf0d-3919-45e2-893b-286e3fa7f2f3 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:56.011787 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1116/2224] 10.222.0.15 () {60 vars in 1143 bytes} [Tue May 31 14:50:55 2022] POST /identity/v3/users => generated 286 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:50:56.013336 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6651258f-324a-4a36-9cdb-cdd77d49f087 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:56.024036 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6651258f-324a-4a36-9cdb-cdd77d49f087 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:56.028696 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3416a0e4-7d12-4885-a6c1-38756ed699d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:56.029395 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3416a0e4-7d12-4885-a6c1-38756ed699d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:56.029684 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3416a0e4-7d12-4885-a6c1-38756ed699d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:56.033517 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3416a0e4-7d12-4885-a6c1-38756ed699d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:56.034177 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3416a0e4-7d12-4885-a6c1-38756ed699d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:56.035845 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3416a0e4-7d12-4885-a6c1-38756ed699d5 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:56.047412 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1109/2225] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:50:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:50:56.051798 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0950bf0d-3919-45e2-893b-286e3fa7f2f3 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:56.062725 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0950bf0d-3919-45e2-893b-286e3fa7f2f3 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:56.067941 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d437f7-a408-4cf6-b045-55bc6dd82a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:56.068613 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d437f7-a408-4cf6-b045-55bc6dd82a70 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:56.068901 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d437f7-a408-4cf6-b045-55bc6dd82a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:56.069210 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d437f7-a408-4cf6-b045-55bc6dd82a70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:56.069933 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d437f7-a408-4cf6-b045-55bc6dd82a70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:56.071702 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d437f7-a408-4cf6-b045-55bc6dd82a70 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:56.082108 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1117/2226] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:50:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:50:56.086180 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3416a0e4-7d12-4885-a6c1-38756ed699d5 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:56.096319 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3416a0e4-7d12-4885-a6c1-38756ed699d5 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:56.100964 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0591f3-88f4-4c48-92f7-f9f5dc79a655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:56.101841 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0591f3-88f4-4c48-92f7-f9f5dc79a655 admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:56.102128 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0591f3-88f4-4c48-92f7-f9f5dc79a655 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:56.102407 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0591f3-88f4-4c48-92f7-f9f5dc79a655 admin admin] PATH_INFO: `/v3/projects/49d3e3e8a28c4a178149907900a967dc/users/8a5357b6da484c63a0c2787ebe5efdce/roles/317f725e26bf43648d8235bb1f7c4cb3` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:56.118976 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0591f3-88f4-4c48-92f7-f9f5dc79a655 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49d3e3e8a28c4a178149907900a967dc, user_id=8a5357b6da484c63a0c2787ebe5efdce, role_id=317f725e26bf43648d8235bb1f7c4cb3)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:56.121671 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0591f3-88f4-4c48-92f7-f9f5dc79a655 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:56.164697 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d437f7-a408-4cf6-b045-55bc6dd82a70 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:56.166574 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-16d437f7-a408-4cf6-b045-55bc6dd82a70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:56.197056 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1110/2227] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:50:56 2022] PUT /identity/v3/projects/49d3e3e8a28c4a178149907900a967dc/users/8a5357b6da484c63a0c2787ebe5efdce/roles/317f725e26bf43648d8235bb1f7c4cb3 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:50:56.198709 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1189514f-6371-437f-99eb-0ee9db3dc459 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:56.199125 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1189514f-6371-437f-99eb-0ee9db3dc459 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:56.199286 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1189514f-6371-437f-99eb-0ee9db3dc459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:56.200114 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d437f7-a408-4cf6-b045-55bc6dd82a70 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:56.227090 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:56.233963 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-1189514f-6371-437f-99eb-0ee9db3dc459 None None] MFA Rules not processed for user `8a5357b6da484c63a0c2787ebe5efdce`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:50:56.233963 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-1189514f-6371-437f-99eb-0ee9db3dc459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:56.266886 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18290140-d1d5-4d6f-a7a0-aa517e0d4735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:56.269067 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18290140-d1d5-4d6f-a7a0-aa517e0d4735 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:56.269682 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18290140-d1d5-4d6f-a7a0-aa517e0d4735 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:56.270248 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18290140-d1d5-4d6f-a7a0-aa517e0d4735 admin admin] PATH_INFO: `/v3/projects/1ead722a62514df585dafc59cb789685` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:56.272003 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18290140-d1d5-4d6f-a7a0-aa517e0d4735 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ead722a62514df585dafc59cb789685)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:56.274467 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18290140-d1d5-4d6f-a7a0-aa517e0d4735 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:56.308631 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1111/2228] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:50:56 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:50:56.309489 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1189514f-6371-437f-99eb-0ee9db3dc459 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:56.310845 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-1189514f-6371-437f-99eb-0ee9db3dc459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:56.327253 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1189514f-6371-437f-99eb-0ee9db3dc459 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:56.332405 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855082e7-67b9-4d7f-82a5-8f99a1941481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:56.333367 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855082e7-67b9-4d7f-82a5-8f99a1941481 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:56.333777 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855082e7-67b9-4d7f-82a5-8f99a1941481 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:56.334063 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855082e7-67b9-4d7f-82a5-8f99a1941481 admin admin] PATH_INFO: `/v3/users/e93010e18fbe42abbccbec85c1e56547` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:56.335283 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855082e7-67b9-4d7f-82a5-8f99a1941481 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e93010e18fbe42abbccbec85c1e56547)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:56.337268 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855082e7-67b9-4d7f-82a5-8f99a1941481 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:56.359085 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:56.386057 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-18290140-d1d5-4d6f-a7a0-aa517e0d4735 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ead722a62514df585dafc59cb789685', 'request_id': 'req-18290140-d1d5-4d6f-a7a0-aa517e0d4735'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:56.489136 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-18290140-d1d5-4d6f-a7a0-aa517e0d4735 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ead722a62514df585dafc59cb789685', 'request_id': 'req-18290140-d1d5-4d6f-a7a0-aa517e0d4735'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:56.496062 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-18290140-d1d5-4d6f-a7a0-aa517e0d4735 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ead722a62514df585dafc59cb789685', 'request_id': 'req-18290140-d1d5-4d6f-a7a0-aa517e0d4735'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:56.507947 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-18290140-d1d5-4d6f-a7a0-aa517e0d4735 admin admin] The token cache is being invalidate because project 1ead722a62514df585dafc59cb789685 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80503) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 14:50:56.508237 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-18290140-d1d5-4d6f-a7a0-aa517e0d4735 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:56.508912 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-18290140-d1d5-4d6f-a7a0-aa517e0d4735 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:56.510653 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1118/2229] 10.222.0.15 () {58 vars in 1232 bytes} [Tue May 31 14:50:56 2022] DELETE /identity/v3/projects/1ead722a62514df585dafc59cb789685 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 14:50:56.511431 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18290140-d1d5-4d6f-a7a0-aa517e0d4735 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:56.516176 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-18290140-d1d5-4d6f-a7a0-aa517e0d4735 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:56.528097 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-855082e7-67b9-4d7f-82a5-8f99a1941481 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e93010e18fbe42abbccbec85c1e56547'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:56.536082 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-855082e7-67b9-4d7f-82a5-8f99a1941481 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e93010e18fbe42abbccbec85c1e56547'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:56.536804 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-855082e7-67b9-4d7f-82a5-8f99a1941481 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e93010e18fbe42abbccbec85c1e56547'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:56.537426 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-855082e7-67b9-4d7f-82a5-8f99a1941481 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e93010e18fbe42abbccbec85c1e56547'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:56.564258 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-855082e7-67b9-4d7f-82a5-8f99a1941481 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e93010e18fbe42abbccbec85c1e56547'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:56.577373 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18290140-d1d5-4d6f-a7a0-aa517e0d4735 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:56.581676 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645618bd-e3a0-425d-883c-b49cadd9dcc6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ba98b007cc4ae1b20e7f261824b77c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:56.582374 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645618bd-e3a0-425d-883c-b49cadd9dcc6 service glance] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:56.582914 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645618bd-e3a0-425d-883c-b49cadd9dcc6 service glance] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:56.583206 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645618bd-e3a0-425d-883c-b49cadd9dcc6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:56.585369 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-645618bd-e3a0-425d-883c-b49cadd9dcc6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:56.643758 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1112/2230] 10.222.0.15 () {58 vars in 1223 bytes} [Tue May 31 14:50:56 2022] DELETE /identity/v3/users/e93010e18fbe42abbccbec85c1e56547 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:50:56.644979 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855082e7-67b9-4d7f-82a5-8f99a1941481 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:56.646360 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-855082e7-67b9-4d7f-82a5-8f99a1941481 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:56.651710 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645618bd-e3a0-425d-883c-b49cadd9dcc6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:56.653179 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645618bd-e3a0-425d-883c-b49cadd9dcc6 service glance] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:56.662524 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1119/2231] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:50:56 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:50:56.663177 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645618bd-e3a0-425d-883c-b49cadd9dcc6 service glance] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:56.664502 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-645618bd-e3a0-425d-883c-b49cadd9dcc6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:56.676339 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:56.722168 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855082e7-67b9-4d7f-82a5-8f99a1941481 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:56.725806 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645618bd-e3a0-425d-883c-b49cadd9dcc6 service glance] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:56.726850 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268c8ed7-b197-4fde-83f4-a78dcdde10fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:56.727814 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268c8ed7-b197-4fde-83f4-a78dcdde10fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:56.728064 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268c8ed7-b197-4fde-83f4-a78dcdde10fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:56.728336 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268c8ed7-b197-4fde-83f4-a78dcdde10fb admin admin] PATH_INFO: `/v3/users/176a0df213614c859ab8edd01c0f7aa4` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:56.729562 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268c8ed7-b197-4fde-83f4-a78dcdde10fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=176a0df213614c859ab8edd01c0f7aa4)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:56.731536 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268c8ed7-b197-4fde-83f4-a78dcdde10fb admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:56.779457 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ae8dfb-2f9a-4bbe-95af-7bb75ce20e2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afbf718dcd9b4741a926b0a2321bd53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:56.780793 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae8dfb-2f9a-4bbe-95af-7bb75ce20e2c service cinder] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:56.781073 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae8dfb-2f9a-4bbe-95af-7bb75ce20e2c service cinder] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:56.781343 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae8dfb-2f9a-4bbe-95af-7bb75ce20e2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:56.783598 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-f7ae8dfb-2f9a-4bbe-95af-7bb75ce20e2c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:56.862271 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ae8dfb-2f9a-4bbe-95af-7bb75ce20e2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:56.863875 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ae8dfb-2f9a-4bbe-95af-7bb75ce20e2c service cinder] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:56.878275 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1120/2232] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:50:56 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:50:56.879623 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f6186-8109-4d6b-b4b2-f41856645e41 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:56.879911 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f6186-8109-4d6b-b4b2-f41856645e41 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:56.880186 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f6186-8109-4d6b-b4b2-f41856645e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:56.903941 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-140f6186-8109-4d6b-b4b2-f41856645e41 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:50:56.905864 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-140f6186-8109-4d6b-b4b2-f41856645e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:56.920864 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1121/2233] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:50:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:50:56.923065 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-268c8ed7-b197-4fde-83f4-a78dcdde10fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '176a0df213614c859ab8edd01c0f7aa4'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:56.933175 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140f6186-8109-4d6b-b4b2-f41856645e41 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:56.933409 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-268c8ed7-b197-4fde-83f4-a78dcdde10fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '176a0df213614c859ab8edd01c0f7aa4'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:56.934158 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-268c8ed7-b197-4fde-83f4-a78dcdde10fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '176a0df213614c859ab8edd01c0f7aa4'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:56.935268 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-268c8ed7-b197-4fde-83f4-a78dcdde10fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '176a0df213614c859ab8edd01c0f7aa4'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:56.935386 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-140f6186-8109-4d6b-b4b2-f41856645e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:56.954341 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-268c8ed7-b197-4fde-83f4-a78dcdde10fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '176a0df213614c859ab8edd01c0f7aa4'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:57.008294 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140f6186-8109-4d6b-b4b2-f41856645e41 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:57.012640 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c57f538-b16e-4d9b-a8c1-c552028b554f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:57.013289 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c57f538-b16e-4d9b-a8c1-c552028b554f service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:57.018894 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c57f538-b16e-4d9b-a8c1-c552028b554f service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:57.018894 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c57f538-b16e-4d9b-a8c1-c552028b554f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:57.018894 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-0c57f538-b16e-4d9b-a8c1-c552028b554f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:57.028329 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c57f538-b16e-4d9b-a8c1-c552028b554f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:57.029790 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c57f538-b16e-4d9b-a8c1-c552028b554f service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:57.039993 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1122/2234] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:50:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 14:50:57.042831 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1113/2235] 10.222.0.15 () {58 vars in 1223 bytes} [Tue May 31 14:50:56 2022] DELETE /identity/v3/users/176a0df213614c859ab8edd01c0f7aa4 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:50:57.458810 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c57f538-b16e-4d9b-a8c1-c552028b554f service neutron] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:57.459239 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268c8ed7-b197-4fde-83f4-a78dcdde10fb admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:57.460468 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-0c57f538-b16e-4d9b-a8c1-c552028b554f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:57.461372 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-268c8ed7-b197-4fde-83f4-a78dcdde10fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:57.477590 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c57f538-b16e-4d9b-a8c1-c552028b554f service neutron] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:57.500821 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:57.504789 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:57.555819 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060c1efa-30da-424c-a723-8bcc6ec420bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:57.556856 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c1efa-30da-424c-a723-8bcc6ec420bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:57.557136 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c1efa-30da-424c-a723-8bcc6ec420bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:57.557917 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c1efa-30da-424c-a723-8bcc6ec420bc admin admin] PATH_INFO: `/v3/projects/ecbd89c46aa74279a76a4bd50df169d5` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:57.559374 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060c1efa-30da-424c-a723-8bcc6ec420bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecbd89c46aa74279a76a4bd50df169d5)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:57.562235 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060c1efa-30da-424c-a723-8bcc6ec420bc admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:57.572232 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268c8ed7-b197-4fde-83f4-a78dcdde10fb admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:57.577576 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef731f7d-16fb-429c-9f17-bb20989e9b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:57.578015 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef731f7d-16fb-429c-9f17-bb20989e9b12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:57.578301 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef731f7d-16fb-429c-9f17-bb20989e9b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:57.578601 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef731f7d-16fb-429c-9f17-bb20989e9b12 admin admin] PATH_INFO: `/v3/projects/8f23bf2550564e11b34fdccd23ffddd8` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:57.579939 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef731f7d-16fb-429c-9f17-bb20989e9b12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f23bf2550564e11b34fdccd23ffddd8)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:57.581846 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef731f7d-16fb-429c-9f17-bb20989e9b12 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:57.691526 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-060c1efa-30da-424c-a723-8bcc6ec420bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecbd89c46aa74279a76a4bd50df169d5', 'request_id': 'req-060c1efa-30da-424c-a723-8bcc6ec420bc'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:57.691753 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-ef731f7d-16fb-429c-9f17-bb20989e9b12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f23bf2550564e11b34fdccd23ffddd8', 'request_id': 'req-ef731f7d-16fb-429c-9f17-bb20989e9b12'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:57.698925 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-ef731f7d-16fb-429c-9f17-bb20989e9b12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f23bf2550564e11b34fdccd23ffddd8', 'request_id': 'req-ef731f7d-16fb-429c-9f17-bb20989e9b12'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:57.774753 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-060c1efa-30da-424c-a723-8bcc6ec420bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecbd89c46aa74279a76a4bd50df169d5', 'request_id': 'req-060c1efa-30da-424c-a723-8bcc6ec420bc'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:57.781469 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-060c1efa-30da-424c-a723-8bcc6ec420bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecbd89c46aa74279a76a4bd50df169d5', 'request_id': 'req-060c1efa-30da-424c-a723-8bcc6ec420bc'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:57.792413 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-060c1efa-30da-424c-a723-8bcc6ec420bc admin admin] The token cache is being invalidate because project ecbd89c46aa74279a76a4bd50df169d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80503) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 14:50:57.792700 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-060c1efa-30da-424c-a723-8bcc6ec420bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:57.793326 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-060c1efa-30da-424c-a723-8bcc6ec420bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:57.794889 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1123/2236] 10.222.0.15 () {58 vars in 1232 bytes} [Tue May 31 14:50:57 2022] DELETE /identity/v3/projects/ecbd89c46aa74279a76a4bd50df169d5 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:50:57.801456 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af96d5d3-83f6-4db2-88dd-7d67e32ba80d None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:57.804252 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af96d5d3-83f6-4db2-88dd-7d67e32ba80d None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:57.804252 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af96d5d3-83f6-4db2-88dd-7d67e32ba80d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:57.820903 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-af96d5d3-83f6-4db2-88dd-7d67e32ba80d None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:50:57.822101 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-af96d5d3-83f6-4db2-88dd-7d67e32ba80d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:57.842885 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-ef731f7d-16fb-429c-9f17-bb20989e9b12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f23bf2550564e11b34fdccd23ffddd8', 'request_id': 'req-ef731f7d-16fb-429c-9f17-bb20989e9b12'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:57.853652 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-ef731f7d-16fb-429c-9f17-bb20989e9b12 admin admin] The token cache is being invalidate because project 8f23bf2550564e11b34fdccd23ffddd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 14:50:57.853941 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-ef731f7d-16fb-429c-9f17-bb20989e9b12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:57.854594 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-ef731f7d-16fb-429c-9f17-bb20989e9b12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:50:57.856982 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1114/2237] 10.222.0.15 () {58 vars in 1232 bytes} [Tue May 31 14:50:57 2022] DELETE /identity/v3/projects/8f23bf2550564e11b34fdccd23ffddd8 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 14:50:57.861201 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb919e-79cb-44b9-8c28-9a24a12d3cad None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:57.861494 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb919e-79cb-44b9-8c28-9a24a12d3cad None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:57.861772 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb919e-79cb-44b9-8c28-9a24a12d3cad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:57.879820 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-f3bb919e-79cb-44b9-8c28-9a24a12d3cad None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:50:57.881014 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-f3bb919e-79cb-44b9-8c28-9a24a12d3cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:57.881706 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1124/2238] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:50:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 14:50:57.889056 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1115/2239] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:50:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 14:50:57.889814 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b850a-8753-4b8e-a709-400f14f09394 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:57.889985 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b850a-8753-4b8e-a709-400f14f09394 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:57.890268 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b850a-8753-4b8e-a709-400f14f09394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:57.897540 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b974e48-a834-4c71-87ac-af13e50ea1cd None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:57.897962 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b974e48-a834-4c71-87ac-af13e50ea1cd None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:57.898283 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b974e48-a834-4c71-87ac-af13e50ea1cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:57.908572 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-ae2b850a-8753-4b8e-a709-400f14f09394 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:50:57.909743 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-ae2b850a-8753-4b8e-a709-400f14f09394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:57.917302 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-9b974e48-a834-4c71-87ac-af13e50ea1cd None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:50:57.917663 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1125/2240] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:50:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 14:50:57.918751 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-9b974e48-a834-4c71-87ac-af13e50ea1cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:57.921882 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2b850a-8753-4b8e-a709-400f14f09394 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:57.927885 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1116/2241] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:50:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:50:57.931561 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b974e48-a834-4c71-87ac-af13e50ea1cd None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:57.937243 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2b850a-8753-4b8e-a709-400f14f09394 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:57.941653 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b974e48-a834-4c71-87ac-af13e50ea1cd None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:57.942878 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5ddc48-5973-4ab0-980d-27082311bba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:57.943368 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5ddc48-5973-4ab0-980d-27082311bba9 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:57.943692 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5ddc48-5973-4ab0-980d-27082311bba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:57.943933 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5ddc48-5973-4ab0-980d-27082311bba9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:57.944947 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5ddc48-5973-4ab0-980d-27082311bba9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:50:57.945252 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5ddc48-5973-4ab0-980d-27082311bba9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:57.947175 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5ddc48-5973-4ab0-980d-27082311bba9 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:57.948013 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59369669-b6f4-4eb7-92ac-f3b2c55b5079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:57.948679 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59369669-b6f4-4eb7-92ac-f3b2c55b5079 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:57.949068 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59369669-b6f4-4eb7-92ac-f3b2c55b5079 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:57.949289 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59369669-b6f4-4eb7-92ac-f3b2c55b5079 admin admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:57.950356 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59369669-b6f4-4eb7-92ac-f3b2c55b5079 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:50:57.950356 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59369669-b6f4-4eb7-92ac-f3b2c55b5079 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:57.952794 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59369669-b6f4-4eb7-92ac-f3b2c55b5079 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:57.964397 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1126/2242] 10.222.0.15 () {58 vars in 1152 bytes} [Tue May 31 14:50:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 14:50:57.965294 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1117/2243] 10.222.0.15 () {58 vars in 1152 bytes} [Tue May 31 14:50:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 14:50:57.969614 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59369669-b6f4-4eb7-92ac-f3b2c55b5079 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:57.972034 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5ddc48-5973-4ab0-980d-27082311bba9 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:57.980897 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59369669-b6f4-4eb7-92ac-f3b2c55b5079 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:57.985123 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5ddc48-5973-4ab0-980d-27082311bba9 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:57.986181 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdf7638-c3ec-4c34-96fd-791de4715e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:57.986933 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf7638-c3ec-4c34-96fd-791de4715e33 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:57.987162 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf7638-c3ec-4c34-96fd-791de4715e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:57.987637 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf7638-c3ec-4c34-96fd-791de4715e33 admin admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:57.988131 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdf7638-c3ec-4c34-96fd-791de4715e33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:57.990121 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdf7638-c3ec-4c34-96fd-791de4715e33 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:57.990839 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210661e6-5125-405f-ab45-02974f6f2648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:57.991737 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210661e6-5125-405f-ab45-02974f6f2648 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:57.992176 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210661e6-5125-405f-ab45-02974f6f2648 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:57.992464 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210661e6-5125-405f-ab45-02974f6f2648 admin admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:57.993536 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210661e6-5125-405f-ab45-02974f6f2648 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:57.995607 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210661e6-5125-405f-ab45-02974f6f2648 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:58.066808 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1118/2244] 10.222.0.15 () {60 vars in 1152 bytes} [Tue May 31 14:50:57 2022] POST /identity/v3/projects => generated 397 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 14:50:58.070736 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdf7638-c3ec-4c34-96fd-791de4715e33 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:58.084460 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:58.092113 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1127/2245] 10.222.0.15 () {60 vars in 1152 bytes} [Tue May 31 14:50:57 2022] POST /identity/v3/projects => generated 383 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:50:58.097609 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210661e6-5125-405f-ab45-02974f6f2648 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:58.160578 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdf7638-c3ec-4c34-96fd-791de4715e33 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:58.177049 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210661e6-5125-405f-ab45-02974f6f2648 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:58.182078 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c797cb28-d73b-4522-9d1b-49248bd2cb2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:58.182774 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c797cb28-d73b-4522-9d1b-49248bd2cb2e admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:58.183065 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c797cb28-d73b-4522-9d1b-49248bd2cb2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:58.183346 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c797cb28-d73b-4522-9d1b-49248bd2cb2e admin admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:58.184042 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c797cb28-d73b-4522-9d1b-49248bd2cb2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:58.186132 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c797cb28-d73b-4522-9d1b-49248bd2cb2e admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:58.227732 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7175c1ec-ee3b-41d3-9a2f-42254d5e1f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:58.228630 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7175c1ec-ee3b-41d3-9a2f-42254d5e1f4e admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:58.229031 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7175c1ec-ee3b-41d3-9a2f-42254d5e1f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:58.229408 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7175c1ec-ee3b-41d3-9a2f-42254d5e1f4e admin admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:58.230260 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7175c1ec-ee3b-41d3-9a2f-42254d5e1f4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:58.232405 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7175c1ec-ee3b-41d3-9a2f-42254d5e1f4e admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:58.246729 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1128/2246] 10.222.0.15 () {60 vars in 1143 bytes} [Tue May 31 14:50:58 2022] POST /identity/v3/users => generated 292 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:50:58.249096 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c797cb28-d73b-4522-9d1b-49248bd2cb2e admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:58.254415 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:58.259412 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c797cb28-d73b-4522-9d1b-49248bd2cb2e admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:58.264118 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0344cd97-cd88-4c36-8478-fdc79439a8bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:58.265293 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0344cd97-cd88-4c36-8478-fdc79439a8bf admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:58.265577 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0344cd97-cd88-4c36-8478-fdc79439a8bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:58.265855 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0344cd97-cd88-4c36-8478-fdc79439a8bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:58.266669 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0344cd97-cd88-4c36-8478-fdc79439a8bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:58.268404 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0344cd97-cd88-4c36-8478-fdc79439a8bf admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:58.285582 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1129/2247] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:50:58 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:50:58.289821 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0344cd97-cd88-4c36-8478-fdc79439a8bf admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:58.304694 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0344cd97-cd88-4c36-8478-fdc79439a8bf admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:58.306327 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1119/2248] 10.222.0.15 () {60 vars in 1143 bytes} [Tue May 31 14:50:58 2022] POST /identity/v3/users => generated 299 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 14:50:58.311568 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7175c1ec-ee3b-41d3-9a2f-42254d5e1f4e admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:58.313803 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e15fdc-62b8-4b9f-bf5f-96a234c26fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:58.315544 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e15fdc-62b8-4b9f-bf5f-96a234c26fab admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:58.315544 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e15fdc-62b8-4b9f-bf5f-96a234c26fab admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:58.315544 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e15fdc-62b8-4b9f-bf5f-96a234c26fab admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:58.315544 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e15fdc-62b8-4b9f-bf5f-96a234c26fab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:58.317556 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e15fdc-62b8-4b9f-bf5f-96a234c26fab admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:58.324953 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7175c1ec-ee3b-41d3-9a2f-42254d5e1f4e admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:58.328961 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1130/2249] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:50:58 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 14:50:58.333452 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e15fdc-62b8-4b9f-bf5f-96a234c26fab admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:58.334267 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16033743-069d-4782-ab1e-63791f962e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:58.335077 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16033743-069d-4782-ab1e-63791f962e24 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:58.335351 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16033743-069d-4782-ab1e-63791f962e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:58.335641 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16033743-069d-4782-ab1e-63791f962e24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:58.336372 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16033743-069d-4782-ab1e-63791f962e24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:58.338116 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16033743-069d-4782-ab1e-63791f962e24 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:58.345799 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e15fdc-62b8-4b9f-bf5f-96a234c26fab admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:58.349422 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1120/2250] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:50:58 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 14:50:58.351691 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0a1079-30a1-4e71-aaac-de0c593048f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:58.352745 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a1079-30a1-4e71-aaac-de0c593048f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:58.353037 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a1079-30a1-4e71-aaac-de0c593048f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:58.353315 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a1079-30a1-4e71-aaac-de0c593048f4 admin admin] PATH_INFO: `/v3/projects/cb489d0d396a4bcf82ddbeabf87e7dd8/users/eb54e5e20ad54a45abc4262df266a7d0/roles/317f725e26bf43648d8235bb1f7c4cb3` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:58.353420 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16033743-069d-4782-ab1e-63791f962e24 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:58.366978 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16033743-069d-4782-ab1e-63791f962e24 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:58.372042 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0a1079-30a1-4e71-aaac-de0c593048f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb489d0d396a4bcf82ddbeabf87e7dd8, user_id=eb54e5e20ad54a45abc4262df266a7d0, role_id=317f725e26bf43648d8235bb1f7c4cb3)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:58.372175 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636cb58f-cccb-472a-8432-b97a342d034e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:58.372371 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636cb58f-cccb-472a-8432-b97a342d034e admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:58.372645 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0a1079-30a1-4e71-aaac-de0c593048f4 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:58.372738 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636cb58f-cccb-472a-8432-b97a342d034e admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:58.372932 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636cb58f-cccb-472a-8432-b97a342d034e admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:58.374295 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636cb58f-cccb-472a-8432-b97a342d034e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:58.375963 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636cb58f-cccb-472a-8432-b97a342d034e admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:58.387087 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1121/2251] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:50:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 14:50:58.391795 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636cb58f-cccb-472a-8432-b97a342d034e admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:58.401547 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636cb58f-cccb-472a-8432-b97a342d034e admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:58.407041 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5ca376-6cf3-464b-9da0-af26ed934a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:58.407950 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ca376-6cf3-464b-9da0-af26ed934a9c admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:58.408274 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ca376-6cf3-464b-9da0-af26ed934a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:58.408609 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ca376-6cf3-464b-9da0-af26ed934a9c admin admin] PATH_INFO: `/v3/projects/f96091f8c57e4b6eaf274de6bbcb552b/users/2e902e1be7ec4adb8ea1964e3be02231/roles/317f725e26bf43648d8235bb1f7c4cb3` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:58.424465 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5ca376-6cf3-464b-9da0-af26ed934a9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f96091f8c57e4b6eaf274de6bbcb552b, user_id=2e902e1be7ec4adb8ea1964e3be02231, role_id=317f725e26bf43648d8235bb1f7c4cb3)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:58.427209 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5ca376-6cf3-464b-9da0-af26ed934a9c admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:58.501245 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1131/2252] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:50:58 2022] PUT /identity/v3/projects/cb489d0d396a4bcf82ddbeabf87e7dd8/users/eb54e5e20ad54a45abc4262df266a7d0/roles/317f725e26bf43648d8235bb1f7c4cb3 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 14:50:58.511454 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c488da48-6495-4d60-a08f-25d087594a56 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:58.511742 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c488da48-6495-4d60-a08f-25d087594a56 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:58.512021 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c488da48-6495-4d60-a08f-25d087594a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:58.535234 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1122/2253] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:50:58 2022] PUT /identity/v3/projects/f96091f8c57e4b6eaf274de6bbcb552b/users/2e902e1be7ec4adb8ea1964e3be02231/roles/317f725e26bf43648d8235bb1f7c4cb3 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 14:50:58.546769 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f168f6b4-e22f-4993-b0ad-642859b4bba6 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:58.547102 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f168f6b4-e22f-4993-b0ad-642859b4bba6 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:58.547495 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f168f6b4-e22f-4993-b0ad-642859b4bba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:58.551714 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-c488da48-6495-4d60-a08f-25d087594a56 None None] MFA Rules not processed for user `eb54e5e20ad54a45abc4262df266a7d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:50:58.554944 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-c488da48-6495-4d60-a08f-25d087594a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:58.579466 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-f168f6b4-e22f-4993-b0ad-642859b4bba6 None None] MFA Rules not processed for user `2e902e1be7ec4adb8ea1964e3be02231`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:50:58.581284 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-f168f6b4-e22f-4993-b0ad-642859b4bba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:58.641911 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1132/2254] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:50:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 14:50:58.647124 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c488da48-6495-4d60-a08f-25d087594a56 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:58.680401 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1123/2255] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:50:58 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:50:58.681291 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:58.692291 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f168f6b4-e22f-4993-b0ad-642859b4bba6 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:58.693843 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-f168f6b4-e22f-4993-b0ad-642859b4bba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:58.718779 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c488da48-6495-4d60-a08f-25d087594a56 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:58.725290 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656b2c03-d87f-479a-b561-852d8a3794ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:58.727356 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656b2c03-d87f-479a-b561-852d8a3794ba admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:58.727793 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656b2c03-d87f-479a-b561-852d8a3794ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:58.728258 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656b2c03-d87f-479a-b561-852d8a3794ba admin admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:58.729307 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656b2c03-d87f-479a-b561-852d8a3794ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:58.732468 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656b2c03-d87f-479a-b561-852d8a3794ba admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:58.744938 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:58.790688 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f168f6b4-e22f-4993-b0ad-642859b4bba6 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:58.794747 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9143d143-2252-47b9-8f2b-853c13fc4355 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afbf718dcd9b4741a926b0a2321bd53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:58.795436 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9143d143-2252-47b9-8f2b-853c13fc4355 service cinder] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:58.795723 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9143d143-2252-47b9-8f2b-853c13fc4355 service cinder] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:58.796042 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9143d143-2252-47b9-8f2b-853c13fc4355 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:58.820599 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9143d143-2252-47b9-8f2b-853c13fc4355 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:58.822138 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9143d143-2252-47b9-8f2b-853c13fc4355 service cinder] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:58.832504 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1124/2256] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:50:58 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 14:50:58.848799 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1133/2257] 10.222.0.15 () {60 vars in 1152 bytes} [Tue May 31 14:50:58 2022] POST /identity/v3/projects => generated 383 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 14:50:58.849926 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9143d143-2252-47b9-8f2b-853c13fc4355 service cinder] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:58.883105 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9143d143-2252-47b9-8f2b-853c13fc4355 service cinder] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:58.937863 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cea02c7-42f9-4cdc-b41e-da991813d2ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:58.938538 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cea02c7-42f9-4cdc-b41e-da991813d2ba admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:58.938922 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cea02c7-42f9-4cdc-b41e-da991813d2ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:58.939166 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cea02c7-42f9-4cdc-b41e-da991813d2ba admin admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:58.939866 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cea02c7-42f9-4cdc-b41e-da991813d2ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:58.941795 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cea02c7-42f9-4cdc-b41e-da991813d2ba admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:59.009241 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1125/2258] 10.222.0.15 () {60 vars in 1143 bytes} [Tue May 31 14:50:58 2022] POST /identity/v3/users => generated 298 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:50:59.009419 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656b2c03-d87f-479a-b561-852d8a3794ba admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:59.043172 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656b2c03-d87f-479a-b561-852d8a3794ba admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:59.049317 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2e76fb-3a8f-480d-ba40-2f42f80e4b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:59.049976 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2e76fb-3a8f-480d-ba40-2f42f80e4b62 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:59.050256 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2e76fb-3a8f-480d-ba40-2f42f80e4b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:59.050528 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2e76fb-3a8f-480d-ba40-2f42f80e4b62 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:59.051365 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2e76fb-3a8f-480d-ba40-2f42f80e4b62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:59.053061 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2e76fb-3a8f-480d-ba40-2f42f80e4b62 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:59.064558 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1134/2259] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:50:59 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:50:59.069012 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cea02c7-42f9-4cdc-b41e-da991813d2ba admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:59.079588 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cea02c7-42f9-4cdc-b41e-da991813d2ba admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:59.084415 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330d3e68-90c8-4b94-bbca-72576e46425c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:59.085338 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d3e68-90c8-4b94-bbca-72576e46425c admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:59.085663 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d3e68-90c8-4b94-bbca-72576e46425c admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:59.085893 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d3e68-90c8-4b94-bbca-72576e46425c admin admin] PATH_INFO: `/v3/projects/f7b65a7eb17c4b798fd94cbbecd6b639/users/0d6735487c2a42d993054287a1e9dfe3/roles/76c53e2c353644f885028a0226c06146` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:59.100879 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330d3e68-90c8-4b94-bbca-72576e46425c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7b65a7eb17c4b798fd94cbbecd6b639, user_id=0d6735487c2a42d993054287a1e9dfe3, role_id=76c53e2c353644f885028a0226c06146)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:59.103579 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330d3e68-90c8-4b94-bbca-72576e46425c admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:59.176701 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1126/2260] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:50:59 2022] PUT /identity/v3/projects/f7b65a7eb17c4b798fd94cbbecd6b639/users/0d6735487c2a42d993054287a1e9dfe3/roles/76c53e2c353644f885028a0226c06146 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:50:59.180780 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2e76fb-3a8f-480d-ba40-2f42f80e4b62 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:59.191528 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2e76fb-3a8f-480d-ba40-2f42f80e4b62 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:59.258377 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102636da-0d44-43b5-95e1-48bf09c07f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:59.259102 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102636da-0d44-43b5-95e1-48bf09c07f2c admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:59.259434 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102636da-0d44-43b5-95e1-48bf09c07f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:59.259658 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102636da-0d44-43b5-95e1-48bf09c07f2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:59.260571 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102636da-0d44-43b5-95e1-48bf09c07f2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:59.262219 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102636da-0d44-43b5-95e1-48bf09c07f2c admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:59.272520 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1135/2261] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:50:59 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:50:59.276689 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330d3e68-90c8-4b94-bbca-72576e46425c admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:59.288735 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330d3e68-90c8-4b94-bbca-72576e46425c admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:59.294260 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02c951f-5cb0-4989-9765-0a5a93c3fdb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:59.296396 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c951f-5cb0-4989-9765-0a5a93c3fdb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:59.296396 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c951f-5cb0-4989-9765-0a5a93c3fdb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:59.296396 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c951f-5cb0-4989-9765-0a5a93c3fdb2 admin admin] PATH_INFO: `/v3/projects/f7b65a7eb17c4b798fd94cbbecd6b639/users/0d6735487c2a42d993054287a1e9dfe3/roles/76c53e2c353644f885028a0226c06146` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:59.298534 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02c951f-5cb0-4989-9765-0a5a93c3fdb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7b65a7eb17c4b798fd94cbbecd6b639, user_id=0d6735487c2a42d993054287a1e9dfe3, role_id=76c53e2c353644f885028a0226c06146)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:59.303746 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02c951f-5cb0-4989-9765-0a5a93c3fdb2 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:59.313152 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1127/2262] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:50:59 2022] PUT /identity/v3/projects/f7b65a7eb17c4b798fd94cbbecd6b639/users/0d6735487c2a42d993054287a1e9dfe3/roles/76c53e2c353644f885028a0226c06146 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:50:59.325554 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9948711f-174a-47af-803f-625c4cbe3ae1 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:59.325855 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9948711f-174a-47af-803f-625c4cbe3ae1 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:59.326764 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9948711f-174a-47af-803f-625c4cbe3ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:59.360738 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-9948711f-174a-47af-803f-625c4cbe3ae1 None None] MFA Rules not processed for user `0d6735487c2a42d993054287a1e9dfe3`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:50:59.362250 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-9948711f-174a-47af-803f-625c4cbe3ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:50:59.422074 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:59.432512 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1136/2263] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:50:59 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:50:59.443379 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02c951f-5cb0-4989-9765-0a5a93c3fdb2 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:50:59.491326 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:50:59.501415 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02c951f-5cb0-4989-9765-0a5a93c3fdb2 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:50:59.505186 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1c6510-1e08-47be-8672-6157ec29441c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afbf718dcd9b4741a926b0a2321bd53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:50:59.505838 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1c6510-1e08-47be-8672-6157ec29441c service cinder] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:50:59.506135 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1c6510-1e08-47be-8672-6157ec29441c service cinder] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:50:59.506416 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1c6510-1e08-47be-8672-6157ec29441c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:50:59.562991 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1c6510-1e08-47be-8672-6157ec29441c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:50:59.564451 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1c6510-1e08-47be-8672-6157ec29441c service cinder] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:50:59.573269 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1128/2264] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:50:59 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:51:01.666744 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9948711f-174a-47af-803f-625c4cbe3ae1 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:51:01.668164 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-9948711f-174a-47af-803f-625c4cbe3ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:51:01.752924 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9948711f-174a-47af-803f-625c4cbe3ae1 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:51:01.761446 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f13f1f0-6fd2-4745-bf55-9ce1e4c3ed42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:51:01.762427 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13f1f0-6fd2-4745-bf55-9ce1e4c3ed42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:51:01.762786 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13f1f0-6fd2-4745-bf55-9ce1e4c3ed42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:51:01.763115 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13f1f0-6fd2-4745-bf55-9ce1e4c3ed42 admin admin] PATH_INFO: `/v3/users/93f71b153790435dbf337424c40106c8` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:51:01.764861 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f13f1f0-6fd2-4745-bf55-9ce1e4c3ed42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93f71b153790435dbf337424c40106c8)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:51:01.766837 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f13f1f0-6fd2-4745-bf55-9ce1e4c3ed42 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:51:01.949011 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-1f13f1f0-6fd2-4745-bf55-9ce1e4c3ed42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93f71b153790435dbf337424c40106c8'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:51:02.009330 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-1f13f1f0-6fd2-4745-bf55-9ce1e4c3ed42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93f71b153790435dbf337424c40106c8'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:51:02.009961 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-1f13f1f0-6fd2-4745-bf55-9ce1e4c3ed42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93f71b153790435dbf337424c40106c8'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:51:02.017854 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-1f13f1f0-6fd2-4745-bf55-9ce1e4c3ed42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93f71b153790435dbf337424c40106c8'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:51:02.018507 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-1f13f1f0-6fd2-4745-bf55-9ce1e4c3ed42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93f71b153790435dbf337424c40106c8'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:51:02.036448 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1137/2265] 10.222.0.15 () {58 vars in 1223 bytes} [Tue May 31 14:51:01 2022] DELETE /identity/v3/users/93f71b153790435dbf337424c40106c8 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:51:02.041136 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67abbbb-152e-4ae3-9dbb-28366ce820ab None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:51:02.041610 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67abbbb-152e-4ae3-9dbb-28366ce820ab None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:51:02.041771 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67abbbb-152e-4ae3-9dbb-28366ce820ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:51:02.060423 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-d67abbbb-152e-4ae3-9dbb-28366ce820ab None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:51:02.062262 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-d67abbbb-152e-4ae3-9dbb-28366ce820ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:51:02.121655 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1129/2266] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:51:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:51:02.136841 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f13f1f0-6fd2-4745-bf55-9ce1e4c3ed42 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:51:02.138439 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-1f13f1f0-6fd2-4745-bf55-9ce1e4c3ed42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:51:02.222777 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f13f1f0-6fd2-4745-bf55-9ce1e4c3ed42 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:51:02.226617 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec75503f-5bc9-4c94-9c86-d4aa8abf3f6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:51:02.227350 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec75503f-5bc9-4c94-9c86-d4aa8abf3f6d service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:51:02.227700 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec75503f-5bc9-4c94-9c86-d4aa8abf3f6d service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:51:02.227982 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec75503f-5bc9-4c94-9c86-d4aa8abf3f6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:51:02.236742 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:51:02.241864 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec75503f-5bc9-4c94-9c86-d4aa8abf3f6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:51:02.241864 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec75503f-5bc9-4c94-9c86-d4aa8abf3f6d service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:51:02.254110 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1138/2267] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:51:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:51:02.691812 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67abbbb-152e-4ae3-9dbb-28366ce820ab None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:51:02.693497 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-d67abbbb-152e-4ae3-9dbb-28366ce820ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:51:02.706801 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67abbbb-152e-4ae3-9dbb-28366ce820ab None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:51:02.711995 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d365cb-cfe4-4e2e-a19f-3997727105a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:51:02.713375 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d365cb-cfe4-4e2e-a19f-3997727105a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:51:02.713531 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d365cb-cfe4-4e2e-a19f-3997727105a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:51:02.717119 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d365cb-cfe4-4e2e-a19f-3997727105a7 admin admin] PATH_INFO: `/v3/projects/7540639f2b044cdab7958e343db0f768` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:51:02.721376 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d365cb-cfe4-4e2e-a19f-3997727105a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7540639f2b044cdab7958e343db0f768)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:51:02.723130 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d365cb-cfe4-4e2e-a19f-3997727105a7 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:51:02.851621 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-c4d365cb-cfe4-4e2e-a19f-3997727105a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7540639f2b044cdab7958e343db0f768', 'request_id': 'req-c4d365cb-cfe4-4e2e-a19f-3997727105a7'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:51:02.858458 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-c4d365cb-cfe4-4e2e-a19f-3997727105a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7540639f2b044cdab7958e343db0f768', 'request_id': 'req-c4d365cb-cfe4-4e2e-a19f-3997727105a7'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:51:02.940431 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-c4d365cb-cfe4-4e2e-a19f-3997727105a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7540639f2b044cdab7958e343db0f768', 'request_id': 'req-c4d365cb-cfe4-4e2e-a19f-3997727105a7'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:51:02.953034 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-c4d365cb-cfe4-4e2e-a19f-3997727105a7 admin admin] The token cache is being invalidate because project 7540639f2b044cdab7958e343db0f768 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 14:51:02.953327 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-c4d365cb-cfe4-4e2e-a19f-3997727105a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:51:02.953981 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-c4d365cb-cfe4-4e2e-a19f-3997727105a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:51:02.955586 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1130/2268] 10.222.0.15 () {58 vars in 1232 bytes} [Tue May 31 14:51:02 2022] DELETE /identity/v3/projects/7540639f2b044cdab7958e343db0f768 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:51:02.959521 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec75503f-5bc9-4c94-9c86-d4aa8abf3f6d service neutron] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:51:02.973388 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec75503f-5bc9-4c94-9c86-d4aa8abf3f6d service neutron] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:51:03.044631 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a3bbab-b101-4f0a-aeba-55556e037397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:51:03.045557 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a3bbab-b101-4f0a-aeba-55556e037397 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:51:03.045837 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a3bbab-b101-4f0a-aeba-55556e037397 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:51:03.046112 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a3bbab-b101-4f0a-aeba-55556e037397 admin admin] PATH_INFO: `/v3/users/c92881612aab4a9cb0a21e186256839f` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:51:03.047412 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a3bbab-b101-4f0a-aeba-55556e037397 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c92881612aab4a9cb0a21e186256839f)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:51:03.049767 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a3bbab-b101-4f0a-aeba-55556e037397 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:51:03.172109 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-a6a3bbab-b101-4f0a-aeba-55556e037397 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c92881612aab4a9cb0a21e186256839f'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:51:03.231683 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-a6a3bbab-b101-4f0a-aeba-55556e037397 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c92881612aab4a9cb0a21e186256839f'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:51:03.232330 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-a6a3bbab-b101-4f0a-aeba-55556e037397 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c92881612aab4a9cb0a21e186256839f'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:51:03.240459 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-a6a3bbab-b101-4f0a-aeba-55556e037397 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c92881612aab4a9cb0a21e186256839f'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:51:03.241284 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-a6a3bbab-b101-4f0a-aeba-55556e037397 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c92881612aab4a9cb0a21e186256839f'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:51:03.260335 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1139/2269] 10.222.0.15 () {58 vars in 1223 bytes} [Tue May 31 14:51:02 2022] DELETE /identity/v3/users/c92881612aab4a9cb0a21e186256839f => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 14:51:03.726822 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d365cb-cfe4-4e2e-a19f-3997727105a7 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:51:03.728263 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-c4d365cb-cfe4-4e2e-a19f-3997727105a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:51:03.767551 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:51:03.770354 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d365cb-cfe4-4e2e-a19f-3997727105a7 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:51:03.825613 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f2827a-80cb-4414-88bd-4e0c8c2ce72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:51:03.826479 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2827a-80cb-4414-88bd-4e0c8c2ce72a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:51:03.826797 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2827a-80cb-4414-88bd-4e0c8c2ce72a admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:51:03.827080 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2827a-80cb-4414-88bd-4e0c8c2ce72a admin admin] PATH_INFO: `/v3/projects/a5aa80cba0da4ae7b2924df7cb42ac5f` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:51:03.828396 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f2827a-80cb-4414-88bd-4e0c8c2ce72a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5aa80cba0da4ae7b2924df7cb42ac5f)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:51:03.830473 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f2827a-80cb-4414-88bd-4e0c8c2ce72a admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:51:03.981762 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-d6f2827a-80cb-4414-88bd-4e0c8c2ce72a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5aa80cba0da4ae7b2924df7cb42ac5f', 'request_id': 'req-d6f2827a-80cb-4414-88bd-4e0c8c2ce72a'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:51:03.989396 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-d6f2827a-80cb-4414-88bd-4e0c8c2ce72a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5aa80cba0da4ae7b2924df7cb42ac5f', 'request_id': 'req-d6f2827a-80cb-4414-88bd-4e0c8c2ce72a'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:51:04.077899 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-d6f2827a-80cb-4414-88bd-4e0c8c2ce72a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5aa80cba0da4ae7b2924df7cb42ac5f', 'request_id': 'req-d6f2827a-80cb-4414-88bd-4e0c8c2ce72a'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:51:04.089058 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-d6f2827a-80cb-4414-88bd-4e0c8c2ce72a admin admin] The token cache is being invalidate because project a5aa80cba0da4ae7b2924df7cb42ac5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 14:51:04.089387 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-d6f2827a-80cb-4414-88bd-4e0c8c2ce72a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:51:04.090129 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-d6f2827a-80cb-4414-88bd-4e0c8c2ce72a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:51:04.092050 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1131/2270] 10.222.0.15 () {58 vars in 1232 bytes} [Tue May 31 14:51:03 2022] DELETE /identity/v3/projects/a5aa80cba0da4ae7b2924df7cb42ac5f => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 14:51:04.096570 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a3bbab-b101-4f0a-aeba-55556e037397 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:51:04.098069 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-a6a3bbab-b101-4f0a-aeba-55556e037397 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:51:04.130803 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a3bbab-b101-4f0a-aeba-55556e037397 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:51:04.182822 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:51:04.188788 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07da8e39-6042-406c-94ab-ee4c321b44fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:51:04.189706 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da8e39-6042-406c-94ab-ee4c321b44fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:51:04.189992 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da8e39-6042-406c-94ab-ee4c321b44fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:51:04.190268 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da8e39-6042-406c-94ab-ee4c321b44fb admin admin] PATH_INFO: `/v3/users/1cf4ec662ff34885b177e74344f2db2d` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:51:04.191575 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07da8e39-6042-406c-94ab-ee4c321b44fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cf4ec662ff34885b177e74344f2db2d)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:51:04.193550 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07da8e39-6042-406c-94ab-ee4c321b44fb admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:51:04.369074 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-07da8e39-6042-406c-94ab-ee4c321b44fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cf4ec662ff34885b177e74344f2db2d'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:51:04.449211 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-07da8e39-6042-406c-94ab-ee4c321b44fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cf4ec662ff34885b177e74344f2db2d'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:51:04.449889 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-07da8e39-6042-406c-94ab-ee4c321b44fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cf4ec662ff34885b177e74344f2db2d'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:51:04.458256 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-07da8e39-6042-406c-94ab-ee4c321b44fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cf4ec662ff34885b177e74344f2db2d'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:51:04.459640 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-07da8e39-6042-406c-94ab-ee4c321b44fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cf4ec662ff34885b177e74344f2db2d'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:51:04.486604 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1140/2271] 10.222.0.15 () {58 vars in 1223 bytes} [Tue May 31 14:51:04 2022] DELETE /identity/v3/users/1cf4ec662ff34885b177e74344f2db2d => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:51:04.586289 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f2827a-80cb-4414-88bd-4e0c8c2ce72a admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:51:04.587896 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-d6f2827a-80cb-4414-88bd-4e0c8c2ce72a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:51:04.649438 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f2827a-80cb-4414-88bd-4e0c8c2ce72a admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:51:04.699772 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb98f7c-afc3-4796-977c-49de1e5b7bd9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afbf718dcd9b4741a926b0a2321bd53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:51:04.700427 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb98f7c-afc3-4796-977c-49de1e5b7bd9 service cinder] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:51:04.700715 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb98f7c-afc3-4796-977c-49de1e5b7bd9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:51:04.700993 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb98f7c-afc3-4796-977c-49de1e5b7bd9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:51:04.703415 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-ffb98f7c-afc3-4796-977c-49de1e5b7bd9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:51:04.709275 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:51:04.772621 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb98f7c-afc3-4796-977c-49de1e5b7bd9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:51:04.774214 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb98f7c-afc3-4796-977c-49de1e5b7bd9 service cinder] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:51:04.784094 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1132/2272] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:51:04 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:51:04.999887 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07da8e39-6042-406c-94ab-ee4c321b44fb admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:51:05.001510 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-07da8e39-6042-406c-94ab-ee4c321b44fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:51:05.083697 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07da8e39-6042-406c-94ab-ee4c321b44fb admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:51:05.090819 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f42ad5e-4744-46ab-9e5a-7206e5d0284a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:51:05.091692 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f42ad5e-4744-46ab-9e5a-7206e5d0284a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:51:05.092086 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f42ad5e-4744-46ab-9e5a-7206e5d0284a admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:51:05.092260 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f42ad5e-4744-46ab-9e5a-7206e5d0284a admin admin] PATH_INFO: `/v3/projects/de038ea7076841c7b1a17ad3d73516f2` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:51:05.093493 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f42ad5e-4744-46ab-9e5a-7206e5d0284a admin admin] RBAC: Authorizing `identity:delete_project(project_id=de038ea7076841c7b1a17ad3d73516f2)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:51:05.095515 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f42ad5e-4744-46ab-9e5a-7206e5d0284a admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:51:05.176088 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb98f7c-afc3-4796-977c-49de1e5b7bd9 service cinder] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:51:05.178100 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-ffb98f7c-afc3-4796-977c-49de1e5b7bd9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:51:05.194003 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb98f7c-afc3-4796-977c-49de1e5b7bd9 service cinder] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:51:05.203794 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b19386-4b81-4524-9291-b78d8e9e2910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:51:05.206884 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b19386-4b81-4524-9291-b78d8e9e2910 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:51:05.206884 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b19386-4b81-4524-9291-b78d8e9e2910 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:51:05.206884 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b19386-4b81-4524-9291-b78d8e9e2910 admin admin] PATH_INFO: `/v3/users/2e902e1be7ec4adb8ea1964e3be02231` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:51:05.206884 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b19386-4b81-4524-9291-b78d8e9e2910 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e902e1be7ec4adb8ea1964e3be02231)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:51:05.213135 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b19386-4b81-4524-9291-b78d8e9e2910 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:51:05.239742 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-2f42ad5e-4744-46ab-9e5a-7206e5d0284a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de038ea7076841c7b1a17ad3d73516f2', 'request_id': 'req-2f42ad5e-4744-46ab-9e5a-7206e5d0284a'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:51:05.301084 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-2f42ad5e-4744-46ab-9e5a-7206e5d0284a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de038ea7076841c7b1a17ad3d73516f2', 'request_id': 'req-2f42ad5e-4744-46ab-9e5a-7206e5d0284a'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:51:05.307868 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-2f42ad5e-4744-46ab-9e5a-7206e5d0284a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de038ea7076841c7b1a17ad3d73516f2', 'request_id': 'req-2f42ad5e-4744-46ab-9e5a-7206e5d0284a'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:51:05.325984 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-2f42ad5e-4744-46ab-9e5a-7206e5d0284a admin admin] The token cache is being invalidate because project de038ea7076841c7b1a17ad3d73516f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80503) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 14:51:05.326357 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-2f42ad5e-4744-46ab-9e5a-7206e5d0284a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:51:05.327805 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-2f42ad5e-4744-46ab-9e5a-7206e5d0284a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:51:05.330035 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1141/2273] 10.222.0.15 () {58 vars in 1232 bytes} [Tue May 31 14:51:04 2022] DELETE /identity/v3/projects/de038ea7076841c7b1a17ad3d73516f2 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:51:05.335227 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118772b9-f5d1-4399-b702-c1b54e7cd6c7 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:51:05.335543 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118772b9-f5d1-4399-b702-c1b54e7cd6c7 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:51:05.335743 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118772b9-f5d1-4399-b702-c1b54e7cd6c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:51:05.345218 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:51:05.387785 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-118772b9-f5d1-4399-b702-c1b54e7cd6c7 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:51:05.389269 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-118772b9-f5d1-4399-b702-c1b54e7cd6c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:51:05.393298 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-20b19386-4b81-4524-9291-b78d8e9e2910 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e902e1be7ec4adb8ea1964e3be02231'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:51:05.400567 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-20b19386-4b81-4524-9291-b78d8e9e2910 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e902e1be7ec4adb8ea1964e3be02231'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:51:05.401247 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-20b19386-4b81-4524-9291-b78d8e9e2910 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e902e1be7ec4adb8ea1964e3be02231'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:51:05.402102 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-20b19386-4b81-4524-9291-b78d8e9e2910 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e902e1be7ec4adb8ea1964e3be02231'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:51:05.423177 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-20b19386-4b81-4524-9291-b78d8e9e2910 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e902e1be7ec4adb8ea1964e3be02231'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:51:05.458370 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1142/2274] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:51:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 14:51:05.466689 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dda99ed-e852-41d4-b715-898c1cbe8e7d None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:51:05.467057 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dda99ed-e852-41d4-b715-898c1cbe8e7d None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:51:05.467973 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dda99ed-e852-41d4-b715-898c1cbe8e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:51:05.489639 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-5dda99ed-e852-41d4-b715-898c1cbe8e7d None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:51:05.490944 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-5dda99ed-e852-41d4-b715-898c1cbe8e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:51:05.502909 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1143/2275] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:51:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 14:51:05.503855 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dda99ed-e852-41d4-b715-898c1cbe8e7d None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:51:05.513598 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dda99ed-e852-41d4-b715-898c1cbe8e7d None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:51:05.522044 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1133/2276] 10.222.0.15 () {58 vars in 1223 bytes} [Tue May 31 14:51:05 2022] DELETE /identity/v3/users/2e902e1be7ec4adb8ea1964e3be02231 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:51:05.522197 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747249e2-ed49-479a-835b-bba288d6bb5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:51:05.522197 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747249e2-ed49-479a-835b-bba288d6bb5d admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:51:05.522197 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747249e2-ed49-479a-835b-bba288d6bb5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:51:05.522197 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747249e2-ed49-479a-835b-bba288d6bb5d admin admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:51:05.524825 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747249e2-ed49-479a-835b-bba288d6bb5d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:51:05.525422 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747249e2-ed49-479a-835b-bba288d6bb5d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:51:05.528902 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747249e2-ed49-479a-835b-bba288d6bb5d admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:51:05.536411 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78a8a1a-e4b5-4762-bc54-684b3b6926db None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:51:05.536857 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78a8a1a-e4b5-4762-bc54-684b3b6926db None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:51:05.537261 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78a8a1a-e4b5-4762-bc54-684b3b6926db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:51:05.552563 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1144/2277] 10.222.0.15 () {58 vars in 1152 bytes} [Tue May 31 14:51:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:51:05.557451 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747249e2-ed49-479a-835b-bba288d6bb5d admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:51:05.562577 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-c78a8a1a-e4b5-4762-bc54-684b3b6926db None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:51:05.564223 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-c78a8a1a-e4b5-4762-bc54-684b3b6926db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:51:05.570813 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747249e2-ed49-479a-835b-bba288d6bb5d admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:51:05.650487 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461b0423-42eb-441f-8aad-815381a766d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:51:05.651003 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461b0423-42eb-441f-8aad-815381a766d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:51:05.651295 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461b0423-42eb-441f-8aad-815381a766d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:51:05.651606 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461b0423-42eb-441f-8aad-815381a766d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:51:05.652469 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461b0423-42eb-441f-8aad-815381a766d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:51:05.654436 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461b0423-42eb-441f-8aad-815381a766d0 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:51:05.658536 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1134/2278] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:51:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:51:05.671769 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78a8a1a-e4b5-4762-bc54-684b3b6926db None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:51:05.673265 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-c78a8a1a-e4b5-4762-bc54-684b3b6926db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:51:05.692505 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:51:05.738620 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1145/2279] 10.222.0.15 () {60 vars in 1152 bytes} [Tue May 31 14:51:05 2022] POST /identity/v3/projects => generated 381 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 14:51:05.739437 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78a8a1a-e4b5-4762-bc54-684b3b6926db None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:51:05.743337 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461b0423-42eb-441f-8aad-815381a766d0 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:51:05.803886 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108d9df1-4548-4178-94fa-6707a87c4232 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:51:05.804505 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108d9df1-4548-4178-94fa-6707a87c4232 service neutron] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:51:05.804793 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108d9df1-4548-4178-94fa-6707a87c4232 service neutron] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:51:05.805010 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:51:05.805132 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108d9df1-4548-4178-94fa-6707a87c4232 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:51:05.817876 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461b0423-42eb-441f-8aad-815381a766d0 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:51:05.823323 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c78168d-a996-4510-97de-8dda32579c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:51:05.824088 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c78168d-a996-4510-97de-8dda32579c30 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:51:05.824438 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c78168d-a996-4510-97de-8dda32579c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:51:05.824811 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c78168d-a996-4510-97de-8dda32579c30 admin admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:51:05.826347 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c78168d-a996-4510-97de-8dda32579c30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:51:05.829355 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c78168d-a996-4510-97de-8dda32579c30 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:51:05.870197 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108d9df1-4548-4178-94fa-6707a87c4232 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:51:05.871835 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108d9df1-4548-4178-94fa-6707a87c4232 service neutron] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:51:05.884354 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1135/2280] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:51:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:51:05.918979 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1146/2281] 10.222.0.15 () {60 vars in 1143 bytes} [Tue May 31 14:51:05 2022] POST /identity/v3/users => generated 291 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 14:51:05.923294 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108d9df1-4548-4178-94fa-6707a87c4232 service neutron] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:51:05.933695 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108d9df1-4548-4178-94fa-6707a87c4232 service neutron] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:51:05.939968 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c67d49-d403-426e-b339-36e85c6df038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:51:05.940686 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c67d49-d403-426e-b339-36e85c6df038 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:51:05.940969 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c67d49-d403-426e-b339-36e85c6df038 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:51:05.941260 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c67d49-d403-426e-b339-36e85c6df038 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:51:05.941999 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c67d49-d403-426e-b339-36e85c6df038 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:51:05.943649 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c67d49-d403-426e-b339-36e85c6df038 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:51:05.954442 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1136/2282] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:51:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:51:05.958960 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c78168d-a996-4510-97de-8dda32579c30 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:51:05.970356 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c78168d-a996-4510-97de-8dda32579c30 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:51:05.976508 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194cd729-643a-42cf-853c-484d123bb3c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:51:05.977186 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194cd729-643a-42cf-853c-484d123bb3c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:51:05.984100 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194cd729-643a-42cf-853c-484d123bb3c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:51:05.984100 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194cd729-643a-42cf-853c-484d123bb3c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:51:05.984100 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194cd729-643a-42cf-853c-484d123bb3c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:51:05.984100 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194cd729-643a-42cf-853c-484d123bb3c1 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:51:05.991141 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1147/2283] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:51:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 14:51:05.995296 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c67d49-d403-426e-b339-36e85c6df038 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:51:06.006810 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c67d49-d403-426e-b339-36e85c6df038 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:51:06.011758 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d3f391-3e2e-46de-9063-7f0f9f7f4559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:51:06.012703 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d3f391-3e2e-46de-9063-7f0f9f7f4559 admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:51:06.018700 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d3f391-3e2e-46de-9063-7f0f9f7f4559 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:51:06.018700 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d3f391-3e2e-46de-9063-7f0f9f7f4559 admin admin] PATH_INFO: `/v3/projects/8c9cd513bf8a41558758aa27441cb4ca/users/7a2ecbb7bd2447858e2a99cd78bd9982/roles/317f725e26bf43648d8235bb1f7c4cb3` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:51:06.028978 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d3f391-3e2e-46de-9063-7f0f9f7f4559 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c9cd513bf8a41558758aa27441cb4ca, user_id=7a2ecbb7bd2447858e2a99cd78bd9982, role_id=317f725e26bf43648d8235bb1f7c4cb3)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:51:06.032407 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d3f391-3e2e-46de-9063-7f0f9f7f4559 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:51:06.139888 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1137/2284] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:51:05 2022] PUT /identity/v3/projects/8c9cd513bf8a41558758aa27441cb4ca/users/7a2ecbb7bd2447858e2a99cd78bd9982/roles/317f725e26bf43648d8235bb1f7c4cb3 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:51:06.141985 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3760cef-5f12-448f-aa1a-885b250c4c13 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:51:06.141985 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3760cef-5f12-448f-aa1a-885b250c4c13 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:51:06.142256 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3760cef-5f12-448f-aa1a-885b250c4c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:51:06.160739 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-b3760cef-5f12-448f-aa1a-885b250c4c13 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:51:06.167736 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-b3760cef-5f12-448f-aa1a-885b250c4c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:51:06.222388 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1148/2285] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:51:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:51:06.244149 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d3f391-3e2e-46de-9063-7f0f9f7f4559 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:51:06.317880 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:51:06.331939 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d3f391-3e2e-46de-9063-7f0f9f7f4559 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:51:06.336458 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab29b4d-0501-4a49-9986-51417db9bf56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:51:06.337027 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab29b4d-0501-4a49-9986-51417db9bf56 service neutron] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:51:06.337610 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab29b4d-0501-4a49-9986-51417db9bf56 service neutron] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:51:06.337610 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab29b4d-0501-4a49-9986-51417db9bf56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:51:06.348286 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab29b4d-0501-4a49-9986-51417db9bf56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:51:06.350028 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab29b4d-0501-4a49-9986-51417db9bf56 service neutron] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:51:06.363051 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1138/2286] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:51:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:51:06.398027 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3760cef-5f12-448f-aa1a-885b250c4c13 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:51:06.400835 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-b3760cef-5f12-448f-aa1a-885b250c4c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:51:06.431078 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3760cef-5f12-448f-aa1a-885b250c4c13 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:51:06.443319 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a0618f-4dc1-44dd-a864-7ab5b306d336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:51:06.447104 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a0618f-4dc1-44dd-a864-7ab5b306d336 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:51:06.447104 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a0618f-4dc1-44dd-a864-7ab5b306d336 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:51:06.447104 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a0618f-4dc1-44dd-a864-7ab5b306d336 admin admin] PATH_INFO: `/v3/projects/f96091f8c57e4b6eaf274de6bbcb552b` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:51:06.455583 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a0618f-4dc1-44dd-a864-7ab5b306d336 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f96091f8c57e4b6eaf274de6bbcb552b)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:51:06.457751 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a0618f-4dc1-44dd-a864-7ab5b306d336 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:51:06.579686 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-32a0618f-4dc1-44dd-a864-7ab5b306d336 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f96091f8c57e4b6eaf274de6bbcb552b', 'request_id': 'req-32a0618f-4dc1-44dd-a864-7ab5b306d336'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:51:06.666888 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-32a0618f-4dc1-44dd-a864-7ab5b306d336 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f96091f8c57e4b6eaf274de6bbcb552b', 'request_id': 'req-32a0618f-4dc1-44dd-a864-7ab5b306d336'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:51:06.678794 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-32a0618f-4dc1-44dd-a864-7ab5b306d336 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f96091f8c57e4b6eaf274de6bbcb552b', 'request_id': 'req-32a0618f-4dc1-44dd-a864-7ab5b306d336'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:51:06.691717 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-32a0618f-4dc1-44dd-a864-7ab5b306d336 admin admin] The token cache is being invalidate because project f96091f8c57e4b6eaf274de6bbcb552b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80503) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 14:51:06.692086 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-32a0618f-4dc1-44dd-a864-7ab5b306d336 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:51:06.693446 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-32a0618f-4dc1-44dd-a864-7ab5b306d336 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:51:06.695239 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1149/2287] 10.222.0.15 () {58 vars in 1232 bytes} [Tue May 31 14:51:06 2022] DELETE /identity/v3/projects/f96091f8c57e4b6eaf274de6bbcb552b => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:51:06.701416 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09a2fb1-ccf3-4b49-bff9-f7e2fbfab96f None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:51:06.702568 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09a2fb1-ccf3-4b49-bff9-f7e2fbfab96f None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:51:06.702926 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09a2fb1-ccf3-4b49-bff9-f7e2fbfab96f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:51:06.730487 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-f09a2fb1-ccf3-4b49-bff9-f7e2fbfab96f None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:51:06.730487 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-f09a2fb1-ccf3-4b49-bff9-f7e2fbfab96f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:51:06.806529 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1139/2288] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:51:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:51:06.816535 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d12d060-bcc3-447b-a94f-62a17a7ccb4d None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:51:06.817088 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d12d060-bcc3-447b-a94f-62a17a7ccb4d None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:51:06.817373 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d12d060-bcc3-447b-a94f-62a17a7ccb4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:51:06.841769 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-2d12d060-bcc3-447b-a94f-62a17a7ccb4d None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:51:06.843310 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-2d12d060-bcc3-447b-a94f-62a17a7ccb4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:51:06.852895 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1150/2289] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:51:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 14:51:06.863817 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09a2fb1-ccf3-4b49-bff9-f7e2fbfab96f None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:51:06.874683 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09a2fb1-ccf3-4b49-bff9-f7e2fbfab96f None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:51:06.879596 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c61cc9a-3cd7-4971-b39f-77c51323f10e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:51:06.880286 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c61cc9a-3cd7-4971-b39f-77c51323f10e admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:51:06.880556 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c61cc9a-3cd7-4971-b39f-77c51323f10e admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:51:06.880840 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c61cc9a-3cd7-4971-b39f-77c51323f10e admin admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:51:06.881617 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c61cc9a-3cd7-4971-b39f-77c51323f10e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:51:06.882033 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c61cc9a-3cd7-4971-b39f-77c51323f10e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:51:06.883709 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c61cc9a-3cd7-4971-b39f-77c51323f10e admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:51:06.903513 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1140/2290] 10.222.0.15 () {58 vars in 1152 bytes} [Tue May 31 14:51:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:51:06.904930 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d12d060-bcc3-447b-a94f-62a17a7ccb4d None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:51:06.915053 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d12d060-bcc3-447b-a94f-62a17a7ccb4d None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:51:06.920112 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775c20f1-b95a-46a0-b6bc-c28a464b6c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:51:06.920838 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775c20f1-b95a-46a0-b6bc-c28a464b6c8f admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:51:06.921190 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775c20f1-b95a-46a0-b6bc-c28a464b6c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:51:06.921543 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775c20f1-b95a-46a0-b6bc-c28a464b6c8f admin admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:51:06.922463 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775c20f1-b95a-46a0-b6bc-c28a464b6c8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:51:06.924681 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775c20f1-b95a-46a0-b6bc-c28a464b6c8f admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:51:07.011217 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1151/2291] 10.222.0.15 () {60 vars in 1152 bytes} [Tue May 31 14:51:06 2022] POST /identity/v3/projects => generated 381 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:51:07.016288 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c61cc9a-3cd7-4971-b39f-77c51323f10e admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:51:07.028477 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c61cc9a-3cd7-4971-b39f-77c51323f10e admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:51:07.102801 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bebdf7-3b4a-4714-b282-540a4e57389a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:51:07.103592 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bebdf7-3b4a-4714-b282-540a4e57389a admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:51:07.108270 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bebdf7-3b4a-4714-b282-540a4e57389a admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:51:07.108270 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bebdf7-3b4a-4714-b282-540a4e57389a admin admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:51:07.108270 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bebdf7-3b4a-4714-b282-540a4e57389a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:51:07.108270 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bebdf7-3b4a-4714-b282-540a4e57389a admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:51:07.250242 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1141/2292] 10.222.0.15 () {60 vars in 1143 bytes} [Tue May 31 14:51:07 2022] POST /identity/v3/users => generated 291 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 14:51:07.255040 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775c20f1-b95a-46a0-b6bc-c28a464b6c8f admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:51:07.266656 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775c20f1-b95a-46a0-b6bc-c28a464b6c8f admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:51:07.271859 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8186bd7-5545-4188-bbb4-72102e72d2e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:51:07.272541 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8186bd7-5545-4188-bbb4-72102e72d2e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:51:07.273769 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8186bd7-5545-4188-bbb4-72102e72d2e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:51:07.274077 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8186bd7-5545-4188-bbb4-72102e72d2e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:51:07.274837 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8186bd7-5545-4188-bbb4-72102e72d2e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:51:07.276497 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8186bd7-5545-4188-bbb4-72102e72d2e2 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:51:07.292940 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1152/2293] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:51:07 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:51:07.297453 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bebdf7-3b4a-4714-b282-540a4e57389a admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:51:07.310605 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bebdf7-3b4a-4714-b282-540a4e57389a admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:51:07.317128 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46083e57-6fa4-4cca-91b0-bfcd92c40d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:51:07.317845 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46083e57-6fa4-4cca-91b0-bfcd92c40d05 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:51:07.318137 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46083e57-6fa4-4cca-91b0-bfcd92c40d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:51:07.318537 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46083e57-6fa4-4cca-91b0-bfcd92c40d05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:51:07.319370 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46083e57-6fa4-4cca-91b0-bfcd92c40d05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:51:07.320979 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46083e57-6fa4-4cca-91b0-bfcd92c40d05 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:51:07.338594 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1142/2294] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:51:07 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:51:07.342346 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8186bd7-5545-4188-bbb4-72102e72d2e2 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:51:07.355803 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8186bd7-5545-4188-bbb4-72102e72d2e2 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:51:07.362329 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13f9524-b080-46d9-a998-d11689003ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:51:07.363371 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13f9524-b080-46d9-a998-d11689003ab9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:51:07.363541 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13f9524-b080-46d9-a998-d11689003ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:51:07.363811 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13f9524-b080-46d9-a998-d11689003ab9 admin admin] PATH_INFO: `/v3/projects/499bdab4da3a4305b8b9e35f07a99c60/users/6271a874398e4b0f87275d8c404d878b/roles/317f725e26bf43648d8235bb1f7c4cb3` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:51:07.393756 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:51:07.398240 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13f9524-b080-46d9-a998-d11689003ab9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=499bdab4da3a4305b8b9e35f07a99c60, user_id=6271a874398e4b0f87275d8c404d878b, role_id=317f725e26bf43648d8235bb1f7c4cb3)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:51:07.401098 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13f9524-b080-46d9-a998-d11689003ab9 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:51:07.496914 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1153/2295] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:51:07 2022] PUT /identity/v3/projects/499bdab4da3a4305b8b9e35f07a99c60/users/6271a874398e4b0f87275d8c404d878b/roles/317f725e26bf43648d8235bb1f7c4cb3 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:51:07.502427 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de86da5e-5435-423c-abf0-974a1a52b8f8 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:51:07.503181 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de86da5e-5435-423c-abf0-974a1a52b8f8 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:51:07.504045 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de86da5e-5435-423c-abf0-974a1a52b8f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:51:07.540019 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-de86da5e-5435-423c-abf0-974a1a52b8f8 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:51:07.541809 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-de86da5e-5435-423c-abf0-974a1a52b8f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:51:07.599832 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:51:07.612502 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1143/2296] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:51:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 14:51:07.623430 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13f9524-b080-46d9-a998-d11689003ab9 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:51:07.628199 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-f13f9524-b080-46d9-a998-d11689003ab9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:51:07.693522 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13f9524-b080-46d9-a998-d11689003ab9 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:51:07.697202 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946a9cd2-309e-433c-b345-dd83660102e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:51:07.697836 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a9cd2-309e-433c-b345-dd83660102e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:51:07.698119 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a9cd2-309e-433c-b345-dd83660102e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:51:07.698393 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a9cd2-309e-433c-b345-dd83660102e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:51:07.708408 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946a9cd2-309e-433c-b345-dd83660102e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:51:07.709873 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946a9cd2-309e-433c-b345-dd83660102e2 service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:51:07.719750 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1154/2297] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:51:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:51:07.965900 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c63293b-97bf-4a56-80ce-cfd3354f1356 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:51:07.965900 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c63293b-97bf-4a56-80ce-cfd3354f1356 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:51:07.965900 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c63293b-97bf-4a56-80ce-cfd3354f1356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:51:08.009437 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-2c63293b-97bf-4a56-80ce-cfd3354f1356 None None] MFA Rules not processed for user `7a2ecbb7bd2447858e2a99cd78bd9982`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:51:08.011364 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-2c63293b-97bf-4a56-80ce-cfd3354f1356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:51:08.117577 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1144/2298] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:51:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:51:08.132395 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946a9cd2-309e-433c-b345-dd83660102e2 service neutron] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:51:08.134576 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-946a9cd2-309e-433c-b345-dd83660102e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:51:08.219822 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946a9cd2-309e-433c-b345-dd83660102e2 service neutron] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:51:08.223478 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b23ba63-515e-44ff-8399-a4fda4ec5f66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afbf718dcd9b4741a926b0a2321bd53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:51:08.224125 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b23ba63-515e-44ff-8399-a4fda4ec5f66 service cinder] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:51:08.224408 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b23ba63-515e-44ff-8399-a4fda4ec5f66 service cinder] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:51:08.224685 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b23ba63-515e-44ff-8399-a4fda4ec5f66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:51:08.234520 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b23ba63-515e-44ff-8399-a4fda4ec5f66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:51:08.236964 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b23ba63-515e-44ff-8399-a4fda4ec5f66 service cinder] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:51:08.248512 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1155/2299] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:51:08 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:51:10.139905 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e033605-891e-4163-8484-ec708927584f None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:51:10.140408 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e033605-891e-4163-8484-ec708927584f None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:51:10.140408 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e033605-891e-4163-8484-ec708927584f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:51:10.173785 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-5e033605-891e-4163-8484-ec708927584f None None] MFA Rules not processed for user `7a2ecbb7bd2447858e2a99cd78bd9982`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:51:10.175339 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-5e033605-891e-4163-8484-ec708927584f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:51:10.185297 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1145/2300] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:51:10 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:51:11.271454 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b23ba63-515e-44ff-8399-a4fda4ec5f66 service cinder] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:51:11.272930 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-9b23ba63-515e-44ff-8399-a4fda4ec5f66 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:51:11.309757 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b23ba63-515e-44ff-8399-a4fda4ec5f66 service cinder] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:51:11.320541 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba5df42-c132-4299-9618-ab1073226a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:51:11.321441 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba5df42-c132-4299-9618-ab1073226a23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:51:11.321725 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba5df42-c132-4299-9618-ab1073226a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:51:11.322009 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba5df42-c132-4299-9618-ab1073226a23 admin admin] PATH_INFO: `/v3/users/eb54e5e20ad54a45abc4262df266a7d0` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:51:11.324354 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba5df42-c132-4299-9618-ab1073226a23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb54e5e20ad54a45abc4262df266a7d0)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:51:11.326349 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba5df42-c132-4299-9618-ab1073226a23 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:51:11.638789 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-4ba5df42-c132-4299-9618-ab1073226a23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb54e5e20ad54a45abc4262df266a7d0'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:51:11.729994 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-4ba5df42-c132-4299-9618-ab1073226a23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb54e5e20ad54a45abc4262df266a7d0'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:51:11.731274 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-4ba5df42-c132-4299-9618-ab1073226a23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb54e5e20ad54a45abc4262df266a7d0'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:51:11.755387 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-4ba5df42-c132-4299-9618-ab1073226a23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb54e5e20ad54a45abc4262df266a7d0'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:51:11.756161 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-4ba5df42-c132-4299-9618-ab1073226a23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb54e5e20ad54a45abc4262df266a7d0'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:51:11.803227 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1156/2301] 10.222.0.15 () {58 vars in 1223 bytes} [Tue May 31 14:51:11 2022] DELETE /identity/v3/users/eb54e5e20ad54a45abc4262df266a7d0 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:51:11.807473 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b110b6a8-5b02-4042-8783-27d314992990 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:51:11.808006 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b110b6a8-5b02-4042-8783-27d314992990 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:51:11.808239 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b110b6a8-5b02-4042-8783-27d314992990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:51:11.852567 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-b110b6a8-5b02-4042-8783-27d314992990 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:51:11.854143 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-b110b6a8-5b02-4042-8783-27d314992990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:51:11.973196 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1146/2302] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:51:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:51:12.023560 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba5df42-c132-4299-9618-ab1073226a23 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:51:12.026546 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-4ba5df42-c132-4299-9618-ab1073226a23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:51:12.045664 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:51:12.139986 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba5df42-c132-4299-9618-ab1073226a23 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:51:12.145650 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc5a8af-8386-483b-895f-fde6fa704224 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:51:12.146249 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc5a8af-8386-483b-895f-fde6fa704224 service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:51:12.146875 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc5a8af-8386-483b-895f-fde6fa704224 service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:51:12.148726 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc5a8af-8386-483b-895f-fde6fa704224 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:51:12.176025 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc5a8af-8386-483b-895f-fde6fa704224 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:51:12.177612 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc5a8af-8386-483b-895f-fde6fa704224 service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:51:12.189694 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1157/2303] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:51:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:51:12.910139 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b110b6a8-5b02-4042-8783-27d314992990 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:51:12.912058 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-b110b6a8-5b02-4042-8783-27d314992990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:51:12.937569 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b110b6a8-5b02-4042-8783-27d314992990 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:51:12.979508 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be5420e-65bf-44ff-8bed-267155eeb5fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:51:12.979508 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be5420e-65bf-44ff-8bed-267155eeb5fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:51:12.979508 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be5420e-65bf-44ff-8bed-267155eeb5fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:51:12.979508 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be5420e-65bf-44ff-8bed-267155eeb5fc admin admin] PATH_INFO: `/v3/projects/cb489d0d396a4bcf82ddbeabf87e7dd8` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:51:12.980153 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be5420e-65bf-44ff-8bed-267155eeb5fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb489d0d396a4bcf82ddbeabf87e7dd8)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:51:12.980153 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be5420e-65bf-44ff-8bed-267155eeb5fc admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:51:13.178353 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-9be5420e-65bf-44ff-8bed-267155eeb5fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb489d0d396a4bcf82ddbeabf87e7dd8', 'request_id': 'req-9be5420e-65bf-44ff-8bed-267155eeb5fc'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:51:13.200348 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-9be5420e-65bf-44ff-8bed-267155eeb5fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb489d0d396a4bcf82ddbeabf87e7dd8', 'request_id': 'req-9be5420e-65bf-44ff-8bed-267155eeb5fc'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:51:13.284346 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-9be5420e-65bf-44ff-8bed-267155eeb5fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb489d0d396a4bcf82ddbeabf87e7dd8', 'request_id': 'req-9be5420e-65bf-44ff-8bed-267155eeb5fc'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:51:13.302881 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:51:13.313625 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-9be5420e-65bf-44ff-8bed-267155eeb5fc admin admin] The token cache is being invalidate because project cb489d0d396a4bcf82ddbeabf87e7dd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 14:51:13.315310 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-9be5420e-65bf-44ff-8bed-267155eeb5fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:51:13.316306 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-9be5420e-65bf-44ff-8bed-267155eeb5fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:51:13.319441 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1147/2304] 10.222.0.15 () {58 vars in 1232 bytes} [Tue May 31 14:51:12 2022] DELETE /identity/v3/projects/cb489d0d396a4bcf82ddbeabf87e7dd8 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:51:13.323514 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc5a8af-8386-483b-895f-fde6fa704224 service neutron] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:51:13.339630 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc5a8af-8386-483b-895f-fde6fa704224 service neutron] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:51:13.423577 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c78266-c403-4d71-9319-fa83c069367d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:51:13.425208 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c78266-c403-4d71-9319-fa83c069367d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:51:13.425496 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c78266-c403-4d71-9319-fa83c069367d admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:51:13.425773 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c78266-c403-4d71-9319-fa83c069367d admin admin] PATH_INFO: `/v3/users/0d6735487c2a42d993054287a1e9dfe3` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:51:13.427391 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c78266-c403-4d71-9319-fa83c069367d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d6735487c2a42d993054287a1e9dfe3)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:51:13.429604 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c78266-c403-4d71-9319-fa83c069367d admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:51:13.693900 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-e9c78266-c403-4d71-9319-fa83c069367d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d6735487c2a42d993054287a1e9dfe3'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:51:13.804046 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-e9c78266-c403-4d71-9319-fa83c069367d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d6735487c2a42d993054287a1e9dfe3'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:51:13.804767 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-e9c78266-c403-4d71-9319-fa83c069367d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d6735487c2a42d993054287a1e9dfe3'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:51:13.814868 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-e9c78266-c403-4d71-9319-fa83c069367d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d6735487c2a42d993054287a1e9dfe3'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:51:13.816568 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-e9c78266-c403-4d71-9319-fa83c069367d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d6735487c2a42d993054287a1e9dfe3'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:51:13.851123 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1158/2305] 10.222.0.15 () {58 vars in 1223 bytes} [Tue May 31 14:51:13 2022] DELETE /identity/v3/users/0d6735487c2a42d993054287a1e9dfe3 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:51:14.424380 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be5420e-65bf-44ff-8bed-267155eeb5fc admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:51:14.426172 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-9be5420e-65bf-44ff-8bed-267155eeb5fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:51:14.442869 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be5420e-65bf-44ff-8bed-267155eeb5fc admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:51:14.539073 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e596017-9924-4a7c-979b-16a07e51925a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:51:14.539970 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e596017-9924-4a7c-979b-16a07e51925a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:51:14.540255 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e596017-9924-4a7c-979b-16a07e51925a admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:51:14.540533 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e596017-9924-4a7c-979b-16a07e51925a admin admin] PATH_INFO: `/v3/projects/f7b65a7eb17c4b798fd94cbbecd6b639` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:51:14.542752 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e596017-9924-4a7c-979b-16a07e51925a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7b65a7eb17c4b798fd94cbbecd6b639)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:51:14.546604 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e596017-9924-4a7c-979b-16a07e51925a admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:51:14.700080 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-4e596017-9924-4a7c-979b-16a07e51925a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7b65a7eb17c4b798fd94cbbecd6b639', 'request_id': 'req-4e596017-9924-4a7c-979b-16a07e51925a'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:51:14.710968 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-4e596017-9924-4a7c-979b-16a07e51925a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7b65a7eb17c4b798fd94cbbecd6b639', 'request_id': 'req-4e596017-9924-4a7c-979b-16a07e51925a'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:51:14.826480 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-4e596017-9924-4a7c-979b-16a07e51925a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7b65a7eb17c4b798fd94cbbecd6b639', 'request_id': 'req-4e596017-9924-4a7c-979b-16a07e51925a'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:51:14.840835 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-4e596017-9924-4a7c-979b-16a07e51925a admin admin] The token cache is being invalidate because project f7b65a7eb17c4b798fd94cbbecd6b639 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 14:51:14.841238 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-4e596017-9924-4a7c-979b-16a07e51925a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:51:14.841993 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-4e596017-9924-4a7c-979b-16a07e51925a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:51:14.844226 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1148/2306] 10.222.0.15 () {58 vars in 1232 bytes} [Tue May 31 14:51:14 2022] DELETE /identity/v3/projects/f7b65a7eb17c4b798fd94cbbecd6b639 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:51:14.851770 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b05b2-e8d7-4f4c-87ed-ee8c1b9ca767 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:51:14.852617 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b05b2-e8d7-4f4c-87ed-ee8c1b9ca767 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:51:14.852617 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b05b2-e8d7-4f4c-87ed-ee8c1b9ca767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:51:14.872736 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-a55b05b2-e8d7-4f4c-87ed-ee8c1b9ca767 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:51:14.874042 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-a55b05b2-e8d7-4f4c-87ed-ee8c1b9ca767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:51:14.906332 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:51:14.941354 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b4a3f5-5f84-4b20-841b-d0baba0d234a None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:51:14.941736 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b4a3f5-5f84-4b20-841b-d0baba0d234a None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:51:14.942134 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b4a3f5-5f84-4b20-841b-d0baba0d234a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:51:14.968415 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1159/2307] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:51:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:51:14.976665 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fc2ce0-8b4e-4ee2-b96a-4bd05238f101 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:51:14.977248 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fc2ce0-8b4e-4ee2-b96a-4bd05238f101 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:51:14.977730 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fc2ce0-8b4e-4ee2-b96a-4bd05238f101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:51:14.989089 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-99b4a3f5-5f84-4b20-841b-d0baba0d234a None None] MFA Rules not processed for user `6271a874398e4b0f87275d8c404d878b`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:51:14.990155 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-99b4a3f5-5f84-4b20-841b-d0baba0d234a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:51:15.006259 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-03fc2ce0-8b4e-4ee2-b96a-4bd05238f101 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:51:15.007639 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-03fc2ce0-8b4e-4ee2-b96a-4bd05238f101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:51:15.016824 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1160/2308] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:51:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:51:15.021579 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fc2ce0-8b4e-4ee2-b96a-4bd05238f101 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:51:15.031599 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fc2ce0-8b4e-4ee2-b96a-4bd05238f101 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:51:15.038922 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e213fad9-e28e-4043-ab08-9b388223eaaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:51:15.040725 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e213fad9-e28e-4043-ab08-9b388223eaaf admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:51:15.040725 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e213fad9-e28e-4043-ab08-9b388223eaaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:51:15.040725 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e213fad9-e28e-4043-ab08-9b388223eaaf admin admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:51:15.040941 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e213fad9-e28e-4043-ab08-9b388223eaaf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:51:15.041359 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e213fad9-e28e-4043-ab08-9b388223eaaf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:51:15.043050 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e213fad9-e28e-4043-ab08-9b388223eaaf admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:51:15.056001 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1161/2309] 10.222.0.15 () {58 vars in 1152 bytes} [Tue May 31 14:51:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 14:51:15.061686 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e213fad9-e28e-4043-ab08-9b388223eaaf admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:51:15.070085 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1149/2310] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:51:14 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:51:15.075249 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b4a3f5-5f84-4b20-841b-d0baba0d234a None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:51:15.075249 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-99b4a3f5-5f84-4b20-841b-d0baba0d234a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:51:15.076497 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e213fad9-e28e-4043-ab08-9b388223eaaf admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:51:15.082243 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feabd40b-0065-4580-a812-5f9e090d189c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:51:15.083275 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feabd40b-0065-4580-a812-5f9e090d189c admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:51:15.083631 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feabd40b-0065-4580-a812-5f9e090d189c admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:51:15.084097 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feabd40b-0065-4580-a812-5f9e090d189c admin admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:51:15.084907 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feabd40b-0065-4580-a812-5f9e090d189c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:51:15.087116 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feabd40b-0065-4580-a812-5f9e090d189c admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:51:15.089818 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b4a3f5-5f84-4b20-841b-d0baba0d234a None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:51:15.096456 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad275311-378f-44a3-bc94-e2e427d087cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:51:15.097522 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad275311-378f-44a3-bc94-e2e427d087cc admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:51:15.097522 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad275311-378f-44a3-bc94-e2e427d087cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:51:15.097860 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad275311-378f-44a3-bc94-e2e427d087cc admin admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:51:15.098660 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad275311-378f-44a3-bc94-e2e427d087cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:51:15.100667 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad275311-378f-44a3-bc94-e2e427d087cc admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:51:15.177475 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1162/2311] 10.222.0.15 () {60 vars in 1152 bytes} [Tue May 31 14:51:15 2022] POST /identity/v3/projects => generated 375 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:51:15.181285 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feabd40b-0065-4580-a812-5f9e090d189c admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:51:15.242496 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feabd40b-0065-4580-a812-5f9e090d189c admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:51:15.247125 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f084a43-1c13-43bf-9640-c7f90bab6f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:51:15.247876 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f084a43-1c13-43bf-9640-c7f90bab6f88 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:51:15.248137 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f084a43-1c13-43bf-9640-c7f90bab6f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:51:15.248410 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f084a43-1c13-43bf-9640-c7f90bab6f88 admin admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:51:15.249823 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f084a43-1c13-43bf-9640-c7f90bab6f88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:51:15.252113 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f084a43-1c13-43bf-9640-c7f90bab6f88 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:51:15.260374 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1150/2312] 10.222.0.15 () {60 vars in 1152 bytes} [Tue May 31 14:51:15 2022] POST /identity/v3/projects => generated 383 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:51:15.264091 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad275311-378f-44a3-bc94-e2e427d087cc admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:51:15.328330 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad275311-378f-44a3-bc94-e2e427d087cc admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:51:15.334883 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc07740b-cfad-4fe8-ad52-2e00c8eb053f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:51:15.335574 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc07740b-cfad-4fe8-ad52-2e00c8eb053f admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:51:15.335858 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc07740b-cfad-4fe8-ad52-2e00c8eb053f admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:51:15.336140 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc07740b-cfad-4fe8-ad52-2e00c8eb053f admin admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:51:15.339305 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1163/2313] 10.222.0.15 () {60 vars in 1143 bytes} [Tue May 31 14:51:15 2022] POST /identity/v3/users => generated 288 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:51:15.339456 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc07740b-cfad-4fe8-ad52-2e00c8eb053f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:51:15.339456 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc07740b-cfad-4fe8-ad52-2e00c8eb053f admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:51:15.341383 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f084a43-1c13-43bf-9640-c7f90bab6f88 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:51:15.348564 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:51:15.361372 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f084a43-1c13-43bf-9640-c7f90bab6f88 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:51:15.366220 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238168c4-9b60-4f6d-971c-1b7d4f6a3e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:51:15.366956 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238168c4-9b60-4f6d-971c-1b7d4f6a3e24 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:51:15.367272 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238168c4-9b60-4f6d-971c-1b7d4f6a3e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:51:15.367527 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238168c4-9b60-4f6d-971c-1b7d4f6a3e24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:51:15.368834 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238168c4-9b60-4f6d-971c-1b7d4f6a3e24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:51:15.369853 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238168c4-9b60-4f6d-971c-1b7d4f6a3e24 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:51:15.383740 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1164/2314] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:51:15 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 14:51:15.387093 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238168c4-9b60-4f6d-971c-1b7d4f6a3e24 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:51:15.407259 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238168c4-9b60-4f6d-971c-1b7d4f6a3e24 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:51:15.415867 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ed08cc-123e-4b0c-8289-6db399eeb05c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:51:15.417170 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ed08cc-123e-4b0c-8289-6db399eeb05c admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:51:15.417458 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ed08cc-123e-4b0c-8289-6db399eeb05c admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:51:15.417738 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ed08cc-123e-4b0c-8289-6db399eeb05c admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:51:15.418535 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ed08cc-123e-4b0c-8289-6db399eeb05c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:51:15.420451 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ed08cc-123e-4b0c-8289-6db399eeb05c admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:51:15.444685 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1165/2315] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:51:15 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:51:15.449433 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ed08cc-123e-4b0c-8289-6db399eeb05c admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:51:15.452586 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1151/2316] 10.222.0.15 () {60 vars in 1143 bytes} [Tue May 31 14:51:15 2022] POST /identity/v3/users => generated 298 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 14:51:15.459590 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc07740b-cfad-4fe8-ad52-2e00c8eb053f admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:51:15.461067 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ed08cc-123e-4b0c-8289-6db399eeb05c admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:51:15.465910 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c82ded8-340a-4df7-b880-968c6877c8be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:51:15.466837 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c82ded8-340a-4df7-b880-968c6877c8be admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:51:15.467117 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c82ded8-340a-4df7-b880-968c6877c8be admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:51:15.467394 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c82ded8-340a-4df7-b880-968c6877c8be admin admin] PATH_INFO: `/v3/projects/22ebc280c8a041138423d9fd27159123/users/06d79531e6bd4f6bb7eb6b14da186d01/roles/317f725e26bf43648d8235bb1f7c4cb3` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:51:15.476814 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc07740b-cfad-4fe8-ad52-2e00c8eb053f admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:51:15.482428 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf39be06-ee5f-41fe-ab99-112369c57f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:51:15.483135 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf39be06-ee5f-41fe-ab99-112369c57f9e admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:51:15.483473 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf39be06-ee5f-41fe-ab99-112369c57f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:51:15.483721 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf39be06-ee5f-41fe-ab99-112369c57f9e admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:51:15.484643 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf39be06-ee5f-41fe-ab99-112369c57f9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:51:15.485201 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c82ded8-340a-4df7-b880-968c6877c8be admin admin] RBAC: Authorizing `identity:create_grant(project_id=22ebc280c8a041138423d9fd27159123, user_id=06d79531e6bd4f6bb7eb6b14da186d01, role_id=317f725e26bf43648d8235bb1f7c4cb3)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:51:15.486623 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf39be06-ee5f-41fe-ab99-112369c57f9e admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:51:15.488124 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c82ded8-340a-4df7-b880-968c6877c8be admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:51:15.510423 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1152/2317] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:51:15 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:51:15.518941 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf39be06-ee5f-41fe-ab99-112369c57f9e admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:51:15.531929 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf39be06-ee5f-41fe-ab99-112369c57f9e admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:51:15.537198 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6933479c-b199-4204-93b4-17fbf380ed76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:51:15.538441 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6933479c-b199-4204-93b4-17fbf380ed76 admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:51:15.538934 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6933479c-b199-4204-93b4-17fbf380ed76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:51:15.539215 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6933479c-b199-4204-93b4-17fbf380ed76 admin admin] PATH_INFO: `/v3/projects/4829c3389a1c4fe98ad1e18318f623d0/users/0dbb4dbccbb144bfa7edb4b53d46679d/roles/76c53e2c353644f885028a0226c06146` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:51:15.555331 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6933479c-b199-4204-93b4-17fbf380ed76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4829c3389a1c4fe98ad1e18318f623d0, user_id=0dbb4dbccbb144bfa7edb4b53d46679d, role_id=76c53e2c353644f885028a0226c06146)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:51:15.558138 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6933479c-b199-4204-93b4-17fbf380ed76 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:51:15.570090 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1166/2318] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:51:15 2022] PUT /identity/v3/projects/22ebc280c8a041138423d9fd27159123/users/06d79531e6bd4f6bb7eb6b14da186d01/roles/317f725e26bf43648d8235bb1f7c4cb3 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:51:15.581871 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2673ba7b-75ea-453f-ae27-2e5129ef915d None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:51:15.582172 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2673ba7b-75ea-453f-ae27-2e5129ef915d None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:51:15.582458 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2673ba7b-75ea-453f-ae27-2e5129ef915d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:51:15.610857 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-2673ba7b-75ea-453f-ae27-2e5129ef915d None None] MFA Rules not processed for user `06d79531e6bd4f6bb7eb6b14da186d01`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:51:15.612393 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-2673ba7b-75ea-453f-ae27-2e5129ef915d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:51:15.685886 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1153/2319] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:51:15 2022] PUT /identity/v3/projects/4829c3389a1c4fe98ad1e18318f623d0/users/0dbb4dbccbb144bfa7edb4b53d46679d/roles/76c53e2c353644f885028a0226c06146 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:51:15.689992 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6933479c-b199-4204-93b4-17fbf380ed76 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:51:15.695557 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1167/2320] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:51:15 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:51:15.711447 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2673ba7b-75ea-453f-ae27-2e5129ef915d None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:51:15.712973 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-2673ba7b-75ea-453f-ae27-2e5129ef915d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:51:15.792184 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2673ba7b-75ea-453f-ae27-2e5129ef915d None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:51:15.809544 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6933479c-b199-4204-93b4-17fbf380ed76 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:51:15.818588 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31171899-54c1-456f-b4e8-1872e76398ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:51:15.826688 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31171899-54c1-456f-b4e8-1872e76398ea admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:51:15.830798 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31171899-54c1-456f-b4e8-1872e76398ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:51:15.833198 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31171899-54c1-456f-b4e8-1872e76398ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:51:15.835401 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31171899-54c1-456f-b4e8-1872e76398ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:51:15.838600 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31171899-54c1-456f-b4e8-1872e76398ea admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:51:15.857442 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86797c7-e297-4571-8640-3727d39b4a7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afbf718dcd9b4741a926b0a2321bd53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:51:15.858132 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86797c7-e297-4571-8640-3727d39b4a7c service cinder] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:51:15.858421 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86797c7-e297-4571-8640-3727d39b4a7c service cinder] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:51:15.858738 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86797c7-e297-4571-8640-3727d39b4a7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:51:15.867906 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1154/2321] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:51:15 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:51:15.871260 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31171899-54c1-456f-b4e8-1872e76398ea admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:51:15.890505 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31171899-54c1-456f-b4e8-1872e76398ea admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:51:15.898270 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9a30ff-bcc1-4ab8-84f6-8e894c436431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:51:15.899239 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9a30ff-bcc1-4ab8-84f6-8e894c436431 admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:51:15.899520 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9a30ff-bcc1-4ab8-84f6-8e894c436431 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:51:15.899843 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9a30ff-bcc1-4ab8-84f6-8e894c436431 admin admin] PATH_INFO: `/v3/projects/4829c3389a1c4fe98ad1e18318f623d0/users/0dbb4dbccbb144bfa7edb4b53d46679d/roles/76c53e2c353644f885028a0226c06146` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:51:15.902049 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9a30ff-bcc1-4ab8-84f6-8e894c436431 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4829c3389a1c4fe98ad1e18318f623d0, user_id=0dbb4dbccbb144bfa7edb4b53d46679d, role_id=76c53e2c353644f885028a0226c06146)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:51:15.905595 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9a30ff-bcc1-4ab8-84f6-8e894c436431 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:51:15.918610 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1155/2322] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:51:15 2022] PUT /identity/v3/projects/4829c3389a1c4fe98ad1e18318f623d0/users/0dbb4dbccbb144bfa7edb4b53d46679d/roles/76c53e2c353644f885028a0226c06146 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 14:51:15.994886 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86797c7-e297-4571-8640-3727d39b4a7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:51:15.996948 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86797c7-e297-4571-8640-3727d39b4a7c service cinder] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:51:16.012596 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1168/2323] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:51:15 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:51:16.381072 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:51:21.609328 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9a30ff-bcc1-4ab8-84f6-8e894c436431 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:51:21.692607 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:51:21.751380 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9a30ff-bcc1-4ab8-84f6-8e894c436431 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:51:21.758610 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71de5e4-3b1a-455e-8385-24dde4efdb10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:51:21.760125 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71de5e4-3b1a-455e-8385-24dde4efdb10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:51:21.760625 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71de5e4-3b1a-455e-8385-24dde4efdb10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:51:21.761075 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71de5e4-3b1a-455e-8385-24dde4efdb10 admin admin] PATH_INFO: `/v3/users/06d79531e6bd4f6bb7eb6b14da186d01` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:51:21.762593 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71de5e4-3b1a-455e-8385-24dde4efdb10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06d79531e6bd4f6bb7eb6b14da186d01)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:51:21.765492 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71de5e4-3b1a-455e-8385-24dde4efdb10 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:51:21.976434 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-b71de5e4-3b1a-455e-8385-24dde4efdb10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06d79531e6bd4f6bb7eb6b14da186d01'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:51:21.987231 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-b71de5e4-3b1a-455e-8385-24dde4efdb10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06d79531e6bd4f6bb7eb6b14da186d01'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:51:21.988603 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-b71de5e4-3b1a-455e-8385-24dde4efdb10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06d79531e6bd4f6bb7eb6b14da186d01'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:51:21.989668 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-b71de5e4-3b1a-455e-8385-24dde4efdb10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06d79531e6bd4f6bb7eb6b14da186d01'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:51:22.006610 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-b71de5e4-3b1a-455e-8385-24dde4efdb10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06d79531e6bd4f6bb7eb6b14da186d01'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:51:22.116227 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1156/2324] 10.222.0.15 () {58 vars in 1223 bytes} [Tue May 31 14:51:21 2022] DELETE /identity/v3/users/06d79531e6bd4f6bb7eb6b14da186d01 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:51:22.120493 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23709a73-f540-4f0d-a959-5f792d6a3b0b None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:51:22.121004 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23709a73-f540-4f0d-a959-5f792d6a3b0b None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:51:22.121086 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23709a73-f540-4f0d-a959-5f792d6a3b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:51:22.141809 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-23709a73-f540-4f0d-a959-5f792d6a3b0b None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:51:22.143361 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-23709a73-f540-4f0d-a959-5f792d6a3b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:51:22.186432 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:51:22.261984 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1169/2325] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:51:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:51:22.275136 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71de5e4-3b1a-455e-8385-24dde4efdb10 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:51:22.276858 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-b71de5e4-3b1a-455e-8385-24dde4efdb10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:51:22.426379 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71de5e4-3b1a-455e-8385-24dde4efdb10 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:51:22.432527 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26f2dd3-3713-4cff-af53-98f2a11358cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:51:22.433204 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26f2dd3-3713-4cff-af53-98f2a11358cd service neutron] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:51:22.433665 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26f2dd3-3713-4cff-af53-98f2a11358cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:51:22.434322 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26f2dd3-3713-4cff-af53-98f2a11358cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:51:22.461328 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26f2dd3-3713-4cff-af53-98f2a11358cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:51:22.462862 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26f2dd3-3713-4cff-af53-98f2a11358cd service neutron] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:51:22.488080 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1157/2326] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:51:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:51:23.404339 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23709a73-f540-4f0d-a959-5f792d6a3b0b None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:51:23.407643 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-23709a73-f540-4f0d-a959-5f792d6a3b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:51:23.429442 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23709a73-f540-4f0d-a959-5f792d6a3b0b None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:51:23.435862 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d8d131-f592-46e4-b448-9884ea5e2b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:51:23.437590 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d8d131-f592-46e4-b448-9884ea5e2b8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:51:23.438698 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d8d131-f592-46e4-b448-9884ea5e2b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:51:23.439129 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d8d131-f592-46e4-b448-9884ea5e2b8f admin admin] PATH_INFO: `/v3/projects/22ebc280c8a041138423d9fd27159123` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:51:23.440559 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d8d131-f592-46e4-b448-9884ea5e2b8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=22ebc280c8a041138423d9fd27159123)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:51:23.442691 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d8d131-f592-46e4-b448-9884ea5e2b8f admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:51:23.578532 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-a3d8d131-f592-46e4-b448-9884ea5e2b8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22ebc280c8a041138423d9fd27159123', 'request_id': 'req-a3d8d131-f592-46e4-b448-9884ea5e2b8f'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:51:23.672772 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-a3d8d131-f592-46e4-b448-9884ea5e2b8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22ebc280c8a041138423d9fd27159123', 'request_id': 'req-a3d8d131-f592-46e4-b448-9884ea5e2b8f'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:51:23.680250 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-a3d8d131-f592-46e4-b448-9884ea5e2b8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22ebc280c8a041138423d9fd27159123', 'request_id': 'req-a3d8d131-f592-46e4-b448-9884ea5e2b8f'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:51:23.704785 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-a3d8d131-f592-46e4-b448-9884ea5e2b8f admin admin] The token cache is being invalidate because project 22ebc280c8a041138423d9fd27159123 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80503) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 14:51:23.705171 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-a3d8d131-f592-46e4-b448-9884ea5e2b8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:51:23.708165 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-a3d8d131-f592-46e4-b448-9884ea5e2b8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:51:23.709843 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1170/2327] 10.222.0.15 () {58 vars in 1232 bytes} [Tue May 31 14:51:23 2022] DELETE /identity/v3/projects/22ebc280c8a041138423d9fd27159123 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:51:23.714952 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dc1d6f-b2f7-4185-ad7c-71f49afb6dfc None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:51:23.715433 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dc1d6f-b2f7-4185-ad7c-71f49afb6dfc None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:51:23.715573 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dc1d6f-b2f7-4185-ad7c-71f49afb6dfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:51:23.730408 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c63b33-e610-4fef-b6e7-0b53c9b8c50d None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:51:23.731101 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c63b33-e610-4fef-b6e7-0b53c9b8c50d None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:51:23.731576 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c63b33-e610-4fef-b6e7-0b53c9b8c50d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:51:23.761485 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-98c63b33-e610-4fef-b6e7-0b53c9b8c50d None None] MFA Rules not processed for user `001117ac48b544f1adbc64f0acb988f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:51:23.762750 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-98c63b33-e610-4fef-b6e7-0b53c9b8c50d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:51:23.763537 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-99dc1d6f-b2f7-4185-ad7c-71f49afb6dfc None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:51:23.765444 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-99dc1d6f-b2f7-4185-ad7c-71f49afb6dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:51:23.890066 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:51:23.929130 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1171/2328] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:51:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:51:23.953765 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1158/2329] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:51:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:51:23.964379 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351f6cf9-e4b9-4f66-97ea-7a8e9466378d None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:51:23.965059 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351f6cf9-e4b9-4f66-97ea-7a8e9466378d None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:51:23.965059 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351f6cf9-e4b9-4f66-97ea-7a8e9466378d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:51:23.998464 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-351f6cf9-e4b9-4f66-97ea-7a8e9466378d None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:51:23.999869 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-351f6cf9-e4b9-4f66-97ea-7a8e9466378d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:51:24.022709 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1172/2330] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:51:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:51:24.023891 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dc1d6f-b2f7-4185-ad7c-71f49afb6dfc None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:51:24.038238 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dc1d6f-b2f7-4185-ad7c-71f49afb6dfc None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:51:24.066947 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b3aa10-f00d-4c44-b990-083cd0568ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:51:24.067838 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b3aa10-f00d-4c44-b990-083cd0568ac6 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:51:24.068136 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b3aa10-f00d-4c44-b990-083cd0568ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:51:24.068418 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b3aa10-f00d-4c44-b990-083cd0568ac6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:51:24.070814 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b3aa10-f00d-4c44-b990-083cd0568ac6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:51:24.071135 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b3aa10-f00d-4c44-b990-083cd0568ac6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:51:24.072784 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b3aa10-f00d-4c44-b990-083cd0568ac6 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:51:24.122788 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1159/2331] 10.222.0.15 () {58 vars in 1152 bytes} [Tue May 31 14:51:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:51:24.124296 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351f6cf9-e4b9-4f66-97ea-7a8e9466378d None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:51:24.136782 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351f6cf9-e4b9-4f66-97ea-7a8e9466378d None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:51:24.152190 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c8dfc4-8517-4748-aaeb-8f7c1a777843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:51:24.156000 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c8dfc4-8517-4748-aaeb-8f7c1a777843 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:51:24.156000 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c8dfc4-8517-4748-aaeb-8f7c1a777843 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:51:24.156000 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c8dfc4-8517-4748-aaeb-8f7c1a777843 admin admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:51:24.156000 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c8dfc4-8517-4748-aaeb-8f7c1a777843 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:51:24.157770 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c8dfc4-8517-4748-aaeb-8f7c1a777843 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:51:24.310519 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1173/2332] 10.222.0.15 () {60 vars in 1152 bytes} [Tue May 31 14:51:24 2022] POST /identity/v3/projects => generated 373 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 14:51:24.313065 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b3aa10-f00d-4c44-b990-083cd0568ac6 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:51:24.327001 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b3aa10-f00d-4c44-b990-083cd0568ac6 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:51:24.470259 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487a1f0f-d9e5-4e6b-8216-d8bdc7dec6c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:51:24.471401 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a1f0f-d9e5-4e6b-8216-d8bdc7dec6c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:51:24.474679 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a1f0f-d9e5-4e6b-8216-d8bdc7dec6c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:51:24.474679 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a1f0f-d9e5-4e6b-8216-d8bdc7dec6c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:51:24.474679 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487a1f0f-d9e5-4e6b-8216-d8bdc7dec6c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:51:24.478612 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487a1f0f-d9e5-4e6b-8216-d8bdc7dec6c8 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:51:24.639951 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1160/2333] 10.222.0.15 () {60 vars in 1143 bytes} [Tue May 31 14:51:24 2022] POST /identity/v3/users => generated 287 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:51:24.640066 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c8dfc4-8517-4748-aaeb-8f7c1a777843 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:51:24.665509 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c8dfc4-8517-4748-aaeb-8f7c1a777843 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:51:24.704702 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d636ffe-dc7f-4622-ac1f-c884b5402007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:51:24.709631 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d636ffe-dc7f-4622-ac1f-c884b5402007 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:51:24.710113 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d636ffe-dc7f-4622-ac1f-c884b5402007 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:51:24.711886 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d636ffe-dc7f-4622-ac1f-c884b5402007 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:51:24.720409 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d636ffe-dc7f-4622-ac1f-c884b5402007 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:51:24.725176 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d636ffe-dc7f-4622-ac1f-c884b5402007 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:51:24.788122 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1174/2334] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:51:24 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 14:51:24.792183 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487a1f0f-d9e5-4e6b-8216-d8bdc7dec6c8 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:51:24.804726 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487a1f0f-d9e5-4e6b-8216-d8bdc7dec6c8 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:51:24.820494 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e008fbd3-8285-46e9-a7b7-48523855f31f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:51:24.821416 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e008fbd3-8285-46e9-a7b7-48523855f31f admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:51:24.821707 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e008fbd3-8285-46e9-a7b7-48523855f31f admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:51:24.821992 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e008fbd3-8285-46e9-a7b7-48523855f31f admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:51:24.823053 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e008fbd3-8285-46e9-a7b7-48523855f31f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:51:24.835496 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac58c3-d0a8-4d01-a9b3-8a9aa80565df None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:51:24.835953 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e008fbd3-8285-46e9-a7b7-48523855f31f admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:51:24.837025 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac58c3-d0a8-4d01-a9b3-8a9aa80565df None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:51:24.837319 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac58c3-d0a8-4d01-a9b3-8a9aa80565df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:51:24.849154 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1161/2335] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:51:24 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:51:24.852895 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e008fbd3-8285-46e9-a7b7-48523855f31f admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:51:24.865091 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e008fbd3-8285-46e9-a7b7-48523855f31f admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:51:24.872416 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2250446c-f55c-4a1c-9ce0-407b4038d6f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:51:24.874797 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2250446c-f55c-4a1c-9ce0-407b4038d6f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:51:24.875294 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2250446c-f55c-4a1c-9ce0-407b4038d6f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:51:24.875995 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2250446c-f55c-4a1c-9ce0-407b4038d6f1 admin admin] PATH_INFO: `/v3/projects/9ac463b37e604cc888c87bf93c46a791/users/b24a7de30b9a4258a41161b2ff7080b6/roles/317f725e26bf43648d8235bb1f7c4cb3` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:51:24.896532 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-e8ac58c3-d0a8-4d01-a9b3-8a9aa80565df None None] MFA Rules not processed for user `0dbb4dbccbb144bfa7edb4b53d46679d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:51:24.897785 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-e8ac58c3-d0a8-4d01-a9b3-8a9aa80565df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:51:24.919826 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:51:24.926933 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2250446c-f55c-4a1c-9ce0-407b4038d6f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ac463b37e604cc888c87bf93c46a791, user_id=b24a7de30b9a4258a41161b2ff7080b6, role_id=317f725e26bf43648d8235bb1f7c4cb3)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:51:24.929906 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2250446c-f55c-4a1c-9ce0-407b4038d6f1 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:51:25.034757 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1175/2336] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:51:24 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:51:25.055940 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1162/2337] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:51:24 2022] PUT /identity/v3/projects/9ac463b37e604cc888c87bf93c46a791/users/b24a7de30b9a4258a41161b2ff7080b6/roles/317f725e26bf43648d8235bb1f7c4cb3 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 14:51:25.056237 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ac58c3-d0a8-4d01-a9b3-8a9aa80565df None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:51:25.056237 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-e8ac58c3-d0a8-4d01-a9b3-8a9aa80565df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:51:25.058386 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a523aa-4cd4-4b2c-824c-ab1fdd628766 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:51:25.058873 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a523aa-4cd4-4b2c-824c-ab1fdd628766 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:51:25.059291 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a523aa-4cd4-4b2c-824c-ab1fdd628766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:51:25.085765 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-47a523aa-4cd4-4b2c-824c-ab1fdd628766 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:51:25.087270 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-47a523aa-4cd4-4b2c-824c-ab1fdd628766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:51:25.210956 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1163/2338] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:51:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 14:51:25.216994 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a523aa-4cd4-4b2c-824c-ab1fdd628766 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:51:25.223077 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-47a523aa-4cd4-4b2c-824c-ab1fdd628766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:51:25.293901 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a523aa-4cd4-4b2c-824c-ab1fdd628766 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:51:25.298542 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ac58c3-d0a8-4d01-a9b3-8a9aa80565df None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:51:25.299682 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102e8e71-36c7-4c66-87cf-d8ebce7b829d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:51:25.301284 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102e8e71-36c7-4c66-87cf-d8ebce7b829d service neutron] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:51:25.301284 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102e8e71-36c7-4c66-87cf-d8ebce7b829d service neutron] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:51:25.301605 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102e8e71-36c7-4c66-87cf-d8ebce7b829d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:51:25.322275 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102e8e71-36c7-4c66-87cf-d8ebce7b829d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:51:25.324607 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102e8e71-36c7-4c66-87cf-d8ebce7b829d service neutron] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:51:25.345125 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1164/2339] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:51:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 14:51:25.393740 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2719005c-abe0-412a-beab-1ed027dd4f06 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ba98b007cc4ae1b20e7f261824b77c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:51:25.394470 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719005c-abe0-412a-beab-1ed027dd4f06 service glance] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:51:25.394754 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719005c-abe0-412a-beab-1ed027dd4f06 service glance] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:51:25.395031 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719005c-abe0-412a-beab-1ed027dd4f06 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:51:25.400499 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-2719005c-abe0-412a-beab-1ed027dd4f06 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:51:25.543093 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2719005c-abe0-412a-beab-1ed027dd4f06 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:51:25.544559 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2719005c-abe0-412a-beab-1ed027dd4f06 service glance] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:51:25.561532 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1176/2340] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:51:25 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:51:25.924220 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b811c3b-d5b2-449b-a274-d425309ebcfe None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:51:25.925688 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b811c3b-d5b2-449b-a274-d425309ebcfe None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:51:25.926853 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b811c3b-d5b2-449b-a274-d425309ebcfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:51:25.971050 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-4b811c3b-d5b2-449b-a274-d425309ebcfe None None] MFA Rules not processed for user `735d2518c8404bd991acee533b314039`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:51:25.972297 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-4b811c3b-d5b2-449b-a274-d425309ebcfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:51:26.047741 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1165/2341] 10.222.0.15 () {58 vars in 1009 bytes} [Tue May 31 14:51:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 14:51:26.119802 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2719005c-abe0-412a-beab-1ed027dd4f06 service glance] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:51:26.121431 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-2719005c-abe0-412a-beab-1ed027dd4f06 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:51:26.242785 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2719005c-abe0-412a-beab-1ed027dd4f06 service glance] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:51:26.248661 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afa6005-8cbf-4c64-8c93-4826d79756ba service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e158f461c66e4d779f23fb7760672897', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:51:26.249608 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afa6005-8cbf-4c64-8c93-4826d79756ba service swift] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:51:26.249919 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afa6005-8cbf-4c64-8c93-4826d79756ba service swift] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:51:26.250243 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afa6005-8cbf-4c64-8c93-4826d79756ba service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:51:26.260614 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afa6005-8cbf-4c64-8c93-4826d79756ba service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:51:26.262797 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afa6005-8cbf-4c64-8c93-4826d79756ba service swift] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:51:26.301172 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1177/2342] 10.222.0.15 () {60 vars in 1384 bytes} [Tue May 31 14:51:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 31 14:51:26.868562 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:51:27.570804 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d421e50f-849c-459f-a309-160a1f4d0df7 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:51:27.571499 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d421e50f-849c-459f-a309-160a1f4d0df7 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:51:27.573480 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d421e50f-849c-459f-a309-160a1f4d0df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:51:27.634862 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-d421e50f-849c-459f-a309-160a1f4d0df7 None None] MFA Rules not processed for user `b24a7de30b9a4258a41161b2ff7080b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:51:27.636106 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-d421e50f-849c-459f-a309-160a1f4d0df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:51:27.749787 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1166/2343] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:51:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:51:27.760484 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afa6005-8cbf-4c64-8c93-4826d79756ba service swift] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:51:27.768177 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-2afa6005-8cbf-4c64-8c93-4826d79756ba service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:51:27.856419 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afa6005-8cbf-4c64-8c93-4826d79756ba service swift] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:51:27.861372 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86735c89-41e3-4b71-9fe5-7b21a9c097c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afbf718dcd9b4741a926b0a2321bd53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:51:27.872100 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86735c89-41e3-4b71-9fe5-7b21a9c097c5 service cinder] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:51:27.872100 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86735c89-41e3-4b71-9fe5-7b21a9c097c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:51:27.872100 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86735c89-41e3-4b71-9fe5-7b21a9c097c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:51:27.874365 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86735c89-41e3-4b71-9fe5-7b21a9c097c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:51:27.876420 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86735c89-41e3-4b71-9fe5-7b21a9c097c5 service cinder] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:51:27.890775 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1178/2344] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:51:27 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:51:27.933661 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d421e50f-849c-459f-a309-160a1f4d0df7 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:51:27.933661 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-d421e50f-849c-459f-a309-160a1f4d0df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:51:27.964904 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d421e50f-849c-459f-a309-160a1f4d0df7 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:51:27.976342 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7510dc-fb42-4187-977a-a37895db9752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:51:27.977522 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7510dc-fb42-4187-977a-a37895db9752 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:51:27.978055 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7510dc-fb42-4187-977a-a37895db9752 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:51:27.978710 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7510dc-fb42-4187-977a-a37895db9752 admin admin] PATH_INFO: `/v3/users/8a5357b6da484c63a0c2787ebe5efdce` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:51:27.980251 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7510dc-fb42-4187-977a-a37895db9752 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a5357b6da484c63a0c2787ebe5efdce)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:51:27.982383 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7510dc-fb42-4187-977a-a37895db9752 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:51:28.036291 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:51:28.267067 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-0e7510dc-fb42-4187-977a-a37895db9752 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a5357b6da484c63a0c2787ebe5efdce'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:51:28.277849 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-0e7510dc-fb42-4187-977a-a37895db9752 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a5357b6da484c63a0c2787ebe5efdce'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:51:28.279037 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-0e7510dc-fb42-4187-977a-a37895db9752 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a5357b6da484c63a0c2787ebe5efdce'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:51:28.279695 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-0e7510dc-fb42-4187-977a-a37895db9752 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a5357b6da484c63a0c2787ebe5efdce'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:51:28.294097 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-0e7510dc-fb42-4187-977a-a37895db9752 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a5357b6da484c63a0c2787ebe5efdce'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:51:28.415290 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1167/2345] 10.222.0.15 () {58 vars in 1223 bytes} [Tue May 31 14:51:27 2022] DELETE /identity/v3/users/8a5357b6da484c63a0c2787ebe5efdce => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:51:28.415431 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21fcf19-d957-4a26-ad33-34f134ad7dd1 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:51:28.415431 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21fcf19-d957-4a26-ad33-34f134ad7dd1 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:51:28.415431 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21fcf19-d957-4a26-ad33-34f134ad7dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:51:28.433504 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-d21fcf19-d957-4a26-ad33-34f134ad7dd1 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:51:28.434801 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-d21fcf19-d957-4a26-ad33-34f134ad7dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:51:28.531140 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1179/2346] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:51:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:51:28.540419 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7510dc-fb42-4187-977a-a37895db9752 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:51:28.541942 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-0e7510dc-fb42-4187-977a-a37895db9752 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:51:28.621425 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7510dc-fb42-4187-977a-a37895db9752 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:51:28.626302 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:51:28.631449 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b224b9-ef2b-4c51-b782-8505e97c7141 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:51:28.632647 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b224b9-ef2b-4c51-b782-8505e97c7141 service neutron] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:51:28.633152 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b224b9-ef2b-4c51-b782-8505e97c7141 service neutron] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:51:28.633642 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b224b9-ef2b-4c51-b782-8505e97c7141 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:51:28.651577 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b224b9-ef2b-4c51-b782-8505e97c7141 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:51:28.652965 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b224b9-ef2b-4c51-b782-8505e97c7141 service neutron] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:51:28.691133 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1168/2347] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:51:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:51:29.640504 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21fcf19-d957-4a26-ad33-34f134ad7dd1 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:51:29.640504 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-d21fcf19-d957-4a26-ad33-34f134ad7dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:51:29.658377 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21fcf19-d957-4a26-ad33-34f134ad7dd1 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:51:29.677780 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d73e273-9576-48c7-873a-abce7d927f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:51:29.681068 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d73e273-9576-48c7-873a-abce7d927f03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:51:29.681517 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d73e273-9576-48c7-873a-abce7d927f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:51:29.682710 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d73e273-9576-48c7-873a-abce7d927f03 admin admin] PATH_INFO: `/v3/projects/49d3e3e8a28c4a178149907900a967dc` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:51:29.685937 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d73e273-9576-48c7-873a-abce7d927f03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49d3e3e8a28c4a178149907900a967dc)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:51:29.689734 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d73e273-9576-48c7-873a-abce7d927f03 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:51:29.871131 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:51:29.881044 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-0d73e273-9576-48c7-873a-abce7d927f03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49d3e3e8a28c4a178149907900a967dc', 'request_id': 'req-0d73e273-9576-48c7-873a-abce7d927f03'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:51:29.965108 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e586c15-e98e-4a84-924e-8343f1760e4e None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:51:29.967020 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e586c15-e98e-4a84-924e-8343f1760e4e None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:51:29.967020 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e586c15-e98e-4a84-924e-8343f1760e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:51:29.996978 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-4e586c15-e98e-4a84-924e-8343f1760e4e None None] MFA Rules not processed for user `b24a7de30b9a4258a41161b2ff7080b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:51:29.998571 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-4e586c15-e98e-4a84-924e-8343f1760e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:51:30.025388 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-0d73e273-9576-48c7-873a-abce7d927f03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49d3e3e8a28c4a178149907900a967dc', 'request_id': 'req-0d73e273-9576-48c7-873a-abce7d927f03'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:51:30.045408 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-0d73e273-9576-48c7-873a-abce7d927f03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49d3e3e8a28c4a178149907900a967dc', 'request_id': 'req-0d73e273-9576-48c7-873a-abce7d927f03'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:51:30.070312 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-0d73e273-9576-48c7-873a-abce7d927f03 admin admin] The token cache is being invalidate because project 49d3e3e8a28c4a178149907900a967dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80503) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 14:51:30.070626 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-0d73e273-9576-48c7-873a-abce7d927f03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:51:30.075420 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-0d73e273-9576-48c7-873a-abce7d927f03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:51:30.079817 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1180/2348] 10.222.0.15 () {58 vars in 1232 bytes} [Tue May 31 14:51:29 2022] DELETE /identity/v3/projects/49d3e3e8a28c4a178149907900a967dc => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:51:30.189670 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1169/2349] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:51:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:51:40.530028 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=60,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:51:41.002613 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f23e19-08fe-44cb-aaf0-d6e955fb14dc None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:51:41.003111 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f23e19-08fe-44cb-aaf0-d6e955fb14dc None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:51:41.003203 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f23e19-08fe-44cb-aaf0-d6e955fb14dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:51:41.021943 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-75f23e19-08fe-44cb-aaf0-d6e955fb14dc None None] MFA Rules not processed for user `6271a874398e4b0f87275d8c404d878b`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:51:41.022711 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-75f23e19-08fe-44cb-aaf0-d6e955fb14dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:51:41.085370 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1181/2350] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:51:41 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:51:43.137623 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7358214e-fb22-406a-afee-80ac046c142c None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:51:43.138112 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7358214e-fb22-406a-afee-80ac046c142c None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:51:43.138199 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7358214e-fb22-406a-afee-80ac046c142c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:51:43.157125 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-7358214e-fb22-406a-afee-80ac046c142c None None] MFA Rules not processed for user `735d2518c8404bd991acee533b314039`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:51:43.158327 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-7358214e-fb22-406a-afee-80ac046c142c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:51:43.221116 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1170/2351] 10.222.0.15 () {58 vars in 1009 bytes} [Tue May 31 14:51:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:51:43.234149 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f23e19-08fe-44cb-aaf0-d6e955fb14dc None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:51:43.235570 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-75f23e19-08fe-44cb-aaf0-d6e955fb14dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:51:43.307925 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f23e19-08fe-44cb-aaf0-d6e955fb14dc None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:51:43.312795 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cf3f9b-c9db-4d6c-a60f-675b009b6cbd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e158f461c66e4d779f23fb7760672897', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:51:43.319571 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cf3f9b-c9db-4d6c-a60f-675b009b6cbd service swift] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:51:43.319571 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cf3f9b-c9db-4d6c-a60f-675b009b6cbd service swift] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:51:43.319571 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cf3f9b-c9db-4d6c-a60f-675b009b6cbd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:51:43.322016 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cf3f9b-c9db-4d6c-a60f-675b009b6cbd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:51:43.323622 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cf3f9b-c9db-4d6c-a60f-675b009b6cbd service swift] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:51:43.331929 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1182/2352] 10.222.0.15 () {60 vars in 1384 bytes} [Tue May 31 14:51:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 31 14:51:45.531660 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5586b1d7-8755-4587-9eaa-d49d0f0021c9 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:51:45.532558 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5586b1d7-8755-4587-9eaa-d49d0f0021c9 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:51:45.533073 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5586b1d7-8755-4587-9eaa-d49d0f0021c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:51:45.552942 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-5586b1d7-8755-4587-9eaa-d49d0f0021c9 None None] MFA Rules not processed for user `735d2518c8404bd991acee533b314039`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:51:45.554735 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-5586b1d7-8755-4587-9eaa-d49d0f0021c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:51:45.578633 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1171/2353] 10.222.0.15 () {58 vars in 1009 bytes} [Tue May 31 14:51:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:51:45.594401 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cf3f9b-c9db-4d6c-a60f-675b009b6cbd service swift] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:51:45.613046 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cf3f9b-c9db-4d6c-a60f-675b009b6cbd service swift] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:51:45.619301 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9433ac-e87e-41d9-8004-bad474332def service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e158f461c66e4d779f23fb7760672897', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:51:45.621686 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9433ac-e87e-41d9-8004-bad474332def service swift] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:51:45.621686 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9433ac-e87e-41d9-8004-bad474332def service swift] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:51:45.621686 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9433ac-e87e-41d9-8004-bad474332def service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:51:45.636619 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9433ac-e87e-41d9-8004-bad474332def service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:51:45.638672 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9433ac-e87e-41d9-8004-bad474332def service swift] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:51:45.649521 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1183/2354] 10.222.0.15 () {60 vars in 1384 bytes} [Tue May 31 14:51:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 31 14:51:55.545982 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=31 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:51:55.645259 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=71,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:52:03.886199 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6e1354-0fdf-4cff-ab79-cc21f9148c46 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:52:03.886875 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6e1354-0fdf-4cff-ab79-cc21f9148c46 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:52:03.886875 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6e1354-0fdf-4cff-ab79-cc21f9148c46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:52:03.907380 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-8c6e1354-0fdf-4cff-ab79-cc21f9148c46 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:52:03.908684 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-8c6e1354-0fdf-4cff-ab79-cc21f9148c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:52:03.973209 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1172/2355] 10.222.0.73 () {58 vars in 1016 bytes} [Tue May 31 14:52:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:52:03.991186 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9433ac-e87e-41d9-8004-bad474332def service swift] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:52:03.992804 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-ae9433ac-e87e-41d9-8004-bad474332def service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:52:04.094807 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9433ac-e87e-41d9-8004-bad474332def service swift] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:52:04.100360 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf33748-4cef-4a14-9216-8656d64c8a03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57768d448e345ad8879bf29f21b48ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:52:04.101019 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf33748-4cef-4a14-9216-8656d64c8a03 service nova] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:52:04.101303 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf33748-4cef-4a14-9216-8656d64c8a03 service nova] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:52:04.101578 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf33748-4cef-4a14-9216-8656d64c8a03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:52:04.110457 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf33748-4cef-4a14-9216-8656d64c8a03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:52:04.112074 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf33748-4cef-4a14-9216-8656d64c8a03 service nova] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:52:04.122048 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1184/2356] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:52:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:52:11.728401 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c694e-1130-4fed-8131-a54d81418955 None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:52:11.729796 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c694e-1130-4fed-8131-a54d81418955 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:52:11.730491 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9c694e-1130-4fed-8131-a54d81418955 None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:52:11.733264 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1173/2357] 10.222.0.15 () {54 vars in 921 bytes} [Tue May 31 14:52:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:52:11.741646 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b64f76b-39a8-49ca-8815-7fcd23d03924 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:52:11.742170 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b64f76b-39a8-49ca-8815-7fcd23d03924 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:52:11.742170 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b64f76b-39a8-49ca-8815-7fcd23d03924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:52:11.791454 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-4b64f76b-39a8-49ca-8815-7fcd23d03924 None None] MFA Rules not processed for user `b57768d448e345ad8879bf29f21b48ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:52:11.795363 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-4b64f76b-39a8-49ca-8815-7fcd23d03924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:52:11.802994 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1185/2358] 10.222.0.15 () {58 vars in 1018 bytes} [Tue May 31 14:52:11 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 14:52:11.815548 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9c694e-1130-4fed-8131-a54d81418955 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:52:11.817247 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-fa9c694e-1130-4fed-8131-a54d81418955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:52:11.906781 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9c694e-1130-4fed-8131-a54d81418955 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:52:11.911282 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5476f2d2-594a-4bc5-a193-ccac1e637357 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ba98b007cc4ae1b20e7f261824b77c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:52:11.912028 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5476f2d2-594a-4bc5-a193-ccac1e637357 service glance] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:52:11.912256 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5476f2d2-594a-4bc5-a193-ccac1e637357 service glance] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:52:11.912511 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5476f2d2-594a-4bc5-a193-ccac1e637357 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:52:11.926798 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5476f2d2-594a-4bc5-a193-ccac1e637357 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:52:11.928550 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5476f2d2-594a-4bc5-a193-ccac1e637357 service glance] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:52:11.940264 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1174/2359] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:52:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 14:52:12.126658 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de1ea88-458b-4dab-82e9-d7b3ec5f117a None None] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:52:12.127390 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de1ea88-458b-4dab-82e9-d7b3ec5f117a None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:52:12.127671 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de1ea88-458b-4dab-82e9-d7b3ec5f117a None None] PATH_INFO: `/` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:52:12.129079 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1186/2360] 10.222.0.15 () {54 vars in 921 bytes} [Tue May 31 14:52:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:52:12.133882 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533431de-0057-40cb-9bdf-4aa396aed23f None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:52:12.134076 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533431de-0057-40cb-9bdf-4aa396aed23f None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:52:12.134362 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533431de-0057-40cb-9bdf-4aa396aed23f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:52:12.152248 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-533431de-0057-40cb-9bdf-4aa396aed23f None None] MFA Rules not processed for user `c5262f4b9b2948fdb3b4ab504311453b`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:52:12.153451 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-533431de-0057-40cb-9bdf-4aa396aed23f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:52:12.204933 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1175/2361] 10.222.0.15 () {58 vars in 1018 bytes} [Tue May 31 14:52:12 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:52:12.205997 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fdccad-8e28-47c5-9505-3885e0dfedc2 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:52:12.206311 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fdccad-8e28-47c5-9505-3885e0dfedc2 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:52:12.206617 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fdccad-8e28-47c5-9505-3885e0dfedc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:52:12.216830 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533431de-0057-40cb-9bdf-4aa396aed23f None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:52:12.218244 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-533431de-0057-40cb-9bdf-4aa396aed23f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:52:12.225584 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-f0fdccad-8e28-47c5-9505-3885e0dfedc2 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:52:12.226833 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-f0fdccad-8e28-47c5-9505-3885e0dfedc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:52:12.229109 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533431de-0057-40cb-9bdf-4aa396aed23f None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:52:12.232746 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b0d06b-b629-4ccc-a4ce-cc8fb6990ec0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:52:12.233386 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b0d06b-b629-4ccc-a4ce-cc8fb6990ec0 service neutron] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:52:12.233671 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b0d06b-b629-4ccc-a4ce-cc8fb6990ec0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:52:12.233948 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b0d06b-b629-4ccc-a4ce-cc8fb6990ec0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:52:12.234775 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1187/2362] 10.222.0.73 () {58 vars in 1016 bytes} [Tue May 31 14:52:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 14:52:12.242137 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b0d06b-b629-4ccc-a4ce-cc8fb6990ec0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:52:12.243602 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b0d06b-b629-4ccc-a4ce-cc8fb6990ec0 service neutron] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:52:12.248844 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fdccad-8e28-47c5-9505-3885e0dfedc2 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:52:12.250122 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-f0fdccad-8e28-47c5-9505-3885e0dfedc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:52:12.251541 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1176/2363] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:52:12 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 14:52:12.265730 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fdccad-8e28-47c5-9505-3885e0dfedc2 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:52:12.271403 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d809b2a-77ad-41e6-bb21-28de10cac3a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57768d448e345ad8879bf29f21b48ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:52:12.272048 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d809b2a-77ad-41e6-bb21-28de10cac3a9 service nova] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:52:12.272329 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d809b2a-77ad-41e6-bb21-28de10cac3a9 service nova] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:52:12.272606 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d809b2a-77ad-41e6-bb21-28de10cac3a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:52:12.281129 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d809b2a-77ad-41e6-bb21-28de10cac3a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:52:12.282744 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d809b2a-77ad-41e6-bb21-28de10cac3a9 service nova] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:52:12.293848 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1188/2364] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:52:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:52:12.340019 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbb5bbd-5cdd-4269-a8f4-62d3b0695c1d None None] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:52:12.340310 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbb5bbd-5cdd-4269-a8f4-62d3b0695c1d None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:52:12.340585 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbb5bbd-5cdd-4269-a8f4-62d3b0695c1d None None] PATH_INFO: `/` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:52:12.342002 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1177/2365] 10.222.0.15 () {54 vars in 921 bytes} [Tue May 31 14:52:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 31 14:52:12.348083 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90314ab-dd5a-490e-b755-02819e3354bd None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:52:12.348404 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90314ab-dd5a-490e-b755-02819e3354bd None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:52:12.348714 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90314ab-dd5a-490e-b755-02819e3354bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:52:12.366612 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-a90314ab-dd5a-490e-b755-02819e3354bd None None] MFA Rules not processed for user `b57768d448e345ad8879bf29f21b48ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:52:12.367810 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-a90314ab-dd5a-490e-b755-02819e3354bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:52:12.377457 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1189/2366] 10.222.0.15 () {58 vars in 1018 bytes} [Tue May 31 14:52:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:52:12.389923 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbb5bbd-5cdd-4269-a8f4-62d3b0695c1d None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:52:12.403112 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbb5bbd-5cdd-4269-a8f4-62d3b0695c1d None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:52:12.406680 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e312b7-9d88-4cb5-b1b1-fa4ef425f3bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:52:12.407316 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e312b7-9d88-4cb5-b1b1-fa4ef425f3bf service neutron] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:52:12.407598 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e312b7-9d88-4cb5-b1b1-fa4ef425f3bf service neutron] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:52:12.407870 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e312b7-9d88-4cb5-b1b1-fa4ef425f3bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:52:12.419227 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e312b7-9d88-4cb5-b1b1-fa4ef425f3bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:52:12.420647 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e312b7-9d88-4cb5-b1b1-fa4ef425f3bf service neutron] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:52:12.431831 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1178/2367] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:52:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 14:52:12.795156 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83fcf7b-5e6e-4302-a24c-c75e0572c9af None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:52:12.795693 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83fcf7b-5e6e-4302-a24c-c75e0572c9af None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:52:12.795693 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83fcf7b-5e6e-4302-a24c-c75e0572c9af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:52:12.815088 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-d83fcf7b-5e6e-4302-a24c-c75e0572c9af None None] MFA Rules not processed for user `b24a7de30b9a4258a41161b2ff7080b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:52:12.816293 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-d83fcf7b-5e6e-4302-a24c-c75e0572c9af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:52:12.823588 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1190/2368] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:52:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:52:15.792748 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a180b9ed-3854-46a9-a3e7-c8085c29a088 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:52:15.793271 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a180b9ed-3854-46a9-a3e7-c8085c29a088 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:52:15.793368 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a180b9ed-3854-46a9-a3e7-c8085c29a088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:52:15.806226 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:52:15.812531 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-a180b9ed-3854-46a9-a3e7-c8085c29a088 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:52:15.813791 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-a180b9ed-3854-46a9-a3e7-c8085c29a088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:52:15.821883 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1179/2369] 10.222.0.73 () {58 vars in 1016 bytes} [Tue May 31 14:52:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:52:15.835348 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83fcf7b-5e6e-4302-a24c-c75e0572c9af None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:52:15.848214 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83fcf7b-5e6e-4302-a24c-c75e0572c9af None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:52:15.853689 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ba2ba3-6ab9-4aab-960f-793eee43eff9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57768d448e345ad8879bf29f21b48ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:52:15.854325 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ba2ba3-6ab9-4aab-960f-793eee43eff9 service nova] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:52:15.854637 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ba2ba3-6ab9-4aab-960f-793eee43eff9 service nova] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:52:15.854914 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ba2ba3-6ab9-4aab-960f-793eee43eff9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:52:15.863875 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ba2ba3-6ab9-4aab-960f-793eee43eff9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:52:15.865424 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ba2ba3-6ab9-4aab-960f-793eee43eff9 service nova] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:52:15.874658 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1191/2370] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:52:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:52:20.133898 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ecf7f-817f-4bcb-8c07-2ab915bfd07e None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:52:20.134377 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ecf7f-817f-4bcb-8c07-2ab915bfd07e None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:52:20.134471 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ecf7f-817f-4bcb-8c07-2ab915bfd07e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:52:20.183827 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-890ecf7f-817f-4bcb-8c07-2ab915bfd07e None None] MFA Rules not processed for user `735d2518c8404bd991acee533b314039`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:52:20.185039 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-890ecf7f-817f-4bcb-8c07-2ab915bfd07e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:52:20.201709 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1180/2371] 10.222.0.15 () {58 vars in 1009 bytes} [Tue May 31 14:52:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:52:20.213602 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ba2ba3-6ab9-4aab-960f-793eee43eff9 service nova] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:52:20.235097 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ba2ba3-6ab9-4aab-960f-793eee43eff9 service nova] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:52:20.240727 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ecc89f-6428-407b-b433-3e2880bdc8d9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e158f461c66e4d779f23fb7760672897', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:52:20.241367 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ecc89f-6428-407b-b433-3e2880bdc8d9 service swift] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:52:20.241653 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ecc89f-6428-407b-b433-3e2880bdc8d9 service swift] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:52:20.241928 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ecc89f-6428-407b-b433-3e2880bdc8d9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:52:20.250408 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ecc89f-6428-407b-b433-3e2880bdc8d9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:52:20.252025 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ecc89f-6428-407b-b433-3e2880bdc8d9 service swift] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:52:20.260145 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1192/2372] 10.222.0.15 () {60 vars in 1384 bytes} [Tue May 31 14:52:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 31 14:52:20.744975 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0e4f9f-c708-4ef9-aa5a-888ca5b70d2f None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:52:20.745271 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0e4f9f-c708-4ef9-aa5a-888ca5b70d2f None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:52:20.745554 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0e4f9f-c708-4ef9-aa5a-888ca5b70d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:52:20.763219 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-3d0e4f9f-c708-4ef9-aa5a-888ca5b70d2f None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:52:20.764418 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-3d0e4f9f-c708-4ef9-aa5a-888ca5b70d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:52:20.772489 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1181/2373] 10.222.0.73 () {58 vars in 1016 bytes} [Tue May 31 14:52:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:52:20.787789 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ecc89f-6428-407b-b433-3e2880bdc8d9 service swift] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:52:20.799898 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ecc89f-6428-407b-b433-3e2880bdc8d9 service swift] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:52:20.805496 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ec8d44-d8a4-4d6b-a24a-37aa0b6ddad6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57768d448e345ad8879bf29f21b48ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:52:20.806062 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec8d44-d8a4-4d6b-a24a-37aa0b6ddad6 service nova] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:52:20.806342 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec8d44-d8a4-4d6b-a24a-37aa0b6ddad6 service nova] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:52:20.806646 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec8d44-d8a4-4d6b-a24a-37aa0b6ddad6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:52:20.815228 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ec8d44-d8a4-4d6b-a24a-37aa0b6ddad6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:52:20.816842 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ec8d44-d8a4-4d6b-a24a-37aa0b6ddad6 service nova] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:52:20.826581 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1193/2374] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:52:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:52:30.758274 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=21 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:52:30.822428 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=89 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:52:39.448312 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae596ea-7a58-4cdc-bf05-9292bc297149 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:52:39.448934 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae596ea-7a58-4cdc-bf05-9292bc297149 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:52:39.448934 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae596ea-7a58-4cdc-bf05-9292bc297149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:52:39.466379 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-eae596ea-7a58-4cdc-bf05-9292bc297149 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:52:39.467605 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-eae596ea-7a58-4cdc-bf05-9292bc297149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:52:39.475846 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1182/2375] 10.222.0.73 () {58 vars in 1016 bytes} [Tue May 31 14:52:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:52:39.494959 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ec8d44-d8a4-4d6b-a24a-37aa0b6ddad6 service nova] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:52:39.506075 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ec8d44-d8a4-4d6b-a24a-37aa0b6ddad6 service nova] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:52:39.512286 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401456a8-25c2-45b8-b4be-81f11e2d36da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57768d448e345ad8879bf29f21b48ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:52:39.513130 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401456a8-25c2-45b8-b4be-81f11e2d36da service nova] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:52:39.513528 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401456a8-25c2-45b8-b4be-81f11e2d36da service nova] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:52:39.513810 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401456a8-25c2-45b8-b4be-81f11e2d36da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:52:39.522403 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401456a8-25c2-45b8-b4be-81f11e2d36da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:52:39.524118 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401456a8-25c2-45b8-b4be-81f11e2d36da service nova] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:52:39.535552 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1194/2376] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:52:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:52:39.584881 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae596ea-7a58-4cdc-bf05-9292bc297149 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:52:39.584881 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-eae596ea-7a58-4cdc-bf05-9292bc297149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:52:39.746836 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae596ea-7a58-4cdc-bf05-9292bc297149 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:52:39.752531 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f8c2cd-174d-47ad-8747-14c5358dcb48 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc959ca520c4816b5ff7f95655e53e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:52:39.753361 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8c2cd-174d-47ad-8747-14c5358dcb48 service placement] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:52:39.753650 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8c2cd-174d-47ad-8747-14c5358dcb48 service placement] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:52:39.753926 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8c2cd-174d-47ad-8747-14c5358dcb48 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:52:39.755976 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-b8f8c2cd-174d-47ad-8747-14c5358dcb48 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:52:39.768101 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f8c2cd-174d-47ad-8747-14c5358dcb48 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:52:39.769652 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f8c2cd-174d-47ad-8747-14c5358dcb48 service placement] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:52:39.780535 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1183/2377] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:52:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:52:40.365767 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401456a8-25c2-45b8-b4be-81f11e2d36da service nova] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:52:40.375227 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401456a8-25c2-45b8-b4be-81f11e2d36da service nova] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:52:40.379656 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439c95f7-f9f5-4cf0-91b2-5a97aa1293fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:52:40.380293 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439c95f7-f9f5-4cf0-91b2-5a97aa1293fc service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:52:40.380577 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439c95f7-f9f5-4cf0-91b2-5a97aa1293fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:52:40.380854 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439c95f7-f9f5-4cf0-91b2-5a97aa1293fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:52:40.382666 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-439c95f7-f9f5-4cf0-91b2-5a97aa1293fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:52:40.445730 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439c95f7-f9f5-4cf0-91b2-5a97aa1293fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:52:40.452941 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439c95f7-f9f5-4cf0-91b2-5a97aa1293fc service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:52:40.457881 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1195/2378] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:52:40 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:52:45.795203 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a96c48-4bee-414d-99c3-fdcc203c8fe7 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:52:45.795767 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a96c48-4bee-414d-99c3-fdcc203c8fe7 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:52:45.796000 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a96c48-4bee-414d-99c3-fdcc203c8fe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:52:45.836579 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-c8a96c48-4bee-414d-99c3-fdcc203c8fe7 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:52:45.842721 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-c8a96c48-4bee-414d-99c3-fdcc203c8fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:52:45.864089 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1184/2379] 10.222.0.73 () {58 vars in 1016 bytes} [Tue May 31 14:52:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:52:45.912813 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439c95f7-f9f5-4cf0-91b2-5a97aa1293fc service neutron] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:52:45.933469 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439c95f7-f9f5-4cf0-91b2-5a97aa1293fc service neutron] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:52:45.940678 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8c1d37-c061-4b9d-b0af-7265cc516bd7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57768d448e345ad8879bf29f21b48ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:52:45.941561 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c1d37-c061-4b9d-b0af-7265cc516bd7 service nova] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:52:45.942719 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c1d37-c061-4b9d-b0af-7265cc516bd7 service nova] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:52:45.943159 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c1d37-c061-4b9d-b0af-7265cc516bd7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:52:45.953984 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8c1d37-c061-4b9d-b0af-7265cc516bd7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:52:45.955710 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8c1d37-c061-4b9d-b0af-7265cc516bd7 service nova] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:52:45.970811 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1196/2380] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:52:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:52:46.620436 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707b6c1e-6434-4e27-8103-1a523aef2472 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:52:46.620911 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707b6c1e-6434-4e27-8103-1a523aef2472 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:52:46.621460 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707b6c1e-6434-4e27-8103-1a523aef2472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:52:46.649354 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-707b6c1e-6434-4e27-8103-1a523aef2472 None None] MFA Rules not processed for user `735d2518c8404bd991acee533b314039`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:52:46.650870 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-707b6c1e-6434-4e27-8103-1a523aef2472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:52:46.660849 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1185/2381] 10.222.0.15 () {58 vars in 967 bytes} [Tue May 31 14:52:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:52:46.708937 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8c1d37-c061-4b9d-b0af-7265cc516bd7 service nova] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:52:46.721186 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8c1d37-c061-4b9d-b0af-7265cc516bd7 service nova] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:52:46.726807 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebf9d7e-92f6-4cb0-920d-2b7dce85ba5a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e158f461c66e4d779f23fb7760672897', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:52:46.727676 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebf9d7e-92f6-4cb0-920d-2b7dce85ba5a service swift] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:52:46.727968 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebf9d7e-92f6-4cb0-920d-2b7dce85ba5a service swift] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:52:46.728280 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebf9d7e-92f6-4cb0-920d-2b7dce85ba5a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:52:46.740552 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebf9d7e-92f6-4cb0-920d-2b7dce85ba5a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:52:46.742239 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebf9d7e-92f6-4cb0-920d-2b7dce85ba5a service swift] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:52:46.751417 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1197/2382] 10.222.0.15 () {60 vars in 1384 bytes} [Tue May 31 14:52:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 31 14:52:48.631052 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf598e9-f23f-4054-9432-24cee3c04718 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:52:48.631052 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf598e9-f23f-4054-9432-24cee3c04718 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:52:48.631052 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf598e9-f23f-4054-9432-24cee3c04718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:52:48.647492 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-caf598e9-f23f-4054-9432-24cee3c04718 None None] MFA Rules not processed for user `735d2518c8404bd991acee533b314039`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:52:48.648737 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-caf598e9-f23f-4054-9432-24cee3c04718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:52:48.656348 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1186/2383] 10.222.0.15 () {58 vars in 1009 bytes} [Tue May 31 14:52:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:52:48.672740 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebf9d7e-92f6-4cb0-920d-2b7dce85ba5a service swift] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:52:48.687977 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebf9d7e-92f6-4cb0-920d-2b7dce85ba5a service swift] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:52:48.693807 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b607350-1e75-45a4-aee0-3673b62d4127 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e158f461c66e4d779f23fb7760672897', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:52:48.694448 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b607350-1e75-45a4-aee0-3673b62d4127 service swift] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:52:48.694949 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b607350-1e75-45a4-aee0-3673b62d4127 service swift] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:52:48.695250 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b607350-1e75-45a4-aee0-3673b62d4127 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:52:48.704564 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b607350-1e75-45a4-aee0-3673b62d4127 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:52:48.706620 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b607350-1e75-45a4-aee0-3673b62d4127 service swift] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:52:48.718741 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1198/2384] 10.222.0.15 () {60 vars in 1384 bytes} [Tue May 31 14:52:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 31 14:52:58.641747 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=53 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:52:58.715139 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=54 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:53:05.214921 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd121d9-c91a-4d8c-b87d-c8e74f052e0b None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:53:05.215432 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd121d9-c91a-4d8c-b87d-c8e74f052e0b None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:53:05.215530 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd121d9-c91a-4d8c-b87d-c8e74f052e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:53:05.233411 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-dbd121d9-c91a-4d8c-b87d-c8e74f052e0b None None] MFA Rules not processed for user `735d2518c8404bd991acee533b314039`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:53:05.234665 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-dbd121d9-c91a-4d8c-b87d-c8e74f052e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:53:05.242276 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1187/2385] 10.222.0.15 () {58 vars in 967 bytes} [Tue May 31 14:53:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:53:05.254631 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b607350-1e75-45a4-aee0-3673b62d4127 service swift] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:53:05.264747 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b607350-1e75-45a4-aee0-3673b62d4127 service swift] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:53:05.270186 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bd9809-2cda-4f4a-83e9-6b443c4ce855 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e158f461c66e4d779f23fb7760672897', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:53:05.270854 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd9809-2cda-4f4a-83e9-6b443c4ce855 service swift] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:53:05.271135 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd9809-2cda-4f4a-83e9-6b443c4ce855 service swift] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:53:05.271430 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd9809-2cda-4f4a-83e9-6b443c4ce855 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:53:05.279223 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bd9809-2cda-4f4a-83e9-6b443c4ce855 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:53:05.280771 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bd9809-2cda-4f4a-83e9-6b443c4ce855 service swift] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:53:05.289598 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1199/2386] 10.222.0.15 () {60 vars in 1384 bytes} [Tue May 31 14:53:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 31 14:53:05.541146 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01115166-f29a-422d-8ff7-2d2d47f72b82 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:53:05.541452 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01115166-f29a-422d-8ff7-2d2d47f72b82 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:53:05.541746 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01115166-f29a-422d-8ff7-2d2d47f72b82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:53:05.559362 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-01115166-f29a-422d-8ff7-2d2d47f72b82 None None] MFA Rules not processed for user `7a2ecbb7bd2447858e2a99cd78bd9982`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:53:05.560671 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-01115166-f29a-422d-8ff7-2d2d47f72b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:53:05.619646 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1188/2387] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:53:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:53:06.895264 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42965ff8-cf94-4c9e-ab6a-f75bae7fd2de None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:53:06.895803 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42965ff8-cf94-4c9e-ab6a-f75bae7fd2de None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:53:06.895803 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42965ff8-cf94-4c9e-ab6a-f75bae7fd2de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:53:06.913220 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-42965ff8-cf94-4c9e-ab6a-f75bae7fd2de None None] MFA Rules not processed for user `001117ac48b544f1adbc64f0acb988f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:53:06.914436 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-42965ff8-cf94-4c9e-ab6a-f75bae7fd2de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:53:06.975135 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1200/2388] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:53:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:53:08.385862 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01115166-f29a-422d-8ff7-2d2d47f72b82 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:53:08.388839 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-01115166-f29a-422d-8ff7-2d2d47f72b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:53:08.406987 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01115166-f29a-422d-8ff7-2d2d47f72b82 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:53:08.411825 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a08ff0b-758c-47a0-812a-e623d096e9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:53:08.412708 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a08ff0b-758c-47a0-812a-e623d096e9c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:53:08.412997 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a08ff0b-758c-47a0-812a-e623d096e9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:53:08.413278 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a08ff0b-758c-47a0-812a-e623d096e9c9 admin admin] PATH_INFO: `/v3/users/b24a7de30b9a4258a41161b2ff7080b6` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:53:08.414469 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a08ff0b-758c-47a0-812a-e623d096e9c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b24a7de30b9a4258a41161b2ff7080b6)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:53:08.416586 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a08ff0b-758c-47a0-812a-e623d096e9c9 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:53:08.661065 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-6a08ff0b-758c-47a0-812a-e623d096e9c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b24a7de30b9a4258a41161b2ff7080b6'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:53:08.667746 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-6a08ff0b-758c-47a0-812a-e623d096e9c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b24a7de30b9a4258a41161b2ff7080b6'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:53:08.668436 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-6a08ff0b-758c-47a0-812a-e623d096e9c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b24a7de30b9a4258a41161b2ff7080b6'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:53:08.669042 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-6a08ff0b-758c-47a0-812a-e623d096e9c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b24a7de30b9a4258a41161b2ff7080b6'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:53:08.683073 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-6a08ff0b-758c-47a0-812a-e623d096e9c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b24a7de30b9a4258a41161b2ff7080b6'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:53:08.789502 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1189/2389] 10.222.0.15 () {58 vars in 1223 bytes} [Tue May 31 14:53:08 2022] DELETE /identity/v3/users/b24a7de30b9a4258a41161b2ff7080b6 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:53:09.036801 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42965ff8-cf94-4c9e-ab6a-f75bae7fd2de None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:53:09.047477 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42965ff8-cf94-4c9e-ab6a-f75bae7fd2de None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:53:09.104716 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4521e57-edbd-4f7b-8555-7e865a492f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:53:09.105580 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4521e57-edbd-4f7b-8555-7e865a492f9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:53:09.105908 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4521e57-edbd-4f7b-8555-7e865a492f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:53:09.106195 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4521e57-edbd-4f7b-8555-7e865a492f9e admin admin] PATH_INFO: `/v3/projects/9ac463b37e604cc888c87bf93c46a791` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:53:09.107553 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4521e57-edbd-4f7b-8555-7e865a492f9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ac463b37e604cc888c87bf93c46a791)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:53:09.110333 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4521e57-edbd-4f7b-8555-7e865a492f9e admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:53:09.270426 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-a4521e57-edbd-4f7b-8555-7e865a492f9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ac463b37e604cc888c87bf93c46a791', 'request_id': 'req-a4521e57-edbd-4f7b-8555-7e865a492f9e'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:53:09.343988 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-a4521e57-edbd-4f7b-8555-7e865a492f9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ac463b37e604cc888c87bf93c46a791', 'request_id': 'req-a4521e57-edbd-4f7b-8555-7e865a492f9e'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:53:09.350798 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-a4521e57-edbd-4f7b-8555-7e865a492f9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ac463b37e604cc888c87bf93c46a791', 'request_id': 'req-a4521e57-edbd-4f7b-8555-7e865a492f9e'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:53:09.361673 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-a4521e57-edbd-4f7b-8555-7e865a492f9e admin admin] The token cache is being invalidate because project 9ac463b37e604cc888c87bf93c46a791 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80503) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 14:53:09.361955 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-a4521e57-edbd-4f7b-8555-7e865a492f9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:53:09.362762 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-a4521e57-edbd-4f7b-8555-7e865a492f9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:53:09.364387 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1201/2390] 10.222.0.15 () {58 vars in 1232 bytes} [Tue May 31 14:53:09 2022] DELETE /identity/v3/projects/9ac463b37e604cc888c87bf93c46a791 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:53:09.369356 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69998f1-a23b-4d13-a2f5-060c57387272 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:53:09.369651 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69998f1-a23b-4d13-a2f5-060c57387272 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:53:09.369946 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69998f1-a23b-4d13-a2f5-060c57387272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:53:09.387208 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-b69998f1-a23b-4d13-a2f5-060c57387272 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:53:09.388426 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-b69998f1-a23b-4d13-a2f5-060c57387272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:53:09.447067 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1190/2391] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:53:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:53:09.454610 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee9b62-7f6e-4a18-ae08-7f78e4849adc None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:53:09.454907 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee9b62-7f6e-4a18-ae08-7f78e4849adc None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:53:09.455197 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fee9b62-7f6e-4a18-ae08-7f78e4849adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:53:09.474230 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-3fee9b62-7f6e-4a18-ae08-7f78e4849adc None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:53:09.475483 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-3fee9b62-7f6e-4a18-ae08-7f78e4849adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:53:09.483245 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1202/2392] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:53:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:53:09.487400 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69998f1-a23b-4d13-a2f5-060c57387272 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:53:09.497605 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69998f1-a23b-4d13-a2f5-060c57387272 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:53:09.502111 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525d9cbe-eb48-47b2-97e4-dfeb2e16f5a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:53:09.502805 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d9cbe-eb48-47b2-97e4-dfeb2e16f5a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:53:09.503099 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d9cbe-eb48-47b2-97e4-dfeb2e16f5a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:53:09.503381 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d9cbe-eb48-47b2-97e4-dfeb2e16f5a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:53:09.504149 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525d9cbe-eb48-47b2-97e4-dfeb2e16f5a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:53:09.504465 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525d9cbe-eb48-47b2-97e4-dfeb2e16f5a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:53:09.506062 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525d9cbe-eb48-47b2-97e4-dfeb2e16f5a8 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:53:09.512618 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:53:09.518013 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1191/2393] 10.222.0.15 () {58 vars in 1152 bytes} [Tue May 31 14:53:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:53:09.528005 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fee9b62-7f6e-4a18-ae08-7f78e4849adc None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:53:09.537632 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fee9b62-7f6e-4a18-ae08-7f78e4849adc None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:53:09.542194 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79238dda-a531-45ae-acce-09c92b8f11eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:53:09.542869 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79238dda-a531-45ae-acce-09c92b8f11eb admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:53:09.543152 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79238dda-a531-45ae-acce-09c92b8f11eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:53:09.543433 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79238dda-a531-45ae-acce-09c92b8f11eb admin admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:53:09.544129 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79238dda-a531-45ae-acce-09c92b8f11eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:53:09.546003 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79238dda-a531-45ae-acce-09c92b8f11eb admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:53:09.559874 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:53:09.670892 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1203/2394] 10.222.0.15 () {60 vars in 1152 bytes} [Tue May 31 14:53:09 2022] POST /identity/v3/projects => generated 391 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:53:09.677717 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525d9cbe-eb48-47b2-97e4-dfeb2e16f5a8 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:53:09.690005 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525d9cbe-eb48-47b2-97e4-dfeb2e16f5a8 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:53:09.745562 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58487589-f380-4333-9583-22d6124c6b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:53:09.746221 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58487589-f380-4333-9583-22d6124c6b79 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:53:09.746512 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58487589-f380-4333-9583-22d6124c6b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:53:09.746824 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58487589-f380-4333-9583-22d6124c6b79 admin admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:53:09.747602 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58487589-f380-4333-9583-22d6124c6b79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:53:09.749542 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58487589-f380-4333-9583-22d6124c6b79 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:53:09.852048 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1192/2395] 10.222.0.15 () {60 vars in 1143 bytes} [Tue May 31 14:53:09 2022] POST /identity/v3/users => generated 296 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 14:53:09.855646 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79238dda-a531-45ae-acce-09c92b8f11eb admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:53:09.867054 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79238dda-a531-45ae-acce-09c92b8f11eb admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:53:09.873234 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f1ac7a-4075-4723-bbdc-85bfaf5070a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:53:09.873889 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f1ac7a-4075-4723-bbdc-85bfaf5070a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:53:09.874172 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f1ac7a-4075-4723-bbdc-85bfaf5070a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:53:09.874447 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f1ac7a-4075-4723-bbdc-85bfaf5070a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:53:09.875188 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f1ac7a-4075-4723-bbdc-85bfaf5070a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:53:09.876763 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f1ac7a-4075-4723-bbdc-85bfaf5070a9 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:53:09.887932 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1204/2396] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:53:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:53:09.891914 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58487589-f380-4333-9583-22d6124c6b79 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:53:09.901773 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58487589-f380-4333-9583-22d6124c6b79 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:53:09.906395 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f27cf82-0636-46aa-a3d1-a2845f2b1410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:53:09.907081 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f27cf82-0636-46aa-a3d1-a2845f2b1410 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:53:09.907365 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f27cf82-0636-46aa-a3d1-a2845f2b1410 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:53:09.910148 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f27cf82-0636-46aa-a3d1-a2845f2b1410 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:53:09.910148 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f27cf82-0636-46aa-a3d1-a2845f2b1410 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:53:09.910148 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f27cf82-0636-46aa-a3d1-a2845f2b1410 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:53:09.920143 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1193/2397] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:53:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:53:09.924312 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f1ac7a-4075-4723-bbdc-85bfaf5070a9 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:53:09.935551 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f1ac7a-4075-4723-bbdc-85bfaf5070a9 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:53:09.940500 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7893019a-df31-4920-81c2-7ebbd1e59bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:53:09.941396 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7893019a-df31-4920-81c2-7ebbd1e59bea admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:53:09.942591 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7893019a-df31-4920-81c2-7ebbd1e59bea admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:53:09.942902 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7893019a-df31-4920-81c2-7ebbd1e59bea admin admin] PATH_INFO: `/v3/projects/2c4c547ceb054f468a1c37c95e44d2bb/users/b490258f465847819758f98e7765b59e/roles/317f725e26bf43648d8235bb1f7c4cb3` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:53:09.961394 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7893019a-df31-4920-81c2-7ebbd1e59bea admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c4c547ceb054f468a1c37c95e44d2bb, user_id=b490258f465847819758f98e7765b59e, role_id=317f725e26bf43648d8235bb1f7c4cb3)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:53:09.964244 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7893019a-df31-4920-81c2-7ebbd1e59bea admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:53:10.053656 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1205/2398] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:53:09 2022] PUT /identity/v3/projects/2c4c547ceb054f468a1c37c95e44d2bb/users/b490258f465847819758f98e7765b59e/roles/317f725e26bf43648d8235bb1f7c4cb3 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:53:10.064451 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c563c2b-9e7c-4f4e-a8be-1833ec5af295 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:53:10.064746 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c563c2b-9e7c-4f4e-a8be-1833ec5af295 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:53:10.064994 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c563c2b-9e7c-4f4e-a8be-1833ec5af295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:53:10.091928 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-9c563c2b-9e7c-4f4e-a8be-1833ec5af295 None None] MFA Rules not processed for user `b490258f465847819758f98e7765b59e`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:53:10.093183 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-9c563c2b-9e7c-4f4e-a8be-1833ec5af295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:53:10.166125 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1194/2399] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:53:10 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 14:53:10.177275 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7893019a-df31-4920-81c2-7ebbd1e59bea admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:53:10.179074 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-7893019a-df31-4920-81c2-7ebbd1e59bea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:53:10.259395 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7893019a-df31-4920-81c2-7ebbd1e59bea admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:53:10.263114 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4144e477-c8e7-4fed-b76c-ddc9e0865f99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afbf718dcd9b4741a926b0a2321bd53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:53:10.263764 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4144e477-c8e7-4fed-b76c-ddc9e0865f99 service cinder] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:53:10.264049 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4144e477-c8e7-4fed-b76c-ddc9e0865f99 service cinder] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:53:10.264327 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4144e477-c8e7-4fed-b76c-ddc9e0865f99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:53:10.273679 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4144e477-c8e7-4fed-b76c-ddc9e0865f99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:53:10.275149 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4144e477-c8e7-4fed-b76c-ddc9e0865f99 service cinder] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:53:10.284280 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1206/2400] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:53:10 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:53:20.162919 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=67,keystone:INSERT=3 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:53:20.280266 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:INSERT=2,keystone:SELECT=52 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:53:21.690269 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c563c2b-9e7c-4f4e-a8be-1833ec5af295 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:53:21.753819 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c563c2b-9e7c-4f4e-a8be-1833ec5af295 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:53:21.758306 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ad9d1c-0bb9-46f3-b8c8-735815f8b52b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:53:21.759205 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad9d1c-0bb9-46f3-b8c8-735815f8b52b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:53:21.759491 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad9d1c-0bb9-46f3-b8c8-735815f8b52b admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:53:21.759767 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ad9d1c-0bb9-46f3-b8c8-735815f8b52b admin admin] PATH_INFO: `/v3/users/b490258f465847819758f98e7765b59e` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:53:21.761115 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ad9d1c-0bb9-46f3-b8c8-735815f8b52b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b490258f465847819758f98e7765b59e)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:53:21.763083 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ad9d1c-0bb9-46f3-b8c8-735815f8b52b admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:53:21.969950 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-b5ad9d1c-0bb9-46f3-b8c8-735815f8b52b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b490258f465847819758f98e7765b59e'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:53:21.976779 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-b5ad9d1c-0bb9-46f3-b8c8-735815f8b52b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b490258f465847819758f98e7765b59e'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:53:21.977555 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-b5ad9d1c-0bb9-46f3-b8c8-735815f8b52b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b490258f465847819758f98e7765b59e'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:53:21.978168 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-b5ad9d1c-0bb9-46f3-b8c8-735815f8b52b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b490258f465847819758f98e7765b59e'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:53:21.991121 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-b5ad9d1c-0bb9-46f3-b8c8-735815f8b52b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b490258f465847819758f98e7765b59e'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:53:22.086482 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1195/2401] 10.222.0.15 () {58 vars in 1223 bytes} [Tue May 31 14:53:21 2022] DELETE /identity/v3/users/b490258f465847819758f98e7765b59e => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:53:22.091259 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b21a6e-40f6-4293-ba2b-5cdfef6ac3ce None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:53:22.091770 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b21a6e-40f6-4293-ba2b-5cdfef6ac3ce None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:53:22.091888 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b21a6e-40f6-4293-ba2b-5cdfef6ac3ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:53:22.113237 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-64b21a6e-40f6-4293-ba2b-5cdfef6ac3ce None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:53:22.114886 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-64b21a6e-40f6-4293-ba2b-5cdfef6ac3ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:53:22.173569 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1207/2402] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:53:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:53:22.184117 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ad9d1c-0bb9-46f3-b8c8-735815f8b52b admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:53:22.185582 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-b5ad9d1c-0bb9-46f3-b8c8-735815f8b52b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:53:22.255316 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ad9d1c-0bb9-46f3-b8c8-735815f8b52b admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:53:22.259187 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cfe25a-febc-4ebf-9092-4c7eeb1060b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:53:22.259919 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cfe25a-febc-4ebf-9092-4c7eeb1060b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:53:22.260276 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cfe25a-febc-4ebf-9092-4c7eeb1060b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:53:22.260624 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cfe25a-febc-4ebf-9092-4c7eeb1060b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:53:22.273792 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cfe25a-febc-4ebf-9092-4c7eeb1060b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:53:22.275445 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cfe25a-febc-4ebf-9092-4c7eeb1060b8 service neutron] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:53:22.292602 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1196/2403] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:53:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:53:22.773932 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b21a6e-40f6-4293-ba2b-5cdfef6ac3ce None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:53:22.775579 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-64b21a6e-40f6-4293-ba2b-5cdfef6ac3ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:53:22.788397 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b21a6e-40f6-4293-ba2b-5cdfef6ac3ce None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:53:22.793490 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726a177c-62e2-451b-9e54-779bca173792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:53:22.794354 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a177c-62e2-451b-9e54-779bca173792 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:53:22.794684 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a177c-62e2-451b-9e54-779bca173792 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:53:22.794957 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a177c-62e2-451b-9e54-779bca173792 admin admin] PATH_INFO: `/v3/projects/2c4c547ceb054f468a1c37c95e44d2bb` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:53:22.796150 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726a177c-62e2-451b-9e54-779bca173792 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c4c547ceb054f468a1c37c95e44d2bb)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:53:22.798951 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726a177c-62e2-451b-9e54-779bca173792 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:53:22.892289 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-726a177c-62e2-451b-9e54-779bca173792 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c4c547ceb054f468a1c37c95e44d2bb', 'request_id': 'req-726a177c-62e2-451b-9e54-779bca173792'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:53:22.949507 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-726a177c-62e2-451b-9e54-779bca173792 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c4c547ceb054f468a1c37c95e44d2bb', 'request_id': 'req-726a177c-62e2-451b-9e54-779bca173792'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:53:22.955508 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-726a177c-62e2-451b-9e54-779bca173792 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c4c547ceb054f468a1c37c95e44d2bb', 'request_id': 'req-726a177c-62e2-451b-9e54-779bca173792'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:53:22.967261 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-726a177c-62e2-451b-9e54-779bca173792 admin admin] The token cache is being invalidate because project 2c4c547ceb054f468a1c37c95e44d2bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80503) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 14:53:22.967495 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-726a177c-62e2-451b-9e54-779bca173792 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:53:22.968133 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-726a177c-62e2-451b-9e54-779bca173792 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:53:22.969666 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1208/2404] 10.222.0.15 () {58 vars in 1232 bytes} [Tue May 31 14:53:22 2022] DELETE /identity/v3/projects/2c4c547ceb054f468a1c37c95e44d2bb => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:53:26.178679 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4403ff9e-1330-45ee-ae7d-44763196ad13 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:53:26.179243 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4403ff9e-1330-45ee-ae7d-44763196ad13 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:53:26.179243 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4403ff9e-1330-45ee-ae7d-44763196ad13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:53:26.196934 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-4403ff9e-1330-45ee-ae7d-44763196ad13 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:53:26.198158 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-4403ff9e-1330-45ee-ae7d-44763196ad13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:53:26.215073 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:53:26.255027 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1197/2405] 10.222.0.73 () {58 vars in 1016 bytes} [Tue May 31 14:53:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:53:26.274918 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726a177c-62e2-451b-9e54-779bca173792 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:53:26.276829 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-726a177c-62e2-451b-9e54-779bca173792 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:53:26.349681 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726a177c-62e2-451b-9e54-779bca173792 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:53:26.355934 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0ef9a2-a5b3-46b2-ad1c-60f6879e7a39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57768d448e345ad8879bf29f21b48ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:53:26.356577 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0ef9a2-a5b3-46b2-ad1c-60f6879e7a39 service nova] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:53:26.356867 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0ef9a2-a5b3-46b2-ad1c-60f6879e7a39 service nova] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:53:26.357153 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0ef9a2-a5b3-46b2-ad1c-60f6879e7a39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:53:26.365305 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0ef9a2-a5b3-46b2-ad1c-60f6879e7a39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:53:26.366930 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0ef9a2-a5b3-46b2-ad1c-60f6879e7a39 service nova] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:53:26.376251 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1209/2406] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:53:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:53:31.784287 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86584e5e-2dfe-43fd-a8ac-7f8289cc1622 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:53:31.784830 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86584e5e-2dfe-43fd-a8ac-7f8289cc1622 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:53:31.784830 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86584e5e-2dfe-43fd-a8ac-7f8289cc1622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:53:31.803910 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-86584e5e-2dfe-43fd-a8ac-7f8289cc1622 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:53:31.805109 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-86584e5e-2dfe-43fd-a8ac-7f8289cc1622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:53:31.817612 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1198/2407] 10.222.0.73 () {58 vars in 1016 bytes} [Tue May 31 14:53:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:53:31.832065 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0ef9a2-a5b3-46b2-ad1c-60f6879e7a39 service nova] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:53:31.843923 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0ef9a2-a5b3-46b2-ad1c-60f6879e7a39 service nova] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:53:31.849340 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb712fb-04e2-4795-ad28-46b4104c9956 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57768d448e345ad8879bf29f21b48ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:53:31.850117 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb712fb-04e2-4795-ad28-46b4104c9956 service nova] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:53:31.850404 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb712fb-04e2-4795-ad28-46b4104c9956 service nova] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:53:31.850714 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb712fb-04e2-4795-ad28-46b4104c9956 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:53:31.857488 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:53:31.861652 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb712fb-04e2-4795-ad28-46b4104c9956 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:53:31.863357 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb712fb-04e2-4795-ad28-46b4104c9956 service nova] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:53:31.873401 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1210/2408] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:53:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:53:35.700343 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f99b4-d1be-413a-a7a9-0d2573899bd4 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:53:35.700969 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f99b4-d1be-413a-a7a9-0d2573899bd4 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:53:35.700969 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f99b4-d1be-413a-a7a9-0d2573899bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:53:35.719650 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-962f99b4-d1be-413a-a7a9-0d2573899bd4 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:53:35.720942 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-962f99b4-d1be-413a-a7a9-0d2573899bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:53:35.728975 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1199/2409] 10.222.0.73 () {58 vars in 1016 bytes} [Tue May 31 14:53:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:53:35.746628 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb712fb-04e2-4795-ad28-46b4104c9956 service nova] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:53:35.748188 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-7fb712fb-04e2-4795-ad28-46b4104c9956 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:53:35.762690 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb712fb-04e2-4795-ad28-46b4104c9956 service nova] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:53:35.768543 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f18972-b51d-4a3e-9446-d2ee98248694 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57768d448e345ad8879bf29f21b48ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:53:35.769002 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f18972-b51d-4a3e-9446-d2ee98248694 service nova] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:53:35.769285 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f18972-b51d-4a3e-9446-d2ee98248694 service nova] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:53:35.769559 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f18972-b51d-4a3e-9446-d2ee98248694 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:53:35.778776 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f18972-b51d-4a3e-9446-d2ee98248694 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:53:35.780409 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f18972-b51d-4a3e-9446-d2ee98248694 service nova] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:53:35.789975 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1211/2410] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:53:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:53:35.866680 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512b1a04-234b-4c2b-9a08-c69776c73e77 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:53:35.866972 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512b1a04-234b-4c2b-9a08-c69776c73e77 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:53:35.867304 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512b1a04-234b-4c2b-9a08-c69776c73e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:53:35.886312 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-512b1a04-234b-4c2b-9a08-c69776c73e77 None None] MFA Rules not processed for user `ec0bc78fb2d849cb89fec3420844d738`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:53:35.887529 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-512b1a04-234b-4c2b-9a08-c69776c73e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:53:35.945575 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1200/2411] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:53:35 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:53:40.977113 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91cab74-0e22-4594-a961-4c18ef6e9705 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:53:40.977674 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91cab74-0e22-4594-a961-4c18ef6e9705 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:53:40.977791 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91cab74-0e22-4594-a961-4c18ef6e9705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:53:40.998025 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-d91cab74-0e22-4594-a961-4c18ef6e9705 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:53:40.999274 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-d91cab74-0e22-4594-a961-4c18ef6e9705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:53:41.007039 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1212/2412] 10.222.0.73 () {58 vars in 1016 bytes} [Tue May 31 14:53:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:53:41.022178 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512b1a04-234b-4c2b-9a08-c69776c73e77 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:53:41.034918 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512b1a04-234b-4c2b-9a08-c69776c73e77 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:53:41.041006 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc4ab0c-b9df-42d6-92c2-0992976c99ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57768d448e345ad8879bf29f21b48ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:53:41.041653 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc4ab0c-b9df-42d6-92c2-0992976c99ff service nova] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:53:41.041935 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc4ab0c-b9df-42d6-92c2-0992976c99ff service nova] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:53:41.042213 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc4ab0c-b9df-42d6-92c2-0992976c99ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:53:41.051309 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc4ab0c-b9df-42d6-92c2-0992976c99ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:53:41.056241 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc4ab0c-b9df-42d6-92c2-0992976c99ff service nova] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:53:41.063270 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1201/2413] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:53:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:53:43.769116 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e83cbb7-2f8b-44e6-896d-ce39d1255e89 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:53:43.769632 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e83cbb7-2f8b-44e6-896d-ce39d1255e89 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:53:43.769737 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e83cbb7-2f8b-44e6-896d-ce39d1255e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:53:43.787067 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-3e83cbb7-2f8b-44e6-896d-ce39d1255e89 None None] MFA Rules not processed for user `3ba53ede9ae9426f9f89c885aea9e32e`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:53:43.788299 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-3e83cbb7-2f8b-44e6-896d-ce39d1255e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:53:43.843090 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1213/2414] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:53:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:53:44.266030 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb2f1e6-7a88-4503-b343-b15ad1db6ec6 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:53:44.266617 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb2f1e6-7a88-4503-b343-b15ad1db6ec6 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:53:44.266726 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb2f1e6-7a88-4503-b343-b15ad1db6ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:53:44.284785 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-fbb2f1e6-7a88-4503-b343-b15ad1db6ec6 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:53:44.286019 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-fbb2f1e6-7a88-4503-b343-b15ad1db6ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:53:44.295069 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1202/2415] 10.222.0.73 () {58 vars in 1016 bytes} [Tue May 31 14:53:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:53:44.316837 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e83cbb7-2f8b-44e6-896d-ce39d1255e89 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:53:44.329540 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e83cbb7-2f8b-44e6-896d-ce39d1255e89 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:53:44.335032 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494ac5b1-26e8-44ad-8381-edc45edeffde service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57768d448e345ad8879bf29f21b48ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:53:44.335694 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ac5b1-26e8-44ad-8381-edc45edeffde service nova] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:53:44.335991 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ac5b1-26e8-44ad-8381-edc45edeffde service nova] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:53:44.336241 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ac5b1-26e8-44ad-8381-edc45edeffde service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:53:44.344982 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494ac5b1-26e8-44ad-8381-edc45edeffde service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:53:44.346539 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494ac5b1-26e8-44ad-8381-edc45edeffde service nova] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:53:44.356348 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1214/2416] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:53:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:53:54.279583 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=57 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:53:54.351694 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=42 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:54:20.507730 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb2f1e6-7a88-4503-b343-b15ad1db6ec6 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:54:20.509291 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-fbb2f1e6-7a88-4503-b343-b15ad1db6ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:54:20.568911 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb2f1e6-7a88-4503-b343-b15ad1db6ec6 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:54:20.573026 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc16c06-015f-41a4-8b3a-2e7d041a291a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:54:20.573882 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc16c06-015f-41a4-8b3a-2e7d041a291a service neutron] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:54:20.574173 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc16c06-015f-41a4-8b3a-2e7d041a291a service neutron] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:54:20.574656 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc16c06-015f-41a4-8b3a-2e7d041a291a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:54:20.576479 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-1fc16c06-015f-41a4-8b3a-2e7d041a291a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:54:20.590160 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc16c06-015f-41a4-8b3a-2e7d041a291a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:54:20.591643 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc16c06-015f-41a4-8b3a-2e7d041a291a service neutron] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:54:20.602440 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1203/2417] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:54:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:54:22.437437 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494ac5b1-26e8-44ad-8381-edc45edeffde service nova] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:54:22.439401 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-494ac5b1-26e8-44ad-8381-edc45edeffde service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:54:22.469016 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494ac5b1-26e8-44ad-8381-edc45edeffde service nova] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:54:22.476040 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55497597-5fad-47a6-adf4-0dd58875f5c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:54:22.481065 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55497597-5fad-47a6-adf4-0dd58875f5c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:54:22.481065 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55497597-5fad-47a6-adf4-0dd58875f5c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:54:22.481065 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55497597-5fad-47a6-adf4-0dd58875f5c3 admin admin] PATH_INFO: `/v3/users/7a2ecbb7bd2447858e2a99cd78bd9982` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:54:22.481065 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55497597-5fad-47a6-adf4-0dd58875f5c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a2ecbb7bd2447858e2a99cd78bd9982)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:54:22.481065 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55497597-5fad-47a6-adf4-0dd58875f5c3 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:54:22.704915 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-55497597-5fad-47a6-adf4-0dd58875f5c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a2ecbb7bd2447858e2a99cd78bd9982'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:54:22.803587 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-55497597-5fad-47a6-adf4-0dd58875f5c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a2ecbb7bd2447858e2a99cd78bd9982'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:54:22.804192 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-55497597-5fad-47a6-adf4-0dd58875f5c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a2ecbb7bd2447858e2a99cd78bd9982'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:54:22.813787 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-55497597-5fad-47a6-adf4-0dd58875f5c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a2ecbb7bd2447858e2a99cd78bd9982'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:54:22.814018 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-55497597-5fad-47a6-adf4-0dd58875f5c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a2ecbb7bd2447858e2a99cd78bd9982'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:54:22.833279 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1215/2418] 10.222.0.15 () {58 vars in 1223 bytes} [Tue May 31 14:54:22 2022] DELETE /identity/v3/users/7a2ecbb7bd2447858e2a99cd78bd9982 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:54:23.085064 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc16c06-015f-41a4-8b3a-2e7d041a291a service neutron] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:54:23.096784 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc16c06-015f-41a4-8b3a-2e7d041a291a service neutron] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:54:23.168232 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cb040d-a9d7-4593-a6ca-729382237a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:54:23.169152 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb040d-a9d7-4593-a6ca-729382237a20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:54:23.169438 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb040d-a9d7-4593-a6ca-729382237a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:54:23.169719 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb040d-a9d7-4593-a6ca-729382237a20 admin admin] PATH_INFO: `/v3/projects/8c9cd513bf8a41558758aa27441cb4ca` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:54:23.170995 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cb040d-a9d7-4593-a6ca-729382237a20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c9cd513bf8a41558758aa27441cb4ca)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:54:23.173058 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cb040d-a9d7-4593-a6ca-729382237a20 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:54:23.219575 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55497597-5fad-47a6-adf4-0dd58875f5c3 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:54:23.221090 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-55497597-5fad-47a6-adf4-0dd58875f5c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:54:23.241142 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55497597-5fad-47a6-adf4-0dd58875f5c3 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:54:23.245287 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453ca6d0-a7dc-482e-9030-b0d6d769276d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:54:23.246157 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ca6d0-a7dc-482e-9030-b0d6d769276d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:54:23.246439 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ca6d0-a7dc-482e-9030-b0d6d769276d admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:54:23.246773 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ca6d0-a7dc-482e-9030-b0d6d769276d admin admin] PATH_INFO: `/v3/users/001117ac48b544f1adbc64f0acb988f7` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:54:23.248028 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453ca6d0-a7dc-482e-9030-b0d6d769276d admin admin] RBAC: Authorizing `identity:delete_user(user_id=001117ac48b544f1adbc64f0acb988f7)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:54:23.249954 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453ca6d0-a7dc-482e-9030-b0d6d769276d admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:54:23.288148 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-d8cb040d-a9d7-4593-a6ca-729382237a20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c9cd513bf8a41558758aa27441cb4ca', 'request_id': 'req-d8cb040d-a9d7-4593-a6ca-729382237a20'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:54:23.295050 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-d8cb040d-a9d7-4593-a6ca-729382237a20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c9cd513bf8a41558758aa27441cb4ca', 'request_id': 'req-d8cb040d-a9d7-4593-a6ca-729382237a20'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:54:23.368518 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-d8cb040d-a9d7-4593-a6ca-729382237a20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c9cd513bf8a41558758aa27441cb4ca', 'request_id': 'req-d8cb040d-a9d7-4593-a6ca-729382237a20'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:54:23.379453 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-d8cb040d-a9d7-4593-a6ca-729382237a20 admin admin] The token cache is being invalidate because project 8c9cd513bf8a41558758aa27441cb4ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 14:54:23.379741 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-d8cb040d-a9d7-4593-a6ca-729382237a20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:54:23.380391 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-d8cb040d-a9d7-4593-a6ca-729382237a20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:54:23.383478 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1204/2419] 10.222.0.15 () {58 vars in 1232 bytes} [Tue May 31 14:54:23 2022] DELETE /identity/v3/projects/8c9cd513bf8a41558758aa27441cb4ca => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 14:54:23.419663 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-453ca6d0-a7dc-482e-9030-b0d6d769276d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '001117ac48b544f1adbc64f0acb988f7'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:54:23.489016 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-453ca6d0-a7dc-482e-9030-b0d6d769276d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '001117ac48b544f1adbc64f0acb988f7'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:54:23.489702 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-453ca6d0-a7dc-482e-9030-b0d6d769276d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '001117ac48b544f1adbc64f0acb988f7'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:54:23.498171 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-453ca6d0-a7dc-482e-9030-b0d6d769276d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '001117ac48b544f1adbc64f0acb988f7'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:54:23.499141 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-453ca6d0-a7dc-482e-9030-b0d6d769276d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '001117ac48b544f1adbc64f0acb988f7'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:54:23.518443 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1216/2420] 10.222.0.15 () {58 vars in 1223 bytes} [Tue May 31 14:54:23 2022] DELETE /identity/v3/users/001117ac48b544f1adbc64f0acb988f7 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 14:54:23.822807 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cb040d-a9d7-4593-a6ca-729382237a20 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:54:23.824376 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-d8cb040d-a9d7-4593-a6ca-729382237a20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:54:23.861747 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:54:23.892784 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cb040d-a9d7-4593-a6ca-729382237a20 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:54:23.953681 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15dd77e-c78a-4820-a144-51c04cf0a751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:54:23.954570 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15dd77e-c78a-4820-a144-51c04cf0a751 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:54:23.954875 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15dd77e-c78a-4820-a144-51c04cf0a751 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:54:23.955162 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15dd77e-c78a-4820-a144-51c04cf0a751 admin admin] PATH_INFO: `/v3/projects/3b9a03a0a28c424cbf4a7592bbb35fe7` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:54:23.956351 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15dd77e-c78a-4820-a144-51c04cf0a751 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b9a03a0a28c424cbf4a7592bbb35fe7)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:54:23.959006 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15dd77e-c78a-4820-a144-51c04cf0a751 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:54:24.072306 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-c15dd77e-c78a-4820-a144-51c04cf0a751 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b9a03a0a28c424cbf4a7592bbb35fe7', 'request_id': 'req-c15dd77e-c78a-4820-a144-51c04cf0a751'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:54:24.078356 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-c15dd77e-c78a-4820-a144-51c04cf0a751 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b9a03a0a28c424cbf4a7592bbb35fe7', 'request_id': 'req-c15dd77e-c78a-4820-a144-51c04cf0a751'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:54:24.140064 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-c15dd77e-c78a-4820-a144-51c04cf0a751 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b9a03a0a28c424cbf4a7592bbb35fe7', 'request_id': 'req-c15dd77e-c78a-4820-a144-51c04cf0a751'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:54:24.150718 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-c15dd77e-c78a-4820-a144-51c04cf0a751 admin admin] The token cache is being invalidate because project 3b9a03a0a28c424cbf4a7592bbb35fe7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 14:54:24.150954 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-c15dd77e-c78a-4820-a144-51c04cf0a751 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:54:24.151576 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-c15dd77e-c78a-4820-a144-51c04cf0a751 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:54:24.153103 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1205/2421] 10.222.0.15 () {58 vars in 1232 bytes} [Tue May 31 14:54:23 2022] DELETE /identity/v3/projects/3b9a03a0a28c424cbf4a7592bbb35fe7 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:54:24.158007 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f88dc7c-20b2-4dff-ae43-9c6f1ec9f1ed None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:54:24.158302 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f88dc7c-20b2-4dff-ae43-9c6f1ec9f1ed None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:54:24.158615 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f88dc7c-20b2-4dff-ae43-9c6f1ec9f1ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:54:24.177179 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-7f88dc7c-20b2-4dff-ae43-9c6f1ec9f1ed None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:54:24.178414 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-7f88dc7c-20b2-4dff-ae43-9c6f1ec9f1ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:54:24.217653 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:54:24.235879 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1217/2422] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:54:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:54:24.243903 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e508b8a-3d68-4d81-b232-06b530042c5b None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:54:24.244223 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e508b8a-3d68-4d81-b232-06b530042c5b None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:54:24.244509 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e508b8a-3d68-4d81-b232-06b530042c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:54:24.262954 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-2e508b8a-3d68-4d81-b232-06b530042c5b None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:54:24.264325 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-2e508b8a-3d68-4d81-b232-06b530042c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:54:24.272235 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1206/2423] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:54:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:54:24.276419 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f88dc7c-20b2-4dff-ae43-9c6f1ec9f1ed None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:54:24.286177 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f88dc7c-20b2-4dff-ae43-9c6f1ec9f1ed None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:54:24.290723 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875e26ab-3832-4d70-a4b1-5cbbaf111072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:54:24.293034 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e26ab-3832-4d70-a4b1-5cbbaf111072 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:54:24.293034 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e26ab-3832-4d70-a4b1-5cbbaf111072 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:54:24.293034 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e26ab-3832-4d70-a4b1-5cbbaf111072 admin admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:54:24.293034 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875e26ab-3832-4d70-a4b1-5cbbaf111072 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:54:24.293034 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875e26ab-3832-4d70-a4b1-5cbbaf111072 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:54:24.294579 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875e26ab-3832-4d70-a4b1-5cbbaf111072 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:54:24.307144 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1218/2424] 10.222.0.15 () {58 vars in 1152 bytes} [Tue May 31 14:54:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:54:24.311778 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e508b8a-3d68-4d81-b232-06b530042c5b None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:54:24.321528 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e508b8a-3d68-4d81-b232-06b530042c5b None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:54:24.331701 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c80c508-4eb8-4243-b645-3746cac46325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:54:24.332450 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c80c508-4eb8-4243-b645-3746cac46325 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:54:24.332733 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c80c508-4eb8-4243-b645-3746cac46325 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:54:24.333011 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c80c508-4eb8-4243-b645-3746cac46325 admin admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:54:24.333705 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c80c508-4eb8-4243-b645-3746cac46325 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:54:24.335648 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c80c508-4eb8-4243-b645-3746cac46325 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:54:24.462602 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1207/2425] 10.222.0.15 () {60 vars in 1152 bytes} [Tue May 31 14:54:24 2022] POST /identity/v3/projects => generated 367 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:54:24.466820 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875e26ab-3832-4d70-a4b1-5cbbaf111072 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:54:24.478569 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875e26ab-3832-4d70-a4b1-5cbbaf111072 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:54:24.539109 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39940d03-351a-42e7-bd36-8ea73c2e50e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:54:24.539817 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39940d03-351a-42e7-bd36-8ea73c2e50e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:54:24.540057 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39940d03-351a-42e7-bd36-8ea73c2e50e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:54:24.540338 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39940d03-351a-42e7-bd36-8ea73c2e50e8 admin admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:54:24.541040 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39940d03-351a-42e7-bd36-8ea73c2e50e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:54:24.542994 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39940d03-351a-42e7-bd36-8ea73c2e50e8 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:54:24.654386 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1219/2426] 10.222.0.15 () {60 vars in 1143 bytes} [Tue May 31 14:54:24 2022] POST /identity/v3/users => generated 284 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:54:24.659257 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c80c508-4eb8-4243-b645-3746cac46325 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:54:24.670332 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c80c508-4eb8-4243-b645-3746cac46325 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:54:24.674961 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be562744-66ba-4997-8695-38666561c872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:54:24.676300 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be562744-66ba-4997-8695-38666561c872 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:54:24.676668 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be562744-66ba-4997-8695-38666561c872 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:54:24.676969 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be562744-66ba-4997-8695-38666561c872 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:54:24.677691 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be562744-66ba-4997-8695-38666561c872 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:54:24.679328 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be562744-66ba-4997-8695-38666561c872 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:54:24.690416 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1208/2427] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:54:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:54:24.695612 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39940d03-351a-42e7-bd36-8ea73c2e50e8 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:54:24.709194 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39940d03-351a-42e7-bd36-8ea73c2e50e8 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:54:24.715228 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f8c194-4495-4d90-8d03-df6e41024b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:54:24.715228 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f8c194-4495-4d90-8d03-df6e41024b80 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:54:24.715518 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f8c194-4495-4d90-8d03-df6e41024b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:54:24.715845 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f8c194-4495-4d90-8d03-df6e41024b80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:54:24.716572 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f8c194-4495-4d90-8d03-df6e41024b80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:54:24.718302 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f8c194-4495-4d90-8d03-df6e41024b80 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:54:24.729766 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1220/2428] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:54:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:54:24.734480 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be562744-66ba-4997-8695-38666561c872 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:54:24.748999 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be562744-66ba-4997-8695-38666561c872 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:54:24.755498 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4690b22-a0e1-4f76-a653-2728e92f38d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:54:24.756994 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4690b22-a0e1-4f76-a653-2728e92f38d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:54:24.757890 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4690b22-a0e1-4f76-a653-2728e92f38d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:54:24.757890 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4690b22-a0e1-4f76-a653-2728e92f38d8 admin admin] PATH_INFO: `/v3/projects/a82a457524614be0bcc37f00775323b5/users/81932ae35cc7423d862283453ee438e3/roles/317f725e26bf43648d8235bb1f7c4cb3` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:54:24.782730 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4690b22-a0e1-4f76-a653-2728e92f38d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a82a457524614be0bcc37f00775323b5, user_id=81932ae35cc7423d862283453ee438e3, role_id=317f725e26bf43648d8235bb1f7c4cb3)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:54:24.782730 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4690b22-a0e1-4f76-a653-2728e92f38d8 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:54:24.907221 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1209/2429] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:54:24 2022] PUT /identity/v3/projects/a82a457524614be0bcc37f00775323b5/users/81932ae35cc7423d862283453ee438e3/roles/317f725e26bf43648d8235bb1f7c4cb3 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:54:24.924982 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b90adf-3d09-472f-baa3-6ba66ddeea77 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:54:24.925271 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b90adf-3d09-472f-baa3-6ba66ddeea77 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:54:24.925554 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b90adf-3d09-472f-baa3-6ba66ddeea77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:54:24.953310 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-d6b90adf-3d09-472f-baa3-6ba66ddeea77 None None] MFA Rules not processed for user `81932ae35cc7423d862283453ee438e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:54:24.954518 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-d6b90adf-3d09-472f-baa3-6ba66ddeea77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:54:25.017569 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1221/2430] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:54:24 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:54:25.028481 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4690b22-a0e1-4f76-a653-2728e92f38d8 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:54:25.030232 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-e4690b22-a0e1-4f76-a653-2728e92f38d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:54:25.040196 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:54:25.089785 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4690b22-a0e1-4f76-a653-2728e92f38d8 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:54:25.093457 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368782ed-a986-4941-bfd0-aef23205a658 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afbf718dcd9b4741a926b0a2321bd53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:54:25.094103 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368782ed-a986-4941-bfd0-aef23205a658 service cinder] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:54:25.094385 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368782ed-a986-4941-bfd0-aef23205a658 service cinder] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:54:25.094693 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368782ed-a986-4941-bfd0-aef23205a658 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:54:25.103208 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368782ed-a986-4941-bfd0-aef23205a658 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:54:25.105169 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368782ed-a986-4941-bfd0-aef23205a658 service cinder] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:54:25.116174 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1210/2431] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:54:25 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:54:26.853349 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b90adf-3d09-472f-baa3-6ba66ddeea77 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:54:26.854754 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-d6b90adf-3d09-472f-baa3-6ba66ddeea77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:54:26.866327 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b90adf-3d09-472f-baa3-6ba66ddeea77 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:54:26.869872 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d44a499-856b-4cf7-8b69-24c384256c46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afbf718dcd9b4741a926b0a2321bd53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:54:26.870499 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d44a499-856b-4cf7-8b69-24c384256c46 service cinder] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:54:26.870806 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d44a499-856b-4cf7-8b69-24c384256c46 service cinder] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:54:26.871077 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d44a499-856b-4cf7-8b69-24c384256c46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:54:26.872778 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-0d44a499-856b-4cf7-8b69-24c384256c46 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:54:26.915058 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:54:26.951436 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d44a499-856b-4cf7-8b69-24c384256c46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:54:26.952881 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d44a499-856b-4cf7-8b69-24c384256c46 service cinder] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:54:26.964078 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1222/2432] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:54:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:54:28.396844 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368782ed-a986-4941-bfd0-aef23205a658 service cinder] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:54:28.398309 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-368782ed-a986-4941-bfd0-aef23205a658 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:54:28.453554 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368782ed-a986-4941-bfd0-aef23205a658 service cinder] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:54:28.457092 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299c6d41-bbc5-4d84-8f08-019caca80e62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:54:28.457722 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c6d41-bbc5-4d84-8f08-019caca80e62 service neutron] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:54:28.458004 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c6d41-bbc5-4d84-8f08-019caca80e62 service neutron] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:54:28.458277 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c6d41-bbc5-4d84-8f08-019caca80e62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:54:28.460079 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-299c6d41-bbc5-4d84-8f08-019caca80e62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:54:28.472933 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299c6d41-bbc5-4d84-8f08-019caca80e62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:54:28.474865 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299c6d41-bbc5-4d84-8f08-019caca80e62 service neutron] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:54:28.485453 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1211/2433] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:54:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:54:34.803418 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d44a499-856b-4cf7-8b69-24c384256c46 service cinder] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:54:34.804841 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-0d44a499-856b-4cf7-8b69-24c384256c46 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:54:34.819469 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d44a499-856b-4cf7-8b69-24c384256c46 service cinder] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:54:34.825000 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52d848d-0a00-40f1-a5ea-ca9cf6054f38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57768d448e345ad8879bf29f21b48ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:54:34.825631 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52d848d-0a00-40f1-a5ea-ca9cf6054f38 service nova] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:54:34.825909 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52d848d-0a00-40f1-a5ea-ca9cf6054f38 service nova] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:54:34.826226 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52d848d-0a00-40f1-a5ea-ca9cf6054f38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:54:34.827989 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-a52d848d-0a00-40f1-a5ea-ca9cf6054f38 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:54:34.885379 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52d848d-0a00-40f1-a5ea-ca9cf6054f38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:54:34.886994 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52d848d-0a00-40f1-a5ea-ca9cf6054f38 service nova] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:54:34.895729 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1223/2434] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:54:34 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:54:35.145601 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299c6d41-bbc5-4d84-8f08-019caca80e62 service neutron] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:54:35.217754 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299c6d41-bbc5-4d84-8f08-019caca80e62 service neutron] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:54:35.222454 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caca172c-6421-4da1-80a1-6e230ee82e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:54:35.223371 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caca172c-6421-4da1-80a1-6e230ee82e68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:54:35.223655 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caca172c-6421-4da1-80a1-6e230ee82e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:54:35.223934 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caca172c-6421-4da1-80a1-6e230ee82e68 admin admin] PATH_INFO: `/v3/users/81932ae35cc7423d862283453ee438e3` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:54:35.225132 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caca172c-6421-4da1-80a1-6e230ee82e68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81932ae35cc7423d862283453ee438e3)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:54:35.227637 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caca172c-6421-4da1-80a1-6e230ee82e68 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:54:35.403034 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-caca172c-6421-4da1-80a1-6e230ee82e68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81932ae35cc7423d862283453ee438e3'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:54:35.408402 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:54:35.410280 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-caca172c-6421-4da1-80a1-6e230ee82e68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81932ae35cc7423d862283453ee438e3'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:54:35.410986 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-caca172c-6421-4da1-80a1-6e230ee82e68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81932ae35cc7423d862283453ee438e3'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:54:35.411619 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-caca172c-6421-4da1-80a1-6e230ee82e68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81932ae35cc7423d862283453ee438e3'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:54:35.424575 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-caca172c-6421-4da1-80a1-6e230ee82e68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81932ae35cc7423d862283453ee438e3'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:54:35.484622 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1212/2435] 10.222.0.15 () {58 vars in 1223 bytes} [Tue May 31 14:54:35 2022] DELETE /identity/v3/users/81932ae35cc7423d862283453ee438e3 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:54:35.489168 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b7d77-11b0-4c38-95c9-0111aa69896c None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:54:35.490743 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b7d77-11b0-4c38-95c9-0111aa69896c None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:54:35.490743 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b7d77-11b0-4c38-95c9-0111aa69896c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:54:35.512576 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-3f9b7d77-11b0-4c38-95c9-0111aa69896c None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:54:35.512576 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-3f9b7d77-11b0-4c38-95c9-0111aa69896c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:54:35.568067 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1224/2436] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:54:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:54:35.578925 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caca172c-6421-4da1-80a1-6e230ee82e68 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:54:35.581289 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-caca172c-6421-4da1-80a1-6e230ee82e68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:54:35.638053 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caca172c-6421-4da1-80a1-6e230ee82e68 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:54:35.641599 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94dd2aa-330b-4994-aa7e-1cd3d142a3fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:54:35.642247 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94dd2aa-330b-4994-aa7e-1cd3d142a3fe service neutron] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:54:35.642532 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94dd2aa-330b-4994-aa7e-1cd3d142a3fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:54:35.642845 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94dd2aa-330b-4994-aa7e-1cd3d142a3fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:54:35.652536 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94dd2aa-330b-4994-aa7e-1cd3d142a3fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:54:35.653950 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94dd2aa-330b-4994-aa7e-1cd3d142a3fe service neutron] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:54:35.663418 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1213/2437] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:54:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:54:36.085402 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9b7d77-11b0-4c38-95c9-0111aa69896c None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:54:36.086864 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-3f9b7d77-11b0-4c38-95c9-0111aa69896c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:54:36.099101 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9b7d77-11b0-4c38-95c9-0111aa69896c None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:54:36.103697 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e264e2-a6e4-4174-a292-307ec504353f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:54:36.104597 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e264e2-a6e4-4174-a292-307ec504353f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:54:36.104832 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e264e2-a6e4-4174-a292-307ec504353f admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:54:36.105105 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e264e2-a6e4-4174-a292-307ec504353f admin admin] PATH_INFO: `/v3/projects/a82a457524614be0bcc37f00775323b5` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:54:36.106424 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e264e2-a6e4-4174-a292-307ec504353f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a82a457524614be0bcc37f00775323b5)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:54:36.108364 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e264e2-a6e4-4174-a292-307ec504353f admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:54:36.210943 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-19e264e2-a6e4-4174-a292-307ec504353f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a82a457524614be0bcc37f00775323b5', 'request_id': 'req-19e264e2-a6e4-4174-a292-307ec504353f'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:54:36.282477 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-19e264e2-a6e4-4174-a292-307ec504353f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a82a457524614be0bcc37f00775323b5', 'request_id': 'req-19e264e2-a6e4-4174-a292-307ec504353f'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:54:36.287599 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:54:36.289968 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-19e264e2-a6e4-4174-a292-307ec504353f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a82a457524614be0bcc37f00775323b5', 'request_id': 'req-19e264e2-a6e4-4174-a292-307ec504353f'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:54:36.305495 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-19e264e2-a6e4-4174-a292-307ec504353f admin admin] The token cache is being invalidate because project a82a457524614be0bcc37f00775323b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80503) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 14:54:36.305792 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-19e264e2-a6e4-4174-a292-307ec504353f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:54:36.306460 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-19e264e2-a6e4-4174-a292-307ec504353f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:54:36.308321 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1225/2438] 10.222.0.15 () {58 vars in 1232 bytes} [Tue May 31 14:54:36 2022] DELETE /identity/v3/projects/a82a457524614be0bcc37f00775323b5 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:54:36.313444 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd9dac-0ee2-4085-ba9c-7ae84c7e1114 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:54:36.313963 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd9dac-0ee2-4085-ba9c-7ae84c7e1114 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:54:36.314179 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcd9dac-0ee2-4085-ba9c-7ae84c7e1114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:54:36.332638 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-6fcd9dac-0ee2-4085-ba9c-7ae84c7e1114 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:54:36.333911 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-6fcd9dac-0ee2-4085-ba9c-7ae84c7e1114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:54:36.395444 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1214/2439] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:54:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:54:36.403333 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b711be4-47a9-41f4-b92c-64673028990a None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:54:36.404229 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b711be4-47a9-41f4-b92c-64673028990a None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:54:36.404784 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b711be4-47a9-41f4-b92c-64673028990a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:54:36.424306 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-8b711be4-47a9-41f4-b92c-64673028990a None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:54:36.425595 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-8b711be4-47a9-41f4-b92c-64673028990a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:54:36.434616 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1226/2440] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:54:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:54:36.438617 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcd9dac-0ee2-4085-ba9c-7ae84c7e1114 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:54:36.448481 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcd9dac-0ee2-4085-ba9c-7ae84c7e1114 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:54:36.453291 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede78373-89c5-436e-b5b1-18aad129c2a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:54:36.453963 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede78373-89c5-436e-b5b1-18aad129c2a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:54:36.454362 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede78373-89c5-436e-b5b1-18aad129c2a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:54:36.454863 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede78373-89c5-436e-b5b1-18aad129c2a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:54:36.455415 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede78373-89c5-436e-b5b1-18aad129c2a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:54:36.455722 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede78373-89c5-436e-b5b1-18aad129c2a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:54:36.457394 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede78373-89c5-436e-b5b1-18aad129c2a4 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:54:36.469778 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1215/2441] 10.222.0.15 () {58 vars in 1152 bytes} [Tue May 31 14:54:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:54:36.473621 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b711be4-47a9-41f4-b92c-64673028990a None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:54:36.484303 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b711be4-47a9-41f4-b92c-64673028990a None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:54:36.496583 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb92962-d5c7-4228-9448-d152483b0b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:54:36.501154 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb92962-d5c7-4228-9448-d152483b0b8b admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:54:36.501154 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb92962-d5c7-4228-9448-d152483b0b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:54:36.501154 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb92962-d5c7-4228-9448-d152483b0b8b admin admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:54:36.501154 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb92962-d5c7-4228-9448-d152483b0b8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:54:36.501154 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb92962-d5c7-4228-9448-d152483b0b8b admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:54:36.611219 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1227/2442] 10.222.0.15 () {60 vars in 1152 bytes} [Tue May 31 14:54:36 2022] POST /identity/v3/projects => generated 363 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 14:54:36.615229 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede78373-89c5-436e-b5b1-18aad129c2a4 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:54:36.627138 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede78373-89c5-436e-b5b1-18aad129c2a4 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:54:36.692494 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af181db6-64e6-4e72-8bd9-56b6ce5f4b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:54:36.693844 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af181db6-64e6-4e72-8bd9-56b6ce5f4b6c admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:54:36.694429 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af181db6-64e6-4e72-8bd9-56b6ce5f4b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:54:36.694852 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af181db6-64e6-4e72-8bd9-56b6ce5f4b6c admin admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:54:36.696109 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af181db6-64e6-4e72-8bd9-56b6ce5f4b6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:54:36.700069 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af181db6-64e6-4e72-8bd9-56b6ce5f4b6c admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:54:36.708272 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:54:36.816278 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1216/2443] 10.222.0.15 () {60 vars in 1143 bytes} [Tue May 31 14:54:36 2022] POST /identity/v3/users => generated 282 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:54:36.820170 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb92962-d5c7-4228-9448-d152483b0b8b admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:54:36.841914 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb92962-d5c7-4228-9448-d152483b0b8b admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:54:36.846613 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893da102-9027-4f4a-a60c-1b13683d08c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:54:36.847276 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893da102-9027-4f4a-a60c-1b13683d08c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:54:36.847589 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893da102-9027-4f4a-a60c-1b13683d08c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:54:36.847833 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893da102-9027-4f4a-a60c-1b13683d08c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:54:36.848564 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893da102-9027-4f4a-a60c-1b13683d08c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:54:36.850151 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893da102-9027-4f4a-a60c-1b13683d08c4 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:54:36.861528 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1228/2444] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:54:36 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:54:36.865845 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af181db6-64e6-4e72-8bd9-56b6ce5f4b6c admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:54:36.883648 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af181db6-64e6-4e72-8bd9-56b6ce5f4b6c admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:54:36.890100 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71332a59-8562-4c03-89ee-5468026e05d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:54:36.891155 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71332a59-8562-4c03-89ee-5468026e05d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:54:36.891441 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71332a59-8562-4c03-89ee-5468026e05d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:54:36.891847 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71332a59-8562-4c03-89ee-5468026e05d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:54:36.892525 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71332a59-8562-4c03-89ee-5468026e05d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:54:36.894366 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71332a59-8562-4c03-89ee-5468026e05d1 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:54:36.906874 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1217/2445] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:54:36 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:54:36.911327 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893da102-9027-4f4a-a60c-1b13683d08c4 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:54:36.921809 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893da102-9027-4f4a-a60c-1b13683d08c4 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:54:36.926508 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cb1a73-6de9-4cfb-851a-7c20c27174d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:54:36.927518 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cb1a73-6de9-4cfb-851a-7c20c27174d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:54:36.927802 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cb1a73-6de9-4cfb-851a-7c20c27174d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:54:36.928083 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cb1a73-6de9-4cfb-851a-7c20c27174d7 admin admin] PATH_INFO: `/v3/projects/8254a5433f63457d942f7aa2c4a4b76f/users/5aa4732554f64a22a23833f1426d15bf/roles/317f725e26bf43648d8235bb1f7c4cb3` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:54:36.943184 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cb1a73-6de9-4cfb-851a-7c20c27174d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8254a5433f63457d942f7aa2c4a4b76f, user_id=5aa4732554f64a22a23833f1426d15bf, role_id=317f725e26bf43648d8235bb1f7c4cb3)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:54:36.945848 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cb1a73-6de9-4cfb-851a-7c20c27174d7 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:54:37.050236 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1229/2446] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:54:36 2022] PUT /identity/v3/projects/8254a5433f63457d942f7aa2c4a4b76f/users/5aa4732554f64a22a23833f1426d15bf/roles/317f725e26bf43648d8235bb1f7c4cb3 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:54:37.061113 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060ae89f-6e10-4e2e-a3d1-3abdea73bf5d None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:54:37.061405 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060ae89f-6e10-4e2e-a3d1-3abdea73bf5d None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:54:37.061690 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060ae89f-6e10-4e2e-a3d1-3abdea73bf5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:54:37.094613 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-060ae89f-6e10-4e2e-a3d1-3abdea73bf5d None None] MFA Rules not processed for user `5aa4732554f64a22a23833f1426d15bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:54:37.095918 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-060ae89f-6e10-4e2e-a3d1-3abdea73bf5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:54:37.164351 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1218/2447] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:54:37 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:54:37.168895 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cb1a73-6de9-4cfb-851a-7c20c27174d7 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:54:37.230412 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cb1a73-6de9-4cfb-851a-7c20c27174d7 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:54:37.235027 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbdcf4b-370d-41f7-961b-55b4f13a1f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:54:37.235670 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbdcf4b-370d-41f7-961b-55b4f13a1f5b admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:54:37.236058 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbdcf4b-370d-41f7-961b-55b4f13a1f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:54:37.236460 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbdcf4b-370d-41f7-961b-55b4f13a1f5b admin admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:54:37.237282 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbdcf4b-370d-41f7-961b-55b4f13a1f5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:54:37.239204 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbdcf4b-370d-41f7-961b-55b4f13a1f5b admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:54:37.359643 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1230/2448] 10.222.0.15 () {60 vars in 1152 bytes} [Tue May 31 14:54:37 2022] POST /identity/v3/projects => generated 363 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 14:54:37.363793 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060ae89f-6e10-4e2e-a3d1-3abdea73bf5d None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:54:37.374579 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060ae89f-6e10-4e2e-a3d1-3abdea73bf5d None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:54:37.438497 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8755d725-d822-48c1-b3fe-92b08b4640c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:54:37.439040 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8755d725-d822-48c1-b3fe-92b08b4640c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:54:37.439324 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8755d725-d822-48c1-b3fe-92b08b4640c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:54:37.439608 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8755d725-d822-48c1-b3fe-92b08b4640c5 admin admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:54:37.440381 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8755d725-d822-48c1-b3fe-92b08b4640c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:54:37.442420 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8755d725-d822-48c1-b3fe-92b08b4640c5 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:54:37.508317 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1219/2449] 10.222.0.15 () {60 vars in 1143 bytes} [Tue May 31 14:54:37 2022] POST /identity/v3/users => generated 288 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:54:37.513057 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbdcf4b-370d-41f7-961b-55b4f13a1f5b admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:54:37.527317 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbdcf4b-370d-41f7-961b-55b4f13a1f5b admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:54:37.533098 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb131842-39b9-4f9e-a61e-9302d6f10fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:54:37.533967 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb131842-39b9-4f9e-a61e-9302d6f10fe2 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:54:37.534349 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb131842-39b9-4f9e-a61e-9302d6f10fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:54:37.534731 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb131842-39b9-4f9e-a61e-9302d6f10fe2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:54:37.535493 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb131842-39b9-4f9e-a61e-9302d6f10fe2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:54:37.537140 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb131842-39b9-4f9e-a61e-9302d6f10fe2 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:54:37.549982 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1231/2450] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:54:37 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 14:54:37.555031 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8755d725-d822-48c1-b3fe-92b08b4640c5 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:54:37.567641 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8755d725-d822-48c1-b3fe-92b08b4640c5 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:54:37.573686 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7799e9-fb34-411b-910c-65fcad6f0810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:54:37.574165 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7799e9-fb34-411b-910c-65fcad6f0810 admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:54:37.574449 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7799e9-fb34-411b-910c-65fcad6f0810 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:54:37.574759 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7799e9-fb34-411b-910c-65fcad6f0810 admin admin] PATH_INFO: `/v3/projects/21cfa1a00bbe49c09390e35d049d70c2/users/4a430d16906744b09fd9f6df2395f96c/roles/76c53e2c353644f885028a0226c06146` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:54:37.590319 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7799e9-fb34-411b-910c-65fcad6f0810 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21cfa1a00bbe49c09390e35d049d70c2, user_id=4a430d16906744b09fd9f6df2395f96c, role_id=76c53e2c353644f885028a0226c06146)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:54:37.593237 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7799e9-fb34-411b-910c-65fcad6f0810 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:54:37.685378 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1220/2451] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:54:37 2022] PUT /identity/v3/projects/21cfa1a00bbe49c09390e35d049d70c2/users/4a430d16906744b09fd9f6df2395f96c/roles/76c53e2c353644f885028a0226c06146 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:54:37.689708 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb131842-39b9-4f9e-a61e-9302d6f10fe2 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:54:37.700356 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb131842-39b9-4f9e-a61e-9302d6f10fe2 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:54:37.750186 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:54:37.755982 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ed123c-c831-4d11-bbca-faf091823968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:54:37.756704 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed123c-c831-4d11-bbca-faf091823968 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:54:37.756925 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed123c-c831-4d11-bbca-faf091823968 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:54:37.757241 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed123c-c831-4d11-bbca-faf091823968 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:54:37.758574 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ed123c-c831-4d11-bbca-faf091823968 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:54:37.760119 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ed123c-c831-4d11-bbca-faf091823968 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:54:37.769757 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1232/2452] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:54:37 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:54:37.774112 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7799e9-fb34-411b-910c-65fcad6f0810 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:54:37.784595 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7799e9-fb34-411b-910c-65fcad6f0810 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:54:37.789643 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53abba2-8b15-4e93-beeb-b4595d160201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:54:37.790614 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53abba2-8b15-4e93-beeb-b4595d160201 admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:54:37.790840 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53abba2-8b15-4e93-beeb-b4595d160201 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:54:37.791138 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53abba2-8b15-4e93-beeb-b4595d160201 admin admin] PATH_INFO: `/v3/projects/21cfa1a00bbe49c09390e35d049d70c2/users/4a430d16906744b09fd9f6df2395f96c/roles/76c53e2c353644f885028a0226c06146` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:54:37.793155 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53abba2-8b15-4e93-beeb-b4595d160201 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21cfa1a00bbe49c09390e35d049d70c2, user_id=4a430d16906744b09fd9f6df2395f96c, role_id=76c53e2c353644f885028a0226c06146)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:54:37.795832 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53abba2-8b15-4e93-beeb-b4595d160201 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:54:37.807084 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1221/2453] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:54:37 2022] PUT /identity/v3/projects/21cfa1a00bbe49c09390e35d049d70c2/users/4a430d16906744b09fd9f6df2395f96c/roles/76c53e2c353644f885028a0226c06146 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:54:37.818491 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefe3b5f-61ea-4105-9d41-542b5997c8d8 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:54:37.818816 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefe3b5f-61ea-4105-9d41-542b5997c8d8 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:54:37.819098 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefe3b5f-61ea-4105-9d41-542b5997c8d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:54:37.846730 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-aefe3b5f-61ea-4105-9d41-542b5997c8d8 None None] MFA Rules not processed for user `4a430d16906744b09fd9f6df2395f96c`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:54:37.848043 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-aefe3b5f-61ea-4105-9d41-542b5997c8d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:54:37.913333 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1233/2454] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:54:37 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:54:37.924848 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53abba2-8b15-4e93-beeb-b4595d160201 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:54:37.926539 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-d53abba2-8b15-4e93-beeb-b4595d160201 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:54:37.961064 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:54:37.991367 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53abba2-8b15-4e93-beeb-b4595d160201 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:54:37.995512 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbcfc78-d0e6-4602-b905-c181ab682559 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afbf718dcd9b4741a926b0a2321bd53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:54:37.996145 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbcfc78-d0e6-4602-b905-c181ab682559 service cinder] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:54:37.996428 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbcfc78-d0e6-4602-b905-c181ab682559 service cinder] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:54:37.996703 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbcfc78-d0e6-4602-b905-c181ab682559 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:54:38.005381 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbcfc78-d0e6-4602-b905-c181ab682559 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:54:38.006836 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbcfc78-d0e6-4602-b905-c181ab682559 service cinder] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:54:38.016060 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1222/2455] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:54:37 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:54:38.200251 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefe3b5f-61ea-4105-9d41-542b5997c8d8 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:54:38.209902 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefe3b5f-61ea-4105-9d41-542b5997c8d8 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:54:38.213949 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1245480f-8b30-4013-808a-d3c1636761a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afbf718dcd9b4741a926b0a2321bd53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:54:38.214617 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1245480f-8b30-4013-808a-d3c1636761a4 service cinder] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:54:38.214899 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1245480f-8b30-4013-808a-d3c1636761a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:54:38.215174 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1245480f-8b30-4013-808a-d3c1636761a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:54:38.274506 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1245480f-8b30-4013-808a-d3c1636761a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:54:38.275905 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1245480f-8b30-4013-808a-d3c1636761a4 service cinder] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:54:38.285696 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1234/2456] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:54:38 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:54:38.844871 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad653b-5427-45be-a23e-24043ef09212 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:54:38.844871 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad653b-5427-45be-a23e-24043ef09212 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:54:38.845402 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad653b-5427-45be-a23e-24043ef09212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:54:38.864959 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-faad653b-5427-45be-a23e-24043ef09212 None None] MFA Rules not processed for user `735d2518c8404bd991acee533b314039`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:54:38.866127 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-faad653b-5427-45be-a23e-24043ef09212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:54:38.921599 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1223/2457] 10.222.0.15 () {58 vars in 967 bytes} [Tue May 31 14:54:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:54:39.052590 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1245480f-8b30-4013-808a-d3c1636761a4 service cinder] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:54:39.058718 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-1245480f-8b30-4013-808a-d3c1636761a4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:54:39.135131 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1245480f-8b30-4013-808a-d3c1636761a4 service cinder] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:54:39.140060 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a58aa03-a096-4da0-8487-2393ea085b06 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e158f461c66e4d779f23fb7760672897', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:54:39.140706 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a58aa03-a096-4da0-8487-2393ea085b06 service swift] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:54:39.140985 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a58aa03-a096-4da0-8487-2393ea085b06 service swift] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:54:39.141259 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a58aa03-a096-4da0-8487-2393ea085b06 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:54:39.147447 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:54:39.149816 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a58aa03-a096-4da0-8487-2393ea085b06 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:54:39.151465 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a58aa03-a096-4da0-8487-2393ea085b06 service swift] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:54:39.159699 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1235/2458] 10.222.0.15 () {60 vars in 1384 bytes} [Tue May 31 14:54:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 31 14:54:43.858860 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faad653b-5427-45be-a23e-24043ef09212 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:54:43.876516 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faad653b-5427-45be-a23e-24043ef09212 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:54:43.885469 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2b53a9-636a-4c11-a04a-fe5e46539d9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afbf718dcd9b4741a926b0a2321bd53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:54:43.900242 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b53a9-636a-4c11-a04a-fe5e46539d9e service cinder] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:54:43.901027 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b53a9-636a-4c11-a04a-fe5e46539d9e service cinder] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:54:43.901541 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b53a9-636a-4c11-a04a-fe5e46539d9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:54:43.913229 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-1e2b53a9-636a-4c11-a04a-fe5e46539d9e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:54:43.985516 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2b53a9-636a-4c11-a04a-fe5e46539d9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:54:43.987416 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2b53a9-636a-4c11-a04a-fe5e46539d9e service cinder] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:54:44.001684 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1224/2459] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:54:43 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:54:44.255544 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a58aa03-a096-4da0-8487-2393ea085b06 service swift] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:54:44.256524 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-2a58aa03-a096-4da0-8487-2393ea085b06 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:54:44.337369 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a58aa03-a096-4da0-8487-2393ea085b06 service swift] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:54:44.345844 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6607500a-8a52-420d-8fdd-75daec6f9dae service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc959ca520c4816b5ff7f95655e53e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:54:44.346499 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6607500a-8a52-420d-8fdd-75daec6f9dae service placement] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:54:44.346819 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6607500a-8a52-420d-8fdd-75daec6f9dae service placement] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:54:44.347105 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6607500a-8a52-420d-8fdd-75daec6f9dae service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:54:44.351938 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-6607500a-8a52-420d-8fdd-75daec6f9dae service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:54:44.364694 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6607500a-8a52-420d-8fdd-75daec6f9dae service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:54:44.366407 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6607500a-8a52-420d-8fdd-75daec6f9dae service placement] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:54:44.377341 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1236/2460] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:54:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:54:46.409671 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2b53a9-636a-4c11-a04a-fe5e46539d9e service cinder] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:54:46.487351 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2b53a9-636a-4c11-a04a-fe5e46539d9e service cinder] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:54:46.494894 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ce8deb-be83-4a68-9ced-c52d3a3d2524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:54:46.496534 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ce8deb-be83-4a68-9ced-c52d3a3d2524 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:54:46.496886 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ce8deb-be83-4a68-9ced-c52d3a3d2524 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:54:46.497280 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ce8deb-be83-4a68-9ced-c52d3a3d2524 admin admin] PATH_INFO: `/v3/users/5aa4732554f64a22a23833f1426d15bf` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:54:46.498720 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ce8deb-be83-4a68-9ced-c52d3a3d2524 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5aa4732554f64a22a23833f1426d15bf)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:54:46.500819 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ce8deb-be83-4a68-9ced-c52d3a3d2524 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:54:46.518250 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:54:46.700176 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-19ce8deb-be83-4a68-9ced-c52d3a3d2524 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5aa4732554f64a22a23833f1426d15bf'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:54:46.707575 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-19ce8deb-be83-4a68-9ced-c52d3a3d2524 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5aa4732554f64a22a23833f1426d15bf'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:54:46.708557 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-19ce8deb-be83-4a68-9ced-c52d3a3d2524 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5aa4732554f64a22a23833f1426d15bf'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:54:46.709160 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-19ce8deb-be83-4a68-9ced-c52d3a3d2524 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5aa4732554f64a22a23833f1426d15bf'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:54:46.722314 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-19ce8deb-be83-4a68-9ced-c52d3a3d2524 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5aa4732554f64a22a23833f1426d15bf'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:54:46.843826 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1225/2461] 10.222.0.15 () {58 vars in 1223 bytes} [Tue May 31 14:54:46 2022] DELETE /identity/v3/users/5aa4732554f64a22a23833f1426d15bf => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:54:46.845110 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d819731-8808-41dc-8271-acb66ff3ac6a None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:54:46.845604 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d819731-8808-41dc-8271-acb66ff3ac6a None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:54:46.845686 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d819731-8808-41dc-8271-acb66ff3ac6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:54:46.866739 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-4d819731-8808-41dc-8271-acb66ff3ac6a None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:54:46.868719 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-4d819731-8808-41dc-8271-acb66ff3ac6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:54:46.947819 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1237/2462] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:54:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 14:54:46.957930 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ce8deb-be83-4a68-9ced-c52d3a3d2524 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:54:46.959834 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-19ce8deb-be83-4a68-9ced-c52d3a3d2524 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:54:47.065398 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ce8deb-be83-4a68-9ced-c52d3a3d2524 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:54:47.073521 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ce451b-ef5b-49c0-acce-7c724c11cf34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:54:47.078739 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ce451b-ef5b-49c0-acce-7c724c11cf34 service neutron] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:54:47.078739 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ce451b-ef5b-49c0-acce-7c724c11cf34 service neutron] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:54:47.078739 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ce451b-ef5b-49c0-acce-7c724c11cf34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:54:47.094142 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ce451b-ef5b-49c0-acce-7c724c11cf34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:54:47.096127 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ce451b-ef5b-49c0-acce-7c724c11cf34 service neutron] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:54:47.113655 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1226/2463] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:54:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:54:47.648246 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d819731-8808-41dc-8271-acb66ff3ac6a None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:54:47.654141 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-4d819731-8808-41dc-8271-acb66ff3ac6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:54:47.672452 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d819731-8808-41dc-8271-acb66ff3ac6a None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:54:47.678632 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f586770d-b2cf-4de1-a196-772ff1e9d500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:54:47.680182 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f586770d-b2cf-4de1-a196-772ff1e9d500 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:54:47.680535 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f586770d-b2cf-4de1-a196-772ff1e9d500 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:54:47.680883 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f586770d-b2cf-4de1-a196-772ff1e9d500 admin admin] PATH_INFO: `/v3/projects/8254a5433f63457d942f7aa2c4a4b76f` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:54:47.682405 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f586770d-b2cf-4de1-a196-772ff1e9d500 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8254a5433f63457d942f7aa2c4a4b76f)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:54:47.684637 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f586770d-b2cf-4de1-a196-772ff1e9d500 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:54:47.852741 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-f586770d-b2cf-4de1-a196-772ff1e9d500 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8254a5433f63457d942f7aa2c4a4b76f', 'request_id': 'req-f586770d-b2cf-4de1-a196-772ff1e9d500'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:54:47.896132 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-f586770d-b2cf-4de1-a196-772ff1e9d500 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8254a5433f63457d942f7aa2c4a4b76f', 'request_id': 'req-f586770d-b2cf-4de1-a196-772ff1e9d500'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:54:47.908710 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-f586770d-b2cf-4de1-a196-772ff1e9d500 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8254a5433f63457d942f7aa2c4a4b76f', 'request_id': 'req-f586770d-b2cf-4de1-a196-772ff1e9d500'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:54:47.924619 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-f586770d-b2cf-4de1-a196-772ff1e9d500 admin admin] The token cache is being invalidate because project 8254a5433f63457d942f7aa2c4a4b76f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80503) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 14:54:47.925575 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-f586770d-b2cf-4de1-a196-772ff1e9d500 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:54:47.927097 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-f586770d-b2cf-4de1-a196-772ff1e9d500 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:54:47.931099 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1238/2464] 10.222.0.15 () {58 vars in 1232 bytes} [Tue May 31 14:54:47 2022] DELETE /identity/v3/projects/8254a5433f63457d942f7aa2c4a4b76f => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:54:47.935841 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ce451b-ef5b-49c0-acce-7c724c11cf34 service neutron] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:54:47.952671 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ce451b-ef5b-49c0-acce-7c724c11cf34 service neutron] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:54:48.021641 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4456095c-001f-4e28-a273-b4cd3fb9202d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:54:48.022536 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4456095c-001f-4e28-a273-b4cd3fb9202d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:54:48.022854 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4456095c-001f-4e28-a273-b4cd3fb9202d admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:54:48.023651 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4456095c-001f-4e28-a273-b4cd3fb9202d admin admin] PATH_INFO: `/v3/users/4a430d16906744b09fd9f6df2395f96c` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:54:48.025010 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4456095c-001f-4e28-a273-b4cd3fb9202d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a430d16906744b09fd9f6df2395f96c)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:54:48.027268 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4456095c-001f-4e28-a273-b4cd3fb9202d admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:54:48.215084 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:54:48.259688 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-4456095c-001f-4e28-a273-b4cd3fb9202d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a430d16906744b09fd9f6df2395f96c'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:54:48.282922 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-4456095c-001f-4e28-a273-b4cd3fb9202d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a430d16906744b09fd9f6df2395f96c'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:54:48.284173 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-4456095c-001f-4e28-a273-b4cd3fb9202d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a430d16906744b09fd9f6df2395f96c'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:54:48.285239 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-4456095c-001f-4e28-a273-b4cd3fb9202d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a430d16906744b09fd9f6df2395f96c'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:54:48.350457 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-4456095c-001f-4e28-a273-b4cd3fb9202d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a430d16906744b09fd9f6df2395f96c'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:54:48.456421 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1227/2465] 10.222.0.15 () {58 vars in 1223 bytes} [Tue May 31 14:54:47 2022] DELETE /identity/v3/users/4a430d16906744b09fd9f6df2395f96c => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:54:48.940397 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f586770d-b2cf-4de1-a196-772ff1e9d500 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:54:48.941980 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-f586770d-b2cf-4de1-a196-772ff1e9d500 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:54:48.953800 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4456095c-001f-4e28-a273-b4cd3fb9202d admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:54:48.956373 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-4456095c-001f-4e28-a273-b4cd3fb9202d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:54:48.959686 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f586770d-b2cf-4de1-a196-772ff1e9d500 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:54:48.965423 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:54:49.051379 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4456095c-001f-4e28-a273-b4cd3fb9202d admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:54:49.056492 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28b115d-ba87-45f2-ba35-1b3dfedb1321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:54:49.057379 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b115d-ba87-45f2-ba35-1b3dfedb1321 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:54:49.057660 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b115d-ba87-45f2-ba35-1b3dfedb1321 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:54:49.057963 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b115d-ba87-45f2-ba35-1b3dfedb1321 admin admin] PATH_INFO: `/v3/projects/21cfa1a00bbe49c09390e35d049d70c2` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:54:49.059225 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28b115d-ba87-45f2-ba35-1b3dfedb1321 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21cfa1a00bbe49c09390e35d049d70c2)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:54:49.061413 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28b115d-ba87-45f2-ba35-1b3dfedb1321 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:54:49.072455 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d9796e-9f61-46c3-9a66-5767acd1de3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:54:49.074038 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d9796e-9f61-46c3-9a66-5767acd1de3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:54:49.074342 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d9796e-9f61-46c3-9a66-5767acd1de3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:54:49.074728 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d9796e-9f61-46c3-9a66-5767acd1de3d admin admin] PATH_INFO: `/v3/users/6271a874398e4b0f87275d8c404d878b` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:54:49.076272 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d9796e-9f61-46c3-9a66-5767acd1de3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6271a874398e4b0f87275d8c404d878b)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:54:49.078207 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d9796e-9f61-46c3-9a66-5767acd1de3d admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:54:49.200267 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-b28b115d-ba87-45f2-ba35-1b3dfedb1321 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21cfa1a00bbe49c09390e35d049d70c2', 'request_id': 'req-b28b115d-ba87-45f2-ba35-1b3dfedb1321'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:54:49.211868 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-b28b115d-ba87-45f2-ba35-1b3dfedb1321 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21cfa1a00bbe49c09390e35d049d70c2', 'request_id': 'req-b28b115d-ba87-45f2-ba35-1b3dfedb1321'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:54:49.295883 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-b28b115d-ba87-45f2-ba35-1b3dfedb1321 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21cfa1a00bbe49c09390e35d049d70c2', 'request_id': 'req-b28b115d-ba87-45f2-ba35-1b3dfedb1321'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:54:49.309441 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-b28b115d-ba87-45f2-ba35-1b3dfedb1321 admin admin] The token cache is being invalidate because project 21cfa1a00bbe49c09390e35d049d70c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 14:54:49.309636 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-b28b115d-ba87-45f2-ba35-1b3dfedb1321 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:54:49.311137 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-b28b115d-ba87-45f2-ba35-1b3dfedb1321 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:54:49.313003 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1228/2466] 10.222.0.15 () {58 vars in 1232 bytes} [Tue May 31 14:54:48 2022] DELETE /identity/v3/projects/21cfa1a00bbe49c09390e35d049d70c2 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:54:49.313304 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-c4d9796e-9f61-46c3-9a66-5767acd1de3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6271a874398e4b0f87275d8c404d878b'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:54:49.317583 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e9b81c-403b-4f18-b61c-2e4faab211d9 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:54:49.317880 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e9b81c-403b-4f18-b61c-2e4faab211d9 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:54:49.318318 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e9b81c-403b-4f18-b61c-2e4faab211d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:54:49.338158 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-14e9b81c-403b-4f18-b61c-2e4faab211d9 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:54:49.339452 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-14e9b81c-403b-4f18-b61c-2e4faab211d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:54:49.375123 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:54:49.397686 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-c4d9796e-9f61-46c3-9a66-5767acd1de3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6271a874398e4b0f87275d8c404d878b'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:54:49.398906 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-c4d9796e-9f61-46c3-9a66-5767acd1de3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6271a874398e4b0f87275d8c404d878b'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:54:49.407554 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-c4d9796e-9f61-46c3-9a66-5767acd1de3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6271a874398e4b0f87275d8c404d878b'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:54:49.409026 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1229/2467] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:54:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:54:49.411726 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a9a627-fe98-48fc-bc50-4dce38ddc423 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:54:49.411726 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a9a627-fe98-48fc-bc50-4dce38ddc423 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:54:49.411726 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a9a627-fe98-48fc-bc50-4dce38ddc423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:54:49.413268 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-c4d9796e-9f61-46c3-9a66-5767acd1de3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6271a874398e4b0f87275d8c404d878b'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:54:49.431128 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-56a9a627-fe98-48fc-bc50-4dce38ddc423 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:54:49.432408 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-56a9a627-fe98-48fc-bc50-4dce38ddc423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:54:49.440776 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1239/2468] 10.222.0.15 () {58 vars in 1223 bytes} [Tue May 31 14:54:48 2022] DELETE /identity/v3/users/6271a874398e4b0f87275d8c404d878b => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:54:49.448614 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1230/2469] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:54:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:54:49.452801 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d9796e-9f61-46c3-9a66-5767acd1de3d admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:54:49.535165 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d9796e-9f61-46c3-9a66-5767acd1de3d admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:54:49.540737 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6866c81-46c2-47c0-876d-332cf92a1a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:54:49.541579 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6866c81-46c2-47c0-876d-332cf92a1a9e admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:54:49.541935 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6866c81-46c2-47c0-876d-332cf92a1a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:54:49.542275 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6866c81-46c2-47c0-876d-332cf92a1a9e admin admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:54:49.543156 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6866c81-46c2-47c0-876d-332cf92a1a9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:54:49.543568 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6866c81-46c2-47c0-876d-332cf92a1a9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:54:49.545268 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6866c81-46c2-47c0-876d-332cf92a1a9e admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:54:49.560829 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1240/2470] 10.222.0.15 () {58 vars in 1152 bytes} [Tue May 31 14:54:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:54:49.565477 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a9a627-fe98-48fc-bc50-4dce38ddc423 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:54:49.575392 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a9a627-fe98-48fc-bc50-4dce38ddc423 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:54:49.580807 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f66b7bf-f08b-4057-9a09-f879eb4e4ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:54:49.581588 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f66b7bf-f08b-4057-9a09-f879eb4e4ed4 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:54:49.582200 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f66b7bf-f08b-4057-9a09-f879eb4e4ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:54:49.582481 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f66b7bf-f08b-4057-9a09-f879eb4e4ed4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:54:49.583293 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f66b7bf-f08b-4057-9a09-f879eb4e4ed4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:54:49.585321 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f66b7bf-f08b-4057-9a09-f879eb4e4ed4 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:54:49.675413 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1231/2471] 10.222.0.15 () {60 vars in 1152 bytes} [Tue May 31 14:54:49 2022] POST /identity/v3/projects => generated 367 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:54:49.681690 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6866c81-46c2-47c0-876d-332cf92a1a9e admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:54:49.697624 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6866c81-46c2-47c0-876d-332cf92a1a9e admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:54:49.735015 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:54:49.784534 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4740f95-5e98-40e0-9441-dddb17e7163f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:54:49.784534 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4740f95-5e98-40e0-9441-dddb17e7163f admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:54:49.784534 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4740f95-5e98-40e0-9441-dddb17e7163f admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:54:49.784534 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4740f95-5e98-40e0-9441-dddb17e7163f admin admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:54:49.785196 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4740f95-5e98-40e0-9441-dddb17e7163f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:54:49.787007 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4740f95-5e98-40e0-9441-dddb17e7163f admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:54:49.824889 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f66b7bf-f08b-4057-9a09-f879eb4e4ed4 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:54:49.828265 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-0f66b7bf-f08b-4057-9a09-f879eb4e4ed4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:54:49.854803 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f66b7bf-f08b-4057-9a09-f879eb4e4ed4 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:54:49.860150 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d47878-702d-4479-b494-76e3b8ffae73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:54:49.861038 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d47878-702d-4479-b494-76e3b8ffae73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:54:49.861325 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d47878-702d-4479-b494-76e3b8ffae73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:54:49.861606 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d47878-702d-4479-b494-76e3b8ffae73 admin admin] PATH_INFO: `/v3/projects/499bdab4da3a4305b8b9e35f07a99c60` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:54:49.862902 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d47878-702d-4479-b494-76e3b8ffae73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=499bdab4da3a4305b8b9e35f07a99c60)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:54:49.864868 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d47878-702d-4479-b494-76e3b8ffae73 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:54:49.876340 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1241/2472] 10.222.0.15 () {60 vars in 1143 bytes} [Tue May 31 14:54:49 2022] POST /identity/v3/users => generated 284 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:54:49.880327 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4740f95-5e98-40e0-9441-dddb17e7163f admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:54:49.892659 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4740f95-5e98-40e0-9441-dddb17e7163f admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:54:49.898653 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd62efb-1fe3-4fc6-889c-c70387cb49be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:54:49.899403 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd62efb-1fe3-4fc6-889c-c70387cb49be admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:54:49.899764 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd62efb-1fe3-4fc6-889c-c70387cb49be admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:54:49.900105 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd62efb-1fe3-4fc6-889c-c70387cb49be admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:54:49.901057 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd62efb-1fe3-4fc6-889c-c70387cb49be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:54:49.902796 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd62efb-1fe3-4fc6-889c-c70387cb49be admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:54:49.916217 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1242/2473] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:54:49 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 14:54:49.920359 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd62efb-1fe3-4fc6-889c-c70387cb49be admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:54:49.935511 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd62efb-1fe3-4fc6-889c-c70387cb49be admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:54:49.941684 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0767c180-b8bb-4a0b-9c21-f2f76c6affee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:54:49.942348 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0767c180-b8bb-4a0b-9c21-f2f76c6affee admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:54:49.947025 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0767c180-b8bb-4a0b-9c21-f2f76c6affee admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:54:49.947025 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0767c180-b8bb-4a0b-9c21-f2f76c6affee admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:54:49.947025 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0767c180-b8bb-4a0b-9c21-f2f76c6affee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:54:49.947025 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0767c180-b8bb-4a0b-9c21-f2f76c6affee admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:54:49.956969 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1243/2474] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:54:49 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 14:54:49.960752 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0767c180-b8bb-4a0b-9c21-f2f76c6affee admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:54:49.971499 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0767c180-b8bb-4a0b-9c21-f2f76c6affee admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:54:49.976992 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3049b3-ca95-489c-88d0-5bc36bf404e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:54:49.977895 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3049b3-ca95-489c-88d0-5bc36bf404e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:54:49.978177 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3049b3-ca95-489c-88d0-5bc36bf404e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:54:49.978462 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3049b3-ca95-489c-88d0-5bc36bf404e8 admin admin] PATH_INFO: `/v3/projects/e15c53f978634ce48b233d3d07824d6f/users/14e4a5d382654857a0ee598ab7a079ef/roles/317f725e26bf43648d8235bb1f7c4cb3` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:54:50.001323 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3049b3-ca95-489c-88d0-5bc36bf404e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e15c53f978634ce48b233d3d07824d6f, user_id=14e4a5d382654857a0ee598ab7a079ef, role_id=317f725e26bf43648d8235bb1f7c4cb3)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:54:50.004462 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3049b3-ca95-489c-88d0-5bc36bf404e8 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:54:50.007072 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-b5d47878-702d-4479-b494-76e3b8ffae73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '499bdab4da3a4305b8b9e35f07a99c60', 'request_id': 'req-b5d47878-702d-4479-b494-76e3b8ffae73'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:54:50.016869 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-b5d47878-702d-4479-b494-76e3b8ffae73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '499bdab4da3a4305b8b9e35f07a99c60', 'request_id': 'req-b5d47878-702d-4479-b494-76e3b8ffae73'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:54:50.064627 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1244/2475] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:54:49 2022] PUT /identity/v3/projects/e15c53f978634ce48b233d3d07824d6f/users/14e4a5d382654857a0ee598ab7a079ef/roles/317f725e26bf43648d8235bb1f7c4cb3 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 14:54:50.072951 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-b5d47878-702d-4479-b494-76e3b8ffae73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '499bdab4da3a4305b8b9e35f07a99c60', 'request_id': 'req-b5d47878-702d-4479-b494-76e3b8ffae73'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:54:50.078359 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32514f1f-7c59-4abb-ba32-163aa4250fe1 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:54:50.078817 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32514f1f-7c59-4abb-ba32-163aa4250fe1 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:54:50.079224 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32514f1f-7c59-4abb-ba32-163aa4250fe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:54:50.085199 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-b5d47878-702d-4479-b494-76e3b8ffae73 admin admin] The token cache is being invalidate because project 499bdab4da3a4305b8b9e35f07a99c60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 14:54:50.085589 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-b5d47878-702d-4479-b494-76e3b8ffae73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:54:50.086276 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-b5d47878-702d-4479-b494-76e3b8ffae73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:54:50.087889 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1232/2476] 10.222.0.15 () {58 vars in 1232 bytes} [Tue May 31 14:54:49 2022] DELETE /identity/v3/projects/499bdab4da3a4305b8b9e35f07a99c60 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 14:54:50.091859 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d47878-702d-4479-b494-76e3b8ffae73 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:54:50.093314 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-b5d47878-702d-4479-b494-76e3b8ffae73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:54:50.108069 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-32514f1f-7c59-4abb-ba32-163aa4250fe1 None None] MFA Rules not processed for user `14e4a5d382654857a0ee598ab7a079ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:54:50.109263 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-32514f1f-7c59-4abb-ba32-163aa4250fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:54:50.167392 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d47878-702d-4479-b494-76e3b8ffae73 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:54:50.194745 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1245/2477] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:54:50 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 14:54:50.199046 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32514f1f-7c59-4abb-ba32-163aa4250fe1 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:54:50.200436 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-32514f1f-7c59-4abb-ba32-163aa4250fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:54:50.217614 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:54:50.236840 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39993785-ed1e-4450-888b-4fd9560c078b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:54:50.237751 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39993785-ed1e-4450-888b-4fd9560c078b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:54:50.238036 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39993785-ed1e-4450-888b-4fd9560c078b admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:54:50.238487 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39993785-ed1e-4450-888b-4fd9560c078b admin admin] PATH_INFO: `/v3/users/0dbb4dbccbb144bfa7edb4b53d46679d` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:54:50.239852 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39993785-ed1e-4450-888b-4fd9560c078b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0dbb4dbccbb144bfa7edb4b53d46679d)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:54:50.242531 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39993785-ed1e-4450-888b-4fd9560c078b admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:54:50.266834 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:54:50.272817 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32514f1f-7c59-4abb-ba32-163aa4250fe1 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:54:50.278378 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38d6b5e-7667-4d42-916e-50cd885cce27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:54:50.279185 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d6b5e-7667-4d42-916e-50cd885cce27 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:54:50.279467 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d6b5e-7667-4d42-916e-50cd885cce27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:54:50.279851 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d6b5e-7667-4d42-916e-50cd885cce27 admin admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:54:50.280792 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38d6b5e-7667-4d42-916e-50cd885cce27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:54:50.282770 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38d6b5e-7667-4d42-916e-50cd885cce27 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:54:50.366067 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1246/2478] 10.222.0.15 () {60 vars in 1152 bytes} [Tue May 31 14:54:50 2022] POST /identity/v3/projects => generated 369 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 14:54:50.370385 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38d6b5e-7667-4d42-916e-50cd885cce27 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:54:50.429832 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-39993785-ed1e-4450-888b-4fd9560c078b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0dbb4dbccbb144bfa7edb4b53d46679d'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:54:50.437134 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-39993785-ed1e-4450-888b-4fd9560c078b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0dbb4dbccbb144bfa7edb4b53d46679d'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:54:50.437811 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38d6b5e-7667-4d42-916e-50cd885cce27 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:54:50.437990 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-39993785-ed1e-4450-888b-4fd9560c078b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0dbb4dbccbb144bfa7edb4b53d46679d'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:54:50.438578 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-39993785-ed1e-4450-888b-4fd9560c078b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0dbb4dbccbb144bfa7edb4b53d46679d'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:54:50.442861 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4f68c1-9b6f-4ba0-90dc-67022b4afada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:54:50.449088 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4f68c1-9b6f-4ba0-90dc-67022b4afada admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:54:50.449088 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4f68c1-9b6f-4ba0-90dc-67022b4afada admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:54:50.449088 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4f68c1-9b6f-4ba0-90dc-67022b4afada admin admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:54:50.449088 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4f68c1-9b6f-4ba0-90dc-67022b4afada admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:54:50.449088 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4f68c1-9b6f-4ba0-90dc-67022b4afada admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:54:50.456585 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-39993785-ed1e-4450-888b-4fd9560c078b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0dbb4dbccbb144bfa7edb4b53d46679d'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:54:50.570306 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1233/2479] 10.222.0.15 () {58 vars in 1223 bytes} [Tue May 31 14:54:50 2022] DELETE /identity/v3/users/0dbb4dbccbb144bfa7edb4b53d46679d => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 14:54:50.574614 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1247/2480] 10.222.0.15 () {60 vars in 1143 bytes} [Tue May 31 14:54:50 2022] POST /identity/v3/users => generated 291 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 14:54:50.574725 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39993785-ed1e-4450-888b-4fd9560c078b admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:54:50.576234 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-39993785-ed1e-4450-888b-4fd9560c078b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:54:50.662277 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39993785-ed1e-4450-888b-4fd9560c078b admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:54:50.667556 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0702dc7a-a94b-4ce5-8e0f-57514387c6d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:54:50.668247 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0702dc7a-a94b-4ce5-8e0f-57514387c6d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:54:50.668538 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0702dc7a-a94b-4ce5-8e0f-57514387c6d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:54:50.668816 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0702dc7a-a94b-4ce5-8e0f-57514387c6d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:54:50.669553 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0702dc7a-a94b-4ce5-8e0f-57514387c6d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:54:50.671306 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0702dc7a-a94b-4ce5-8e0f-57514387c6d2 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:54:50.683621 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1234/2481] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:54:50 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 14:54:50.690594 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4f68c1-9b6f-4ba0-90dc-67022b4afada admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:54:50.702216 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4f68c1-9b6f-4ba0-90dc-67022b4afada admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:54:50.707031 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba69f8c5-d5d1-42d4-b795-2d2b3bebef35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:54:50.707933 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba69f8c5-d5d1-42d4-b795-2d2b3bebef35 admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:54:50.708215 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba69f8c5-d5d1-42d4-b795-2d2b3bebef35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:54:50.708494 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba69f8c5-d5d1-42d4-b795-2d2b3bebef35 admin admin] PATH_INFO: `/v3/projects/84ecae94f3054cdea36fe26b0278648d/users/c051ddda14384c6cbc9af557643d7ba3/roles/76c53e2c353644f885028a0226c06146` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:54:50.726282 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba69f8c5-d5d1-42d4-b795-2d2b3bebef35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84ecae94f3054cdea36fe26b0278648d, user_id=c051ddda14384c6cbc9af557643d7ba3, role_id=76c53e2c353644f885028a0226c06146)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:54:50.730806 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba69f8c5-d5d1-42d4-b795-2d2b3bebef35 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:54:50.840093 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1248/2482] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:54:50 2022] PUT /identity/v3/projects/84ecae94f3054cdea36fe26b0278648d/users/c051ddda14384c6cbc9af557643d7ba3/roles/76c53e2c353644f885028a0226c06146 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:54:50.844286 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0702dc7a-a94b-4ce5-8e0f-57514387c6d2 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:54:50.860758 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0702dc7a-a94b-4ce5-8e0f-57514387c6d2 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:54:50.888736 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba69f8c5-d5d1-42d4-b795-2d2b3bebef35 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:54:50.890852 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-ba69f8c5-d5d1-42d4-b795-2d2b3bebef35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:54:50.939954 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:54:50.948462 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb49c1a8-6b39-4e00-ab51-c1b50d94a56f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:54:50.949269 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb49c1a8-6b39-4e00-ab51-c1b50d94a56f admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:54:50.949630 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb49c1a8-6b39-4e00-ab51-c1b50d94a56f admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:54:50.950110 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb49c1a8-6b39-4e00-ab51-c1b50d94a56f admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:54:50.950966 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb49c1a8-6b39-4e00-ab51-c1b50d94a56f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:54:50.952782 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb49c1a8-6b39-4e00-ab51-c1b50d94a56f admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:54:50.963954 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1235/2483] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:54:50 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:54:50.968331 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb49c1a8-6b39-4e00-ab51-c1b50d94a56f admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:54:50.981185 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb49c1a8-6b39-4e00-ab51-c1b50d94a56f admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:54:50.986894 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba69f8c5-d5d1-42d4-b795-2d2b3bebef35 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:54:50.987932 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b04d12-d54d-416d-9444-c13cdb5c1d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:54:50.988837 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b04d12-d54d-416d-9444-c13cdb5c1d38 admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:54:50.989123 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b04d12-d54d-416d-9444-c13cdb5c1d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:54:50.989406 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b04d12-d54d-416d-9444-c13cdb5c1d38 admin admin] PATH_INFO: `/v3/projects/84ecae94f3054cdea36fe26b0278648d/users/c051ddda14384c6cbc9af557643d7ba3/roles/76c53e2c353644f885028a0226c06146` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:54:50.991577 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b04d12-d54d-416d-9444-c13cdb5c1d38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84ecae94f3054cdea36fe26b0278648d, user_id=c051ddda14384c6cbc9af557643d7ba3, role_id=76c53e2c353644f885028a0226c06146)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:54:50.992485 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32da99df-3196-4aa6-847c-eecf655f08aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:54:50.993360 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32da99df-3196-4aa6-847c-eecf655f08aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:54:50.993651 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32da99df-3196-4aa6-847c-eecf655f08aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:54:50.993941 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32da99df-3196-4aa6-847c-eecf655f08aa admin admin] PATH_INFO: `/v3/projects/4829c3389a1c4fe98ad1e18318f623d0` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:54:50.994824 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b04d12-d54d-416d-9444-c13cdb5c1d38 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:54:50.995286 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32da99df-3196-4aa6-847c-eecf655f08aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=4829c3389a1c4fe98ad1e18318f623d0)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:54:50.997236 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32da99df-3196-4aa6-847c-eecf655f08aa admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:54:51.011923 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1236/2484] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:54:50 2022] PUT /identity/v3/projects/84ecae94f3054cdea36fe26b0278648d/users/c051ddda14384c6cbc9af557643d7ba3/roles/76c53e2c353644f885028a0226c06146 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:54:51.023064 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5588a-fb77-4916-85af-ddc3f2ba100c None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:54:51.023500 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5588a-fb77-4916-85af-ddc3f2ba100c None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:54:51.024156 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5588a-fb77-4916-85af-ddc3f2ba100c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:54:51.060807 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-fdf5588a-fb77-4916-85af-ddc3f2ba100c None None] MFA Rules not processed for user `c051ddda14384c6cbc9af557643d7ba3`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:54:51.062297 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-fdf5588a-fb77-4916-85af-ddc3f2ba100c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:54:51.127305 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:54:51.128997 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-32da99df-3196-4aa6-847c-eecf655f08aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4829c3389a1c4fe98ad1e18318f623d0', 'request_id': 'req-32da99df-3196-4aa6-847c-eecf655f08aa'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:54:51.149656 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1237/2485] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:54:51 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 14:54:51.163724 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf5588a-fb77-4916-85af-ddc3f2ba100c None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:54:51.167622 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-fdf5588a-fb77-4916-85af-ddc3f2ba100c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:54:51.234961 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf5588a-fb77-4916-85af-ddc3f2ba100c None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:54:51.261417 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-32da99df-3196-4aa6-847c-eecf655f08aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4829c3389a1c4fe98ad1e18318f623d0', 'request_id': 'req-32da99df-3196-4aa6-847c-eecf655f08aa'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:54:51.273459 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-32da99df-3196-4aa6-847c-eecf655f08aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4829c3389a1c4fe98ad1e18318f623d0', 'request_id': 'req-32da99df-3196-4aa6-847c-eecf655f08aa'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:54:51.294771 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541fa139-dc4d-4f24-bcf1-5f0c099da052 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afbf718dcd9b4741a926b0a2321bd53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:54:51.295862 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541fa139-dc4d-4f24-bcf1-5f0c099da052 service cinder] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:54:51.296365 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541fa139-dc4d-4f24-bcf1-5f0c099da052 service cinder] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:54:51.296796 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541fa139-dc4d-4f24-bcf1-5f0c099da052 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:54:51.296933 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-32da99df-3196-4aa6-847c-eecf655f08aa admin admin] The token cache is being invalidate because project 4829c3389a1c4fe98ad1e18318f623d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80503) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 14:54:51.297234 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-32da99df-3196-4aa6-847c-eecf655f08aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:54:51.298008 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-32da99df-3196-4aa6-847c-eecf655f08aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:54:51.299501 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-541fa139-dc4d-4f24-bcf1-5f0c099da052 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:54:51.300192 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1249/2486] 10.222.0.15 () {58 vars in 1232 bytes} [Tue May 31 14:54:50 2022] DELETE /identity/v3/projects/4829c3389a1c4fe98ad1e18318f623d0 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:54:51.350389 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:54:51.392721 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541fa139-dc4d-4f24-bcf1-5f0c099da052 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:54:51.394335 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541fa139-dc4d-4f24-bcf1-5f0c099da052 service cinder] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:54:51.409109 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1238/2487] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:54:51 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 14:54:51.537979 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32da99df-3196-4aa6-847c-eecf655f08aa admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:54:51.540347 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-32da99df-3196-4aa6-847c-eecf655f08aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:54:51.555912 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32da99df-3196-4aa6-847c-eecf655f08aa admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:54:51.560663 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5edbf18-7ec5-4222-a029-f2aaf486fd65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afbf718dcd9b4741a926b0a2321bd53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:54:51.561946 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5edbf18-7ec5-4222-a029-f2aaf486fd65 service cinder] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:54:51.562438 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5edbf18-7ec5-4222-a029-f2aaf486fd65 service cinder] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:54:51.563074 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5edbf18-7ec5-4222-a029-f2aaf486fd65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:54:51.565622 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-e5edbf18-7ec5-4222-a029-f2aaf486fd65 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:54:51.630927 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5edbf18-7ec5-4222-a029-f2aaf486fd65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:54:51.632426 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5edbf18-7ec5-4222-a029-f2aaf486fd65 service cinder] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:54:51.642241 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1250/2488] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:54:51 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:54:52.698969 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541fa139-dc4d-4f24-bcf1-5f0c099da052 service cinder] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:54:52.700846 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-541fa139-dc4d-4f24-bcf1-5f0c099da052 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:54:52.821609 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541fa139-dc4d-4f24-bcf1-5f0c099da052 service cinder] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:54:52.828402 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d925ce-a8fb-4741-af40-15a1bbb4356a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57768d448e345ad8879bf29f21b48ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:54:52.837460 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d925ce-a8fb-4741-af40-15a1bbb4356a service nova] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:54:52.837460 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d925ce-a8fb-4741-af40-15a1bbb4356a service nova] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:54:52.837460 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d925ce-a8fb-4741-af40-15a1bbb4356a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:54:52.837460 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-d6d925ce-a8fb-4741-af40-15a1bbb4356a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:54:52.845698 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d925ce-a8fb-4741-af40-15a1bbb4356a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:54:52.847380 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d925ce-a8fb-4741-af40-15a1bbb4356a service nova] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:54:52.859720 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1239/2489] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:54:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 14:54:56.753835 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5edbf18-7ec5-4222-a029-f2aaf486fd65 service cinder] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:54:56.755384 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-e5edbf18-7ec5-4222-a029-f2aaf486fd65 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:54:56.824822 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5edbf18-7ec5-4222-a029-f2aaf486fd65 service cinder] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:54:56.829580 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff308511-6b39-4260-a9f0-286902c4aa33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:54:56.832281 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff308511-6b39-4260-a9f0-286902c4aa33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:54:56.832281 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff308511-6b39-4260-a9f0-286902c4aa33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:54:56.832281 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff308511-6b39-4260-a9f0-286902c4aa33 admin admin] PATH_INFO: `/v3/users/14e4a5d382654857a0ee598ab7a079ef` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:54:56.832610 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff308511-6b39-4260-a9f0-286902c4aa33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14e4a5d382654857a0ee598ab7a079ef)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:54:56.834320 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff308511-6b39-4260-a9f0-286902c4aa33 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:54:57.072134 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-ff308511-6b39-4260-a9f0-286902c4aa33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14e4a5d382654857a0ee598ab7a079ef'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:54:57.164968 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-ff308511-6b39-4260-a9f0-286902c4aa33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14e4a5d382654857a0ee598ab7a079ef'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:54:57.165929 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-ff308511-6b39-4260-a9f0-286902c4aa33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14e4a5d382654857a0ee598ab7a079ef'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:54:57.173772 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-ff308511-6b39-4260-a9f0-286902c4aa33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14e4a5d382654857a0ee598ab7a079ef'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:54:57.174480 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-ff308511-6b39-4260-a9f0-286902c4aa33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14e4a5d382654857a0ee598ab7a079ef'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:54:57.184778 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:54:57.192566 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1251/2490] 10.222.0.15 () {58 vars in 1223 bytes} [Tue May 31 14:54:56 2022] DELETE /identity/v3/users/14e4a5d382654857a0ee598ab7a079ef => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:54:57.197250 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a340d4-bc79-4e1c-be63-3eae5f17ce9f None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:54:57.197770 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a340d4-bc79-4e1c-be63-3eae5f17ce9f None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:54:57.197868 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a340d4-bc79-4e1c-be63-3eae5f17ce9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:54:57.215451 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-d4a340d4-bc79-4e1c-be63-3eae5f17ce9f None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:54:57.216707 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-d4a340d4-bc79-4e1c-be63-3eae5f17ce9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:54:57.285567 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1240/2491] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:54:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:54:57.296180 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff308511-6b39-4260-a9f0-286902c4aa33 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:54:57.297692 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-ff308511-6b39-4260-a9f0-286902c4aa33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:54:57.364133 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff308511-6b39-4260-a9f0-286902c4aa33 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:54:57.367769 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38373c2-5adc-4ca5-a683-56e50b3e8dc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:54:57.368454 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38373c2-5adc-4ca5-a683-56e50b3e8dc9 service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:54:57.368812 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38373c2-5adc-4ca5-a683-56e50b3e8dc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:54:57.369034 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38373c2-5adc-4ca5-a683-56e50b3e8dc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:54:57.378941 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38373c2-5adc-4ca5-a683-56e50b3e8dc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:54:57.380561 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38373c2-5adc-4ca5-a683-56e50b3e8dc9 service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:54:57.391248 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1252/2492] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:54:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:54:57.811214 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a340d4-bc79-4e1c-be63-3eae5f17ce9f None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:54:57.812730 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-d4a340d4-bc79-4e1c-be63-3eae5f17ce9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:54:57.825324 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a340d4-bc79-4e1c-be63-3eae5f17ce9f None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:54:57.830469 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bf7b19-eb7e-4265-83be-53ce20ff6e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:54:57.831381 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf7b19-eb7e-4265-83be-53ce20ff6e9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:54:57.831670 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf7b19-eb7e-4265-83be-53ce20ff6e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:54:57.832080 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf7b19-eb7e-4265-83be-53ce20ff6e9a admin admin] PATH_INFO: `/v3/projects/e15c53f978634ce48b233d3d07824d6f` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:54:57.833353 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bf7b19-eb7e-4265-83be-53ce20ff6e9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e15c53f978634ce48b233d3d07824d6f)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:54:57.835306 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bf7b19-eb7e-4265-83be-53ce20ff6e9a admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:54:57.947870 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-78bf7b19-eb7e-4265-83be-53ce20ff6e9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e15c53f978634ce48b233d3d07824d6f', 'request_id': 'req-78bf7b19-eb7e-4265-83be-53ce20ff6e9a'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:54:57.949622 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:54:57.954156 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-78bf7b19-eb7e-4265-83be-53ce20ff6e9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e15c53f978634ce48b233d3d07824d6f', 'request_id': 'req-78bf7b19-eb7e-4265-83be-53ce20ff6e9a'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:54:58.044536 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-78bf7b19-eb7e-4265-83be-53ce20ff6e9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e15c53f978634ce48b233d3d07824d6f', 'request_id': 'req-78bf7b19-eb7e-4265-83be-53ce20ff6e9a'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:54:58.056661 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-78bf7b19-eb7e-4265-83be-53ce20ff6e9a admin admin] The token cache is being invalidate because project e15c53f978634ce48b233d3d07824d6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 14:54:58.056952 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-78bf7b19-eb7e-4265-83be-53ce20ff6e9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:54:58.057869 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-78bf7b19-eb7e-4265-83be-53ce20ff6e9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:54:58.059295 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1241/2493] 10.222.0.15 () {58 vars in 1232 bytes} [Tue May 31 14:54:57 2022] DELETE /identity/v3/projects/e15c53f978634ce48b233d3d07824d6f => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:54:58.063617 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38373c2-5adc-4ca5-a683-56e50b3e8dc9 service neutron] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:54:58.075478 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38373c2-5adc-4ca5-a683-56e50b3e8dc9 service neutron] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:54:58.146974 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e54e90-b05a-48ca-9695-e1240b281033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:54:58.154037 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e54e90-b05a-48ca-9695-e1240b281033 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:54:58.154513 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e54e90-b05a-48ca-9695-e1240b281033 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:54:58.154995 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e54e90-b05a-48ca-9695-e1240b281033 admin admin] PATH_INFO: `/v3/users/c051ddda14384c6cbc9af557643d7ba3` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:54:58.156387 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e54e90-b05a-48ca-9695-e1240b281033 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c051ddda14384c6cbc9af557643d7ba3)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:54:58.159062 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e54e90-b05a-48ca-9695-e1240b281033 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:54:58.322193 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-b1e54e90-b05a-48ca-9695-e1240b281033 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c051ddda14384c6cbc9af557643d7ba3'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:54:58.375510 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-b1e54e90-b05a-48ca-9695-e1240b281033 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c051ddda14384c6cbc9af557643d7ba3'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:54:58.376179 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-b1e54e90-b05a-48ca-9695-e1240b281033 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c051ddda14384c6cbc9af557643d7ba3'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:54:58.384184 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-b1e54e90-b05a-48ca-9695-e1240b281033 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c051ddda14384c6cbc9af557643d7ba3'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:54:58.384902 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-b1e54e90-b05a-48ca-9695-e1240b281033 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c051ddda14384c6cbc9af557643d7ba3'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:54:58.403145 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1253/2494] 10.222.0.15 () {58 vars in 1223 bytes} [Tue May 31 14:54:58 2022] DELETE /identity/v3/users/c051ddda14384c6cbc9af557643d7ba3 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:54:58.857729 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bf7b19-eb7e-4265-83be-53ce20ff6e9a admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:54:58.859228 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-78bf7b19-eb7e-4265-83be-53ce20ff6e9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:54:58.873506 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bf7b19-eb7e-4265-83be-53ce20ff6e9a admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:54:58.939401 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fb357d-efcf-4548-90be-513f69e87674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:54:58.940281 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb357d-efcf-4548-90be-513f69e87674 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:54:58.940564 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb357d-efcf-4548-90be-513f69e87674 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:54:58.940846 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb357d-efcf-4548-90be-513f69e87674 admin admin] PATH_INFO: `/v3/projects/84ecae94f3054cdea36fe26b0278648d` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:54:58.942054 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fb357d-efcf-4548-90be-513f69e87674 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84ecae94f3054cdea36fe26b0278648d)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:54:58.944014 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fb357d-efcf-4548-90be-513f69e87674 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:54:59.081266 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-47fb357d-efcf-4548-90be-513f69e87674 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84ecae94f3054cdea36fe26b0278648d', 'request_id': 'req-47fb357d-efcf-4548-90be-513f69e87674'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:54:59.088864 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-47fb357d-efcf-4548-90be-513f69e87674 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84ecae94f3054cdea36fe26b0278648d', 'request_id': 'req-47fb357d-efcf-4548-90be-513f69e87674'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:54:59.141398 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-47fb357d-efcf-4548-90be-513f69e87674 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84ecae94f3054cdea36fe26b0278648d', 'request_id': 'req-47fb357d-efcf-4548-90be-513f69e87674'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:54:59.153930 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-47fb357d-efcf-4548-90be-513f69e87674 admin admin] The token cache is being invalidate because project 84ecae94f3054cdea36fe26b0278648d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 14:54:59.154331 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-47fb357d-efcf-4548-90be-513f69e87674 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:54:59.155190 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-47fb357d-efcf-4548-90be-513f69e87674 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:54:59.156921 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1242/2495] 10.222.0.15 () {58 vars in 1232 bytes} [Tue May 31 14:54:58 2022] DELETE /identity/v3/projects/84ecae94f3054cdea36fe26b0278648d => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:54:59.161971 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8f497f-1b1d-4138-8d3d-d14b73777de0 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:54:59.162578 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8f497f-1b1d-4138-8d3d-d14b73777de0 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:54:59.162578 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8f497f-1b1d-4138-8d3d-d14b73777de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:54:59.181933 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-7d8f497f-1b1d-4138-8d3d-d14b73777de0 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:54:59.183164 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-7d8f497f-1b1d-4138-8d3d-d14b73777de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:54:59.194743 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:54:59.245370 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1254/2496] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:54:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:54:59.253469 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa41ff0-d18a-494a-bcd2-44c476099e09 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:54:59.253756 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa41ff0-d18a-494a-bcd2-44c476099e09 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:54:59.254045 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa41ff0-d18a-494a-bcd2-44c476099e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:54:59.274785 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-0fa41ff0-d18a-494a-bcd2-44c476099e09 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:54:59.280813 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-0fa41ff0-d18a-494a-bcd2-44c476099e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:54:59.287552 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1243/2497] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:54:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:54:59.293783 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8f497f-1b1d-4138-8d3d-d14b73777de0 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:54:59.303978 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8f497f-1b1d-4138-8d3d-d14b73777de0 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:54:59.309301 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9047b12a-bfe7-4a94-8d71-2825a0ac2c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:54:59.309971 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047b12a-bfe7-4a94-8d71-2825a0ac2c8f admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:54:59.315121 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047b12a-bfe7-4a94-8d71-2825a0ac2c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:54:59.315121 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047b12a-bfe7-4a94-8d71-2825a0ac2c8f admin admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:54:59.315121 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9047b12a-bfe7-4a94-8d71-2825a0ac2c8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:54:59.315121 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9047b12a-bfe7-4a94-8d71-2825a0ac2c8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:54:59.315121 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9047b12a-bfe7-4a94-8d71-2825a0ac2c8f admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:54:59.329202 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1255/2498] 10.222.0.15 () {58 vars in 1152 bytes} [Tue May 31 14:54:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:54:59.334378 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa41ff0-d18a-494a-bcd2-44c476099e09 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:54:59.345381 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa41ff0-d18a-494a-bcd2-44c476099e09 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:54:59.350862 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bb7c9f-9c46-4e6e-80f7-c94ad8064e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:54:59.351310 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb7c9f-9c46-4e6e-80f7-c94ad8064e01 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:54:59.351597 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb7c9f-9c46-4e6e-80f7-c94ad8064e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:54:59.351877 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb7c9f-9c46-4e6e-80f7-c94ad8064e01 admin admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:54:59.352577 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bb7c9f-9c46-4e6e-80f7-c94ad8064e01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:54:59.354502 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bb7c9f-9c46-4e6e-80f7-c94ad8064e01 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:54:59.441501 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1244/2499] 10.222.0.15 () {60 vars in 1152 bytes} [Tue May 31 14:54:59 2022] POST /identity/v3/projects => generated 391 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:54:59.445138 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9047b12a-bfe7-4a94-8d71-2825a0ac2c8f admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:54:59.455518 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9047b12a-bfe7-4a94-8d71-2825a0ac2c8f admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:54:59.508948 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bb7c9f-9c46-4e6e-80f7-c94ad8064e01 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:54:59.510817 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-76bb7c9f-9c46-4e6e-80f7-c94ad8064e01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:54:59.520025 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb914511-d179-4399-ac6f-28191538dc78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:54:59.520696 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb914511-d179-4399-ac6f-28191538dc78 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:54:59.520980 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb914511-d179-4399-ac6f-28191538dc78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:54:59.521257 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb914511-d179-4399-ac6f-28191538dc78 admin admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:54:59.521965 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb914511-d179-4399-ac6f-28191538dc78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:54:59.523952 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb914511-d179-4399-ac6f-28191538dc78 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:54:59.559816 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:54:59.572648 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bb7c9f-9c46-4e6e-80f7-c94ad8064e01 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:54:59.576537 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b36f203-fd9f-4c7f-96b6-641bbb13c7af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:54:59.577192 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b36f203-fd9f-4c7f-96b6-641bbb13c7af service neutron] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:54:59.577479 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b36f203-fd9f-4c7f-96b6-641bbb13c7af service neutron] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:54:59.577760 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b36f203-fd9f-4c7f-96b6-641bbb13c7af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:54:59.579656 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-6b36f203-fd9f-4c7f-96b6-641bbb13c7af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:54:59.591947 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b36f203-fd9f-4c7f-96b6-641bbb13c7af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:54:59.593401 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b36f203-fd9f-4c7f-96b6-641bbb13c7af service neutron] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:54:59.613160 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1245/2500] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:54:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 14:54:59.628026 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1256/2501] 10.222.0.15 () {60 vars in 1143 bytes} [Tue May 31 14:54:59 2022] POST /identity/v3/users => generated 296 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:54:59.632249 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b36f203-fd9f-4c7f-96b6-641bbb13c7af service neutron] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:54:59.642227 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b36f203-fd9f-4c7f-96b6-641bbb13c7af service neutron] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:54:59.648865 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b262a282-d9b3-401f-831b-61e8cc959567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:54:59.649537 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b262a282-d9b3-401f-831b-61e8cc959567 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:54:59.649820 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b262a282-d9b3-401f-831b-61e8cc959567 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:54:59.650096 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b262a282-d9b3-401f-831b-61e8cc959567 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:54:59.650857 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b262a282-d9b3-401f-831b-61e8cc959567 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:54:59.652474 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b262a282-d9b3-401f-831b-61e8cc959567 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:54:59.665395 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1246/2502] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:54:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:54:59.670513 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb914511-d179-4399-ac6f-28191538dc78 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:54:59.678110 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb914511-d179-4399-ac6f-28191538dc78 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:54:59.683522 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4ced2a-d077-4b2f-9133-86fc7892ec27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:54:59.684195 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4ced2a-d077-4b2f-9133-86fc7892ec27 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:54:59.684476 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4ced2a-d077-4b2f-9133-86fc7892ec27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:54:59.684752 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4ced2a-d077-4b2f-9133-86fc7892ec27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:54:59.685724 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4ced2a-d077-4b2f-9133-86fc7892ec27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:54:59.687356 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4ced2a-d077-4b2f-9133-86fc7892ec27 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:54:59.698927 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1257/2503] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:54:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:54:59.703151 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b262a282-d9b3-401f-831b-61e8cc959567 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:54:59.713706 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b262a282-d9b3-401f-831b-61e8cc959567 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:54:59.719306 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b698ad5e-a37a-43c8-8223-b8ae2b970fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:54:59.723637 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b698ad5e-a37a-43c8-8223-b8ae2b970fa2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:54:59.723995 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b698ad5e-a37a-43c8-8223-b8ae2b970fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:54:59.724359 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b698ad5e-a37a-43c8-8223-b8ae2b970fa2 admin admin] PATH_INFO: `/v3/projects/1097dd4f8cad4033aeb5d8b37f572867/users/e1d386cf72454d0090286d924ae5ce89/roles/317f725e26bf43648d8235bb1f7c4cb3` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:54:59.741118 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b698ad5e-a37a-43c8-8223-b8ae2b970fa2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1097dd4f8cad4033aeb5d8b37f572867, user_id=e1d386cf72454d0090286d924ae5ce89, role_id=317f725e26bf43648d8235bb1f7c4cb3)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:54:59.744592 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b698ad5e-a37a-43c8-8223-b8ae2b970fa2 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:54:59.833661 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1247/2504] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:54:59 2022] PUT /identity/v3/projects/1097dd4f8cad4033aeb5d8b37f572867/users/e1d386cf72454d0090286d924ae5ce89/roles/317f725e26bf43648d8235bb1f7c4cb3 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:54:59.845110 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d32992-0852-462b-bb09-c1beff8ab956 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:54:59.845487 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d32992-0852-462b-bb09-c1beff8ab956 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:54:59.845841 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d32992-0852-462b-bb09-c1beff8ab956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:54:59.877835 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-a0d32992-0852-462b-bb09-c1beff8ab956 None None] MFA Rules not processed for user `e1d386cf72454d0090286d924ae5ce89`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:54:59.879104 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-a0d32992-0852-462b-bb09-c1beff8ab956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:54:59.952269 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1258/2505] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:54:59 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:54:59.957377 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b698ad5e-a37a-43c8-8223-b8ae2b970fa2 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:00.026531 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b698ad5e-a37a-43c8-8223-b8ae2b970fa2 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:00.031500 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1149a62-33cb-4853-bd58-6b8f4cc504c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:00.032185 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1149a62-33cb-4853-bd58-6b8f4cc504c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:00.032472 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1149a62-33cb-4853-bd58-6b8f4cc504c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:00.032752 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1149a62-33cb-4853-bd58-6b8f4cc504c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:00.033467 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1149a62-33cb-4853-bd58-6b8f4cc504c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:00.035458 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1149a62-33cb-4853-bd58-6b8f4cc504c7 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:00.132054 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1248/2506] 10.222.0.15 () {60 vars in 1152 bytes} [Tue May 31 14:54:59 2022] POST /identity/v3/projects => generated 393 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:55:00.136993 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d32992-0852-462b-bb09-c1beff8ab956 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:00.154879 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d32992-0852-462b-bb09-c1beff8ab956 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:00.169869 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:55:00.227849 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1f8b60-61e5-4e78-9a4b-5eaac0b15e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:00.228650 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1f8b60-61e5-4e78-9a4b-5eaac0b15e58 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:00.228936 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1f8b60-61e5-4e78-9a4b-5eaac0b15e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:00.229218 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1f8b60-61e5-4e78-9a4b-5eaac0b15e58 admin admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:00.229921 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1f8b60-61e5-4e78-9a4b-5eaac0b15e58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:00.231911 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1f8b60-61e5-4e78-9a4b-5eaac0b15e58 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:00.331946 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1259/2507] 10.222.0.15 () {60 vars in 1143 bytes} [Tue May 31 14:55:00 2022] POST /identity/v3/users => generated 303 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 14:55:00.336766 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1149a62-33cb-4853-bd58-6b8f4cc504c7 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:00.347335 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1149a62-33cb-4853-bd58-6b8f4cc504c7 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:00.354172 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4218dfb6-51e1-4533-a4fe-e6fcda593129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:00.355000 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4218dfb6-51e1-4533-a4fe-e6fcda593129 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:00.355275 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4218dfb6-51e1-4533-a4fe-e6fcda593129 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:00.360354 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4218dfb6-51e1-4533-a4fe-e6fcda593129 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:00.360354 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4218dfb6-51e1-4533-a4fe-e6fcda593129 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:00.360354 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4218dfb6-51e1-4533-a4fe-e6fcda593129 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:00.371066 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1249/2508] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:55:00 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:55:00.374570 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1f8b60-61e5-4e78-9a4b-5eaac0b15e58 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:00.386265 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1f8b60-61e5-4e78-9a4b-5eaac0b15e58 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:00.390962 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a33ac3-4781-4a9a-bbf0-9d788c64edcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:00.391909 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a33ac3-4781-4a9a-bbf0-9d788c64edcf admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:00.392189 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a33ac3-4781-4a9a-bbf0-9d788c64edcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:00.392473 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a33ac3-4781-4a9a-bbf0-9d788c64edcf admin admin] PATH_INFO: `/v3/projects/6fd590e6f0154ea6b0b1a810adbe9168/users/cf3d9352a94a483c9178479222afb73d/roles/76c53e2c353644f885028a0226c06146` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:00.409078 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a33ac3-4781-4a9a-bbf0-9d788c64edcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fd590e6f0154ea6b0b1a810adbe9168, user_id=cf3d9352a94a483c9178479222afb73d, role_id=76c53e2c353644f885028a0226c06146)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:00.411890 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a33ac3-4781-4a9a-bbf0-9d788c64edcf admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:00.480778 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1260/2509] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:55:00 2022] PUT /identity/v3/projects/6fd590e6f0154ea6b0b1a810adbe9168/users/cf3d9352a94a483c9178479222afb73d/roles/76c53e2c353644f885028a0226c06146 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:55:00.484565 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4218dfb6-51e1-4533-a4fe-e6fcda593129 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:00.495406 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4218dfb6-51e1-4533-a4fe-e6fcda593129 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:00.560121 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0794d483-3bc0-48d4-9063-898340a234df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:00.561074 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0794d483-3bc0-48d4-9063-898340a234df admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:00.561363 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0794d483-3bc0-48d4-9063-898340a234df admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:00.561639 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0794d483-3bc0-48d4-9063-898340a234df admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:00.562422 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0794d483-3bc0-48d4-9063-898340a234df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:00.564067 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0794d483-3bc0-48d4-9063-898340a234df admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:00.576514 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1250/2510] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:55:00 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:55:00.581634 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a33ac3-4781-4a9a-bbf0-9d788c64edcf admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:00.594821 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a33ac3-4781-4a9a-bbf0-9d788c64edcf admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:00.599641 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20643296-d0b7-49ab-ac11-81217721301b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:00.600537 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20643296-d0b7-49ab-ac11-81217721301b admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:00.600862 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20643296-d0b7-49ab-ac11-81217721301b admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:00.601093 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20643296-d0b7-49ab-ac11-81217721301b admin admin] PATH_INFO: `/v3/projects/6fd590e6f0154ea6b0b1a810adbe9168/users/cf3d9352a94a483c9178479222afb73d/roles/76c53e2c353644f885028a0226c06146` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:00.603173 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20643296-d0b7-49ab-ac11-81217721301b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fd590e6f0154ea6b0b1a810adbe9168, user_id=cf3d9352a94a483c9178479222afb73d, role_id=76c53e2c353644f885028a0226c06146)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:00.605829 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20643296-d0b7-49ab-ac11-81217721301b admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:00.616973 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1261/2511] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:55:00 2022] PUT /identity/v3/projects/6fd590e6f0154ea6b0b1a810adbe9168/users/cf3d9352a94a483c9178479222afb73d/roles/76c53e2c353644f885028a0226c06146 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:55:00.627554 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ff6522-0479-4127-92b0-f746bfac4051 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:00.628132 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ff6522-0479-4127-92b0-f746bfac4051 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:00.628487 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ff6522-0479-4127-92b0-f746bfac4051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:00.657391 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-27ff6522-0479-4127-92b0-f746bfac4051 None None] MFA Rules not processed for user `cf3d9352a94a483c9178479222afb73d`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:55:00.658811 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-27ff6522-0479-4127-92b0-f746bfac4051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:55:00.668429 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:55:00.736823 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1251/2512] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:55:00 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:55:00.748946 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20643296-d0b7-49ab-ac11-81217721301b admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:00.750710 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-20643296-d0b7-49ab-ac11-81217721301b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:55:00.813459 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20643296-d0b7-49ab-ac11-81217721301b admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:00.817161 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a73c98a-9220-42a1-a2cb-d7a7f67d7fbb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afbf718dcd9b4741a926b0a2321bd53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:00.817800 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a73c98a-9220-42a1-a2cb-d7a7f67d7fbb service cinder] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:00.818087 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a73c98a-9220-42a1-a2cb-d7a7f67d7fbb service cinder] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:00.818358 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a73c98a-9220-42a1-a2cb-d7a7f67d7fbb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:00.829507 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a73c98a-9220-42a1-a2cb-d7a7f67d7fbb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:00.831027 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a73c98a-9220-42a1-a2cb-d7a7f67d7fbb service cinder] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:00.842545 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1262/2513] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:55:00 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:55:00.897950 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ff6522-0479-4127-92b0-f746bfac4051 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:00.899746 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-27ff6522-0479-4127-92b0-f746bfac4051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:55:00.914020 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ff6522-0479-4127-92b0-f746bfac4051 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:00.918771 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c6ae55-9143-435d-839c-e2e95d522afa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afbf718dcd9b4741a926b0a2321bd53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:00.919451 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c6ae55-9143-435d-839c-e2e95d522afa service cinder] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:00.919751 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c6ae55-9143-435d-839c-e2e95d522afa service cinder] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:00.920022 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c6ae55-9143-435d-839c-e2e95d522afa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:01.002931 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c6ae55-9143-435d-839c-e2e95d522afa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:01.004431 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c6ae55-9143-435d-839c-e2e95d522afa service cinder] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:01.015645 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1252/2514] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:55:00 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:55:03.519595 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b52ae-2a74-46a4-aded-f2354ba192ed None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:03.521420 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b52ae-2a74-46a4-aded-f2354ba192ed None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:03.521861 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b52ae-2a74-46a4-aded-f2354ba192ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:03.564284 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-f95b52ae-2a74-46a4-aded-f2354ba192ed None None] MFA Rules not processed for user `735d2518c8404bd991acee533b314039`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:55:03.566674 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-f95b52ae-2a74-46a4-aded-f2354ba192ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:55:03.707315 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1263/2515] 10.222.0.15 () {58 vars in 1009 bytes} [Tue May 31 14:55:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:55:03.744882 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c6ae55-9143-435d-839c-e2e95d522afa service cinder] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:03.747247 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-97c6ae55-9143-435d-839c-e2e95d522afa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:55:03.775046 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95b52ae-2a74-46a4-aded-f2354ba192ed None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:03.779888 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-f95b52ae-2a74-46a4-aded-f2354ba192ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:55:03.810304 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:55:03.873977 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c6ae55-9143-435d-839c-e2e95d522afa service cinder] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:03.887155 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7762a6-6503-46f8-a537-146979bd66c5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e158f461c66e4d779f23fb7760672897', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:03.887155 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7762a6-6503-46f8-a537-146979bd66c5 service swift] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:03.887155 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7762a6-6503-46f8-a537-146979bd66c5 service swift] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:03.887155 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7762a6-6503-46f8-a537-146979bd66c5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:03.903771 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7762a6-6503-46f8-a537-146979bd66c5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:03.912194 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7762a6-6503-46f8-a537-146979bd66c5 service swift] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:03.931152 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95b52ae-2a74-46a4-aded-f2354ba192ed None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:03.931757 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1253/2516] 10.222.0.15 () {60 vars in 1384 bytes} [Tue May 31 14:55:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 31 14:55:03.933390 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7762a6-6503-46f8-a537-146979bd66c5 service swift] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:03.936762 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-3d7762a6-6503-46f8-a537-146979bd66c5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:55:03.943661 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89cfe67-f54f-4b7e-bdb4-6c8f09b2ca96 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc959ca520c4816b5ff7f95655e53e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:03.944651 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89cfe67-f54f-4b7e-bdb4-6c8f09b2ca96 service placement] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:03.944941 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89cfe67-f54f-4b7e-bdb4-6c8f09b2ca96 service placement] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:03.946133 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89cfe67-f54f-4b7e-bdb4-6c8f09b2ca96 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:03.952755 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-a89cfe67-f54f-4b7e-bdb4-6c8f09b2ca96 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:55:03.971802 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89cfe67-f54f-4b7e-bdb4-6c8f09b2ca96 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:03.974822 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89cfe67-f54f-4b7e-bdb4-6c8f09b2ca96 service placement] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:03.984608 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:55:03.995194 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1264/2517] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:55:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:55:04.042103 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7762a6-6503-46f8-a537-146979bd66c5 service swift] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:04.047861 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5169f2dd-0fe7-4a6f-8f90-727c8c36aab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:04.048816 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5169f2dd-0fe7-4a6f-8f90-727c8c36aab9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:04.049119 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5169f2dd-0fe7-4a6f-8f90-727c8c36aab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:04.049377 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5169f2dd-0fe7-4a6f-8f90-727c8c36aab9 admin admin] PATH_INFO: `/v3/users/ec0bc78fb2d849cb89fec3420844d738` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:04.050813 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5169f2dd-0fe7-4a6f-8f90-727c8c36aab9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec0bc78fb2d849cb89fec3420844d738)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:04.052777 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5169f2dd-0fe7-4a6f-8f90-727c8c36aab9 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:04.251567 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-5169f2dd-0fe7-4a6f-8f90-727c8c36aab9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec0bc78fb2d849cb89fec3420844d738'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:04.262014 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-5169f2dd-0fe7-4a6f-8f90-727c8c36aab9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec0bc78fb2d849cb89fec3420844d738'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:04.262723 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-5169f2dd-0fe7-4a6f-8f90-727c8c36aab9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec0bc78fb2d849cb89fec3420844d738'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:04.263539 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-5169f2dd-0fe7-4a6f-8f90-727c8c36aab9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec0bc78fb2d849cb89fec3420844d738'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:04.290030 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-5169f2dd-0fe7-4a6f-8f90-727c8c36aab9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec0bc78fb2d849cb89fec3420844d738'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:04.399193 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1254/2518] 10.222.0.15 () {58 vars in 1223 bytes} [Tue May 31 14:55:03 2022] DELETE /identity/v3/users/ec0bc78fb2d849cb89fec3420844d738 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:55:04.801131 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89cfe67-f54f-4b7e-bdb4-6c8f09b2ca96 service placement] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:04.819091 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89cfe67-f54f-4b7e-bdb4-6c8f09b2ca96 service placement] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:04.914917 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719dbe3d-a66c-4b99-9ad1-8bf3f7946851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:04.915937 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719dbe3d-a66c-4b99-9ad1-8bf3f7946851 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:04.916373 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719dbe3d-a66c-4b99-9ad1-8bf3f7946851 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:04.916663 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719dbe3d-a66c-4b99-9ad1-8bf3f7946851 admin admin] PATH_INFO: `/v3/projects/0efdb0dd783e4076a13f49c4700bcebf` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:04.917964 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719dbe3d-a66c-4b99-9ad1-8bf3f7946851 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0efdb0dd783e4076a13f49c4700bcebf)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:04.920170 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719dbe3d-a66c-4b99-9ad1-8bf3f7946851 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:05.068214 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-719dbe3d-a66c-4b99-9ad1-8bf3f7946851 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0efdb0dd783e4076a13f49c4700bcebf', 'request_id': 'req-719dbe3d-a66c-4b99-9ad1-8bf3f7946851'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:05.147514 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-719dbe3d-a66c-4b99-9ad1-8bf3f7946851 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0efdb0dd783e4076a13f49c4700bcebf', 'request_id': 'req-719dbe3d-a66c-4b99-9ad1-8bf3f7946851'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:05.157070 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-719dbe3d-a66c-4b99-9ad1-8bf3f7946851 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0efdb0dd783e4076a13f49c4700bcebf', 'request_id': 'req-719dbe3d-a66c-4b99-9ad1-8bf3f7946851'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:05.170849 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-719dbe3d-a66c-4b99-9ad1-8bf3f7946851 admin admin] The token cache is being invalidate because project 0efdb0dd783e4076a13f49c4700bcebf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80503) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 14:55:05.171226 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-719dbe3d-a66c-4b99-9ad1-8bf3f7946851 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:05.171912 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-719dbe3d-a66c-4b99-9ad1-8bf3f7946851 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:05.178449 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1265/2519] 10.222.0.15 () {58 vars in 1232 bytes} [Tue May 31 14:55:04 2022] DELETE /identity/v3/projects/0efdb0dd783e4076a13f49c4700bcebf => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:55:05.181282 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e400870-25af-41d8-9ec4-64dc1b0d8f0a None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:05.181904 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e400870-25af-41d8-9ec4-64dc1b0d8f0a None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:05.182250 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e400870-25af-41d8-9ec4-64dc1b0d8f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:05.212554 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-3e400870-25af-41d8-9ec4-64dc1b0d8f0a None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:55:05.214209 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-3e400870-25af-41d8-9ec4-64dc1b0d8f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:55:05.317715 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1255/2520] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:55:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:55:05.317895 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99cdab8-2df7-4694-a606-84d321fed7ca None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:05.317895 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99cdab8-2df7-4694-a606-84d321fed7ca None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:05.317895 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99cdab8-2df7-4694-a606-84d321fed7ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:05.346361 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-c99cdab8-2df7-4694-a606-84d321fed7ca None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:55:05.346361 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-c99cdab8-2df7-4694-a606-84d321fed7ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:55:05.357320 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1266/2521] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:55:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:55:05.363437 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e400870-25af-41d8-9ec4-64dc1b0d8f0a None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:05.376530 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e400870-25af-41d8-9ec4-64dc1b0d8f0a None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:05.387497 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf92d3ca-7c89-45ed-b547-2c9ea8b19aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:05.388536 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf92d3ca-7c89-45ed-b547-2c9ea8b19aae admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:05.388825 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf92d3ca-7c89-45ed-b547-2c9ea8b19aae admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:05.389101 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf92d3ca-7c89-45ed-b547-2c9ea8b19aae admin admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:05.389984 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf92d3ca-7c89-45ed-b547-2c9ea8b19aae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:55:05.390341 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf92d3ca-7c89-45ed-b547-2c9ea8b19aae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:05.392098 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf92d3ca-7c89-45ed-b547-2c9ea8b19aae admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:05.410893 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1256/2522] 10.222.0.15 () {58 vars in 1152 bytes} [Tue May 31 14:55:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:55:05.413235 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99cdab8-2df7-4694-a606-84d321fed7ca None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:05.425156 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99cdab8-2df7-4694-a606-84d321fed7ca None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:05.432124 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6ff50d-df84-4f65-a8c2-755462d99abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:05.432970 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ff50d-df84-4f65-a8c2-755462d99abc admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:05.433249 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ff50d-df84-4f65-a8c2-755462d99abc admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:05.433519 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ff50d-df84-4f65-a8c2-755462d99abc admin admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:05.434205 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6ff50d-df84-4f65-a8c2-755462d99abc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:05.437818 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6ff50d-df84-4f65-a8c2-755462d99abc admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:05.498431 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf92d3ca-7c89-45ed-b547-2c9ea8b19aae admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:05.500318 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-bf92d3ca-7c89-45ed-b547-2c9ea8b19aae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:55:05.521957 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1267/2523] 10.222.0.15 () {60 vars in 1152 bytes} [Tue May 31 14:55:05 2022] POST /identity/v3/projects => generated 409 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 14:55:05.527223 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6ff50d-df84-4f65-a8c2-755462d99abc admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:05.540250 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:55:05.579508 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:55:05.641971 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf92d3ca-7c89-45ed-b547-2c9ea8b19aae admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:05.684649 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6ff50d-df84-4f65-a8c2-755462d99abc admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:05.695529 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dab3b1-2e91-4c41-8e94-3f4cfd8a1dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:05.696431 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dab3b1-2e91-4c41-8e94-3f4cfd8a1dfb admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:05.697750 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dab3b1-2e91-4c41-8e94-3f4cfd8a1dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:05.698177 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dab3b1-2e91-4c41-8e94-3f4cfd8a1dfb admin admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:05.698912 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dab3b1-2e91-4c41-8e94-3f4cfd8a1dfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:05.700849 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dab3b1-2e91-4c41-8e94-3f4cfd8a1dfb admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:05.740764 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3df9f4-0df1-4f64-9934-613df19bb4e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57768d448e345ad8879bf29f21b48ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:05.741436 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3df9f4-0df1-4f64-9934-613df19bb4e0 service nova] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:05.741720 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3df9f4-0df1-4f64-9934-613df19bb4e0 service nova] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:05.742250 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3df9f4-0df1-4f64-9934-613df19bb4e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:05.744307 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-7a3df9f4-0df1-4f64-9934-613df19bb4e0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:55:05.764818 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3df9f4-0df1-4f64-9934-613df19bb4e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:05.767164 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3df9f4-0df1-4f64-9934-613df19bb4e0 service nova] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:05.772884 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1268/2524] 10.222.0.15 () {60 vars in 1143 bytes} [Tue May 31 14:55:05 2022] POST /identity/v3/users => generated 305 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:55:05.784439 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1257/2525] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:55:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 14:55:05.784785 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dab3b1-2e91-4c41-8e94-3f4cfd8a1dfb admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:05.797575 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dab3b1-2e91-4c41-8e94-3f4cfd8a1dfb admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:05.802753 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b4339f-02ba-49d4-a07b-49fe948d8c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:05.803501 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b4339f-02ba-49d4-a07b-49fe948d8c0d admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:05.803793 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b4339f-02ba-49d4-a07b-49fe948d8c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:05.804103 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b4339f-02ba-49d4-a07b-49fe948d8c0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:05.805609 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b4339f-02ba-49d4-a07b-49fe948d8c0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:05.807263 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b4339f-02ba-49d4-a07b-49fe948d8c0d admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:05.822461 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1269/2526] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:55:05 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:55:05.824108 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3df9f4-0df1-4f64-9934-613df19bb4e0 service nova] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:05.836693 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3df9f4-0df1-4f64-9934-613df19bb4e0 service nova] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:05.842818 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d593f5d0-1e33-44f5-88f9-72101e7fc0ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:05.843562 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d593f5d0-1e33-44f5-88f9-72101e7fc0ee admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:05.843928 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d593f5d0-1e33-44f5-88f9-72101e7fc0ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:05.844280 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d593f5d0-1e33-44f5-88f9-72101e7fc0ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:05.845096 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d593f5d0-1e33-44f5-88f9-72101e7fc0ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:05.846786 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d593f5d0-1e33-44f5-88f9-72101e7fc0ee admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:05.872620 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1258/2527] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:55:05 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:55:05.873882 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b4339f-02ba-49d4-a07b-49fe948d8c0d admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:05.885849 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b4339f-02ba-49d4-a07b-49fe948d8c0d admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:05.891865 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae9bf30-45e2-4f31-b639-4758b7264026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:05.893662 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae9bf30-45e2-4f31-b639-4758b7264026 admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:05.893927 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae9bf30-45e2-4f31-b639-4758b7264026 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:05.894211 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae9bf30-45e2-4f31-b639-4758b7264026 admin admin] PATH_INFO: `/v3/projects/414a5239ae3446f49e546bc9d9181fa2/users/c4758abd735a43cabbf54a14d1d31634/roles/317f725e26bf43648d8235bb1f7c4cb3` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:05.915955 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae9bf30-45e2-4f31-b639-4758b7264026 admin admin] RBAC: Authorizing `identity:create_grant(project_id=414a5239ae3446f49e546bc9d9181fa2, user_id=c4758abd735a43cabbf54a14d1d31634, role_id=317f725e26bf43648d8235bb1f7c4cb3)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:05.918693 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae9bf30-45e2-4f31-b639-4758b7264026 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:06.027136 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1270/2528] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:55:05 2022] PUT /identity/v3/projects/414a5239ae3446f49e546bc9d9181fa2/users/c4758abd735a43cabbf54a14d1d31634/roles/317f725e26bf43648d8235bb1f7c4cb3 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:55:06.037745 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1718d5-8293-44cc-9b03-bccb2855e1b1 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:06.038146 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1718d5-8293-44cc-9b03-bccb2855e1b1 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:06.038529 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1718d5-8293-44cc-9b03-bccb2855e1b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:06.073760 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-3c1718d5-8293-44cc-9b03-bccb2855e1b1 None None] MFA Rules not processed for user `c4758abd735a43cabbf54a14d1d31634`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:55:06.075052 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-3c1718d5-8293-44cc-9b03-bccb2855e1b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:55:06.160994 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1259/2529] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:55:06 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:55:06.162676 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae9bf30-45e2-4f31-b639-4758b7264026 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:06.238801 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae9bf30-45e2-4f31-b639-4758b7264026 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:06.245912 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80be8c2a-4f5a-4e63-9002-34ba58bc73e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:06.247343 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80be8c2a-4f5a-4e63-9002-34ba58bc73e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:06.247781 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80be8c2a-4f5a-4e63-9002-34ba58bc73e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:06.248278 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80be8c2a-4f5a-4e63-9002-34ba58bc73e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:06.250883 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80be8c2a-4f5a-4e63-9002-34ba58bc73e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:06.253434 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80be8c2a-4f5a-4e63-9002-34ba58bc73e1 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:06.379704 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1271/2530] 10.222.0.15 () {60 vars in 1152 bytes} [Tue May 31 14:55:06 2022] POST /identity/v3/projects => generated 409 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:55:06.380848 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1718d5-8293-44cc-9b03-bccb2855e1b1 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:06.393919 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1718d5-8293-44cc-9b03-bccb2855e1b1 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:06.445416 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:55:06.464472 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b116520e-a4aa-4adc-a224-65502493988d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:06.465191 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b116520e-a4aa-4adc-a224-65502493988d admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:06.465494 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b116520e-a4aa-4adc-a224-65502493988d admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:06.466007 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b116520e-a4aa-4adc-a224-65502493988d admin admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:06.467012 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b116520e-a4aa-4adc-a224-65502493988d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:06.469061 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b116520e-a4aa-4adc-a224-65502493988d admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:06.515437 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80be8c2a-4f5a-4e63-9002-34ba58bc73e1 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:06.517211 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-80be8c2a-4f5a-4e63-9002-34ba58bc73e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:55:06.530375 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80be8c2a-4f5a-4e63-9002-34ba58bc73e1 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:06.535957 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e4112c-48a8-457b-9001-f661edb79eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:06.536857 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e4112c-48a8-457b-9001-f661edb79eac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:06.537152 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e4112c-48a8-457b-9001-f661edb79eac admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:06.537450 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e4112c-48a8-457b-9001-f661edb79eac admin admin] PATH_INFO: `/v3/users/e1d386cf72454d0090286d924ae5ce89` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:06.539611 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e4112c-48a8-457b-9001-f661edb79eac admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1d386cf72454d0090286d924ae5ce89)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:06.541657 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e4112c-48a8-457b-9001-f661edb79eac admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:06.565571 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1260/2531] 10.222.0.15 () {60 vars in 1143 bytes} [Tue May 31 14:55:06 2022] POST /identity/v3/users => generated 311 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:55:06.566811 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b116520e-a4aa-4adc-a224-65502493988d admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:06.583872 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b116520e-a4aa-4adc-a224-65502493988d admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:06.586874 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494e6890-8883-43ba-8279-a7234561e4b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:06.587594 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494e6890-8883-43ba-8279-a7234561e4b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:06.587881 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494e6890-8883-43ba-8279-a7234561e4b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:06.588218 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494e6890-8883-43ba-8279-a7234561e4b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:06.588997 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494e6890-8883-43ba-8279-a7234561e4b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:06.591928 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494e6890-8883-43ba-8279-a7234561e4b2 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:06.609055 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1261/2532] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:55:06 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:55:06.614248 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494e6890-8883-43ba-8279-a7234561e4b2 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:06.632381 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494e6890-8883-43ba-8279-a7234561e4b2 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:06.639205 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1fad65-a66b-4d86-9f1b-e0610151567f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:06.639205 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1fad65-a66b-4d86-9f1b-e0610151567f admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:06.639624 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1fad65-a66b-4d86-9f1b-e0610151567f admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:06.639866 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1fad65-a66b-4d86-9f1b-e0610151567f admin admin] PATH_INFO: `/v3/projects/20245f09b6dc4effa2962156b106154e/users/e852e67d85e343f99edf56605c448079/roles/76c53e2c353644f885028a0226c06146` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:06.660757 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1fad65-a66b-4d86-9f1b-e0610151567f admin admin] RBAC: Authorizing `identity:create_grant(project_id=20245f09b6dc4effa2962156b106154e, user_id=e852e67d85e343f99edf56605c448079, role_id=76c53e2c353644f885028a0226c06146)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:06.665512 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1fad65-a66b-4d86-9f1b-e0610151567f admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:06.826414 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1262/2533] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:55:06 2022] PUT /identity/v3/projects/20245f09b6dc4effa2962156b106154e/users/e852e67d85e343f99edf56605c448079/roles/76c53e2c353644f885028a0226c06146 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:55:06.834867 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1fad65-a66b-4d86-9f1b-e0610151567f admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:06.951565 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1fad65-a66b-4d86-9f1b-e0610151567f admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:06.959066 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8ba41d-ba2b-42dd-9f6d-a6aed335e063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:06.959606 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8ba41d-ba2b-42dd-9f6d-a6aed335e063 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:06.959893 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8ba41d-ba2b-42dd-9f6d-a6aed335e063 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:06.960187 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8ba41d-ba2b-42dd-9f6d-a6aed335e063 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:06.961454 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8ba41d-ba2b-42dd-9f6d-a6aed335e063 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:06.963281 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8ba41d-ba2b-42dd-9f6d-a6aed335e063 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:06.975872 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1263/2534] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:55:06 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 14:55:06.980437 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8ba41d-ba2b-42dd-9f6d-a6aed335e063 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:06.992194 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8ba41d-ba2b-42dd-9f6d-a6aed335e063 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:06.997392 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef53e027-d654-4c7f-b074-a51c07f68a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:06.998333 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef53e027-d654-4c7f-b074-a51c07f68a50 admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:06.998737 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef53e027-d654-4c7f-b074-a51c07f68a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:06.999027 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef53e027-d654-4c7f-b074-a51c07f68a50 admin admin] PATH_INFO: `/v3/projects/20245f09b6dc4effa2962156b106154e/users/e852e67d85e343f99edf56605c448079/roles/76c53e2c353644f885028a0226c06146` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:07.002213 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef53e027-d654-4c7f-b074-a51c07f68a50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20245f09b6dc4effa2962156b106154e, user_id=e852e67d85e343f99edf56605c448079, role_id=76c53e2c353644f885028a0226c06146)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:07.005411 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef53e027-d654-4c7f-b074-a51c07f68a50 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:07.016211 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1264/2535] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:55:06 2022] PUT /identity/v3/projects/20245f09b6dc4effa2962156b106154e/users/e852e67d85e343f99edf56605c448079/roles/76c53e2c353644f885028a0226c06146 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 14:55:07.026954 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dd9e60-3f1d-4662-b293-74a8ca0ff0f5 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:07.027247 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dd9e60-3f1d-4662-b293-74a8ca0ff0f5 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:07.027529 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dd9e60-3f1d-4662-b293-74a8ca0ff0f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:07.054259 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-d3dd9e60-3f1d-4662-b293-74a8ca0ff0f5 None None] MFA Rules not processed for user `e852e67d85e343f99edf56605c448079`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:55:07.055549 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-d3dd9e60-3f1d-4662-b293-74a8ca0ff0f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:55:07.135583 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1265/2536] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:55:07 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 14:55:07.193843 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dd9e60-3f1d-4662-b293-74a8ca0ff0f5 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:07.195825 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-d3dd9e60-3f1d-4662-b293-74a8ca0ff0f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:55:07.202174 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:55:07.210607 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:55:07.219752 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-a3e4112c-48a8-457b-9001-f661edb79eac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1d386cf72454d0090286d924ae5ce89'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:07.256369 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dd9e60-3f1d-4662-b293-74a8ca0ff0f5 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:07.260673 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b862ad2-84c9-4db6-9845-cef0cbc9ca75 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afbf718dcd9b4741a926b0a2321bd53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:07.261336 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b862ad2-84c9-4db6-9845-cef0cbc9ca75 service cinder] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:07.261634 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b862ad2-84c9-4db6-9845-cef0cbc9ca75 service cinder] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:07.262896 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b862ad2-84c9-4db6-9845-cef0cbc9ca75 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:07.272806 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b862ad2-84c9-4db6-9845-cef0cbc9ca75 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:07.274906 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b862ad2-84c9-4db6-9845-cef0cbc9ca75 service cinder] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:07.286090 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1266/2537] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:55:07 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:55:07.286846 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-a3e4112c-48a8-457b-9001-f661edb79eac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1d386cf72454d0090286d924ae5ce89'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:07.287474 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-a3e4112c-48a8-457b-9001-f661edb79eac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1d386cf72454d0090286d924ae5ce89'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:07.298861 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-a3e4112c-48a8-457b-9001-f661edb79eac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1d386cf72454d0090286d924ae5ce89'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:07.299851 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-a3e4112c-48a8-457b-9001-f661edb79eac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1d386cf72454d0090286d924ae5ce89'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:07.338466 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1272/2538] 10.222.0.15 () {58 vars in 1223 bytes} [Tue May 31 14:55:06 2022] DELETE /identity/v3/users/e1d386cf72454d0090286d924ae5ce89 => generated 0 bytes in 824 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 14:55:07.343744 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea368c9-2829-456a-b427-a50de3e01cf8 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:07.344229 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea368c9-2829-456a-b427-a50de3e01cf8 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:07.344652 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea368c9-2829-456a-b427-a50de3e01cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:07.366394 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-fea368c9-2829-456a-b427-a50de3e01cf8 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:55:07.367795 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-fea368c9-2829-456a-b427-a50de3e01cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:55:07.438601 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1267/2539] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:55:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:55:07.449096 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e4112c-48a8-457b-9001-f661edb79eac admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:07.450944 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-a3e4112c-48a8-457b-9001-f661edb79eac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:55:07.527578 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e4112c-48a8-457b-9001-f661edb79eac admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:07.531959 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eedc8f-6028-4340-a54f-54328838c70d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:07.532613 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eedc8f-6028-4340-a54f-54328838c70d service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:07.532896 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eedc8f-6028-4340-a54f-54328838c70d service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:07.533174 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eedc8f-6028-4340-a54f-54328838c70d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:07.543196 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eedc8f-6028-4340-a54f-54328838c70d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:07.545253 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eedc8f-6028-4340-a54f-54328838c70d service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:07.557327 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1273/2540] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:55:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:55:07.711544 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea368c9-2829-456a-b427-a50de3e01cf8 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:07.713052 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-fea368c9-2829-456a-b427-a50de3e01cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:55:07.782527 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea368c9-2829-456a-b427-a50de3e01cf8 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:07.796885 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516e8858-c8bb-4ca1-ac5b-fd02a0e4e85c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afbf718dcd9b4741a926b0a2321bd53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:07.797977 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e8858-c8bb-4ca1-ac5b-fd02a0e4e85c service cinder] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:07.798275 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e8858-c8bb-4ca1-ac5b-fd02a0e4e85c service cinder] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:07.798580 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e8858-c8bb-4ca1-ac5b-fd02a0e4e85c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:07.800712 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-516e8858-c8bb-4ca1-ac5b-fd02a0e4e85c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:55:07.883044 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516e8858-c8bb-4ca1-ac5b-fd02a0e4e85c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:07.884500 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516e8858-c8bb-4ca1-ac5b-fd02a0e4e85c service cinder] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:07.895235 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1268/2541] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:55:07 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:55:08.029199 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eedc8f-6028-4340-a54f-54328838c70d service neutron] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:08.032302 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-89eedc8f-6028-4340-a54f-54328838c70d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:55:08.050327 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eedc8f-6028-4340-a54f-54328838c70d service neutron] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:08.067184 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc3efd2-46a4-4139-8eeb-c998864503a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:08.072204 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc3efd2-46a4-4139-8eeb-c998864503a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:08.077780 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc3efd2-46a4-4139-8eeb-c998864503a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:08.077780 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc3efd2-46a4-4139-8eeb-c998864503a4 admin admin] PATH_INFO: `/v3/projects/1097dd4f8cad4033aeb5d8b37f572867` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:08.077780 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc3efd2-46a4-4139-8eeb-c998864503a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1097dd4f8cad4033aeb5d8b37f572867)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:08.078345 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc3efd2-46a4-4139-8eeb-c998864503a4 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:08.217811 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-7dc3efd2-46a4-4139-8eeb-c998864503a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1097dd4f8cad4033aeb5d8b37f572867', 'request_id': 'req-7dc3efd2-46a4-4139-8eeb-c998864503a4'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:08.300816 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-7dc3efd2-46a4-4139-8eeb-c998864503a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1097dd4f8cad4033aeb5d8b37f572867', 'request_id': 'req-7dc3efd2-46a4-4139-8eeb-c998864503a4'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:08.309820 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-7dc3efd2-46a4-4139-8eeb-c998864503a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1097dd4f8cad4033aeb5d8b37f572867', 'request_id': 'req-7dc3efd2-46a4-4139-8eeb-c998864503a4'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:08.326883 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-7dc3efd2-46a4-4139-8eeb-c998864503a4 admin admin] The token cache is being invalidate because project 1097dd4f8cad4033aeb5d8b37f572867 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80503) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 14:55:08.329381 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-7dc3efd2-46a4-4139-8eeb-c998864503a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:08.329381 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-7dc3efd2-46a4-4139-8eeb-c998864503a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:08.332778 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1274/2542] 10.222.0.15 () {58 vars in 1232 bytes} [Tue May 31 14:55:08 2022] DELETE /identity/v3/projects/1097dd4f8cad4033aeb5d8b37f572867 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:55:08.334006 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516e8858-c8bb-4ca1-ac5b-fd02a0e4e85c service cinder] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:08.342288 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:55:08.348769 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516e8858-c8bb-4ca1-ac5b-fd02a0e4e85c service cinder] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:08.443853 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39549598-919e-49e6-af62-9ac643304c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:08.445582 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39549598-919e-49e6-af62-9ac643304c5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:08.446134 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39549598-919e-49e6-af62-9ac643304c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:08.446612 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39549598-919e-49e6-af62-9ac643304c5e admin admin] PATH_INFO: `/v3/users/cf3d9352a94a483c9178479222afb73d` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:08.448079 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39549598-919e-49e6-af62-9ac643304c5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf3d9352a94a483c9178479222afb73d)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:08.450046 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39549598-919e-49e6-af62-9ac643304c5e admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:08.671367 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-39549598-919e-49e6-af62-9ac643304c5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf3d9352a94a483c9178479222afb73d'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:08.686949 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-39549598-919e-49e6-af62-9ac643304c5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf3d9352a94a483c9178479222afb73d'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:08.687785 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-39549598-919e-49e6-af62-9ac643304c5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf3d9352a94a483c9178479222afb73d'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:08.688472 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-39549598-919e-49e6-af62-9ac643304c5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf3d9352a94a483c9178479222afb73d'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:08.724352 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-39549598-919e-49e6-af62-9ac643304c5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf3d9352a94a483c9178479222afb73d'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:08.821793 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1269/2543] 10.222.0.15 () {58 vars in 1223 bytes} [Tue May 31 14:55:08 2022] DELETE /identity/v3/users/cf3d9352a94a483c9178479222afb73d => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:55:09.310306 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc3efd2-46a4-4139-8eeb-c998864503a4 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:09.312158 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-7dc3efd2-46a4-4139-8eeb-c998864503a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:55:09.329106 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc3efd2-46a4-4139-8eeb-c998864503a4 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:09.397215 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:55:09.420452 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2007f5a3-977a-48a8-8c13-a3a63da7714b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:09.421549 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007f5a3-977a-48a8-8c13-a3a63da7714b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:09.421939 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007f5a3-977a-48a8-8c13-a3a63da7714b admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:09.422321 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007f5a3-977a-48a8-8c13-a3a63da7714b admin admin] PATH_INFO: `/v3/projects/6fd590e6f0154ea6b0b1a810adbe9168` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:09.423748 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2007f5a3-977a-48a8-8c13-a3a63da7714b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fd590e6f0154ea6b0b1a810adbe9168)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:09.425741 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2007f5a3-977a-48a8-8c13-a3a63da7714b admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:09.564473 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-2007f5a3-977a-48a8-8c13-a3a63da7714b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fd590e6f0154ea6b0b1a810adbe9168', 'request_id': 'req-2007f5a3-977a-48a8-8c13-a3a63da7714b'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:09.639266 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-2007f5a3-977a-48a8-8c13-a3a63da7714b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fd590e6f0154ea6b0b1a810adbe9168', 'request_id': 'req-2007f5a3-977a-48a8-8c13-a3a63da7714b'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:09.649310 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-2007f5a3-977a-48a8-8c13-a3a63da7714b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fd590e6f0154ea6b0b1a810adbe9168', 'request_id': 'req-2007f5a3-977a-48a8-8c13-a3a63da7714b'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:09.664783 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-2007f5a3-977a-48a8-8c13-a3a63da7714b admin admin] The token cache is being invalidate because project 6fd590e6f0154ea6b0b1a810adbe9168 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80503) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 14:55:09.665072 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-2007f5a3-977a-48a8-8c13-a3a63da7714b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:09.665811 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-2007f5a3-977a-48a8-8c13-a3a63da7714b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:09.667404 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1275/2544] 10.222.0.15 () {58 vars in 1232 bytes} [Tue May 31 14:55:09 2022] DELETE /identity/v3/projects/6fd590e6f0154ea6b0b1a810adbe9168 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:55:09.672599 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d33bdda-32c6-4863-80c3-6a87e3ab73d0 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:09.679354 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d33bdda-32c6-4863-80c3-6a87e3ab73d0 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:09.679354 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d33bdda-32c6-4863-80c3-6a87e3ab73d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:09.693012 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-9d33bdda-32c6-4863-80c3-6a87e3ab73d0 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:55:09.694243 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-9d33bdda-32c6-4863-80c3-6a87e3ab73d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:55:09.798698 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1270/2545] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:55:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:55:09.800338 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d83bba-0e5d-4489-bdd4-6ce99ee46ae6 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:09.800631 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d83bba-0e5d-4489-bdd4-6ce99ee46ae6 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:09.800912 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d83bba-0e5d-4489-bdd4-6ce99ee46ae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:09.827634 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-f3d83bba-0e5d-4489-bdd4-6ce99ee46ae6 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:55:09.828866 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-f3d83bba-0e5d-4489-bdd4-6ce99ee46ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:55:09.842964 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1276/2546] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:55:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 14:55:09.846319 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d33bdda-32c6-4863-80c3-6a87e3ab73d0 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:09.857317 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d33bdda-32c6-4863-80c3-6a87e3ab73d0 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:09.862047 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab608b81-6771-4754-890f-189c4f90890b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:09.862772 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab608b81-6771-4754-890f-189c4f90890b admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:09.863062 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab608b81-6771-4754-890f-189c4f90890b admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:09.863342 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab608b81-6771-4754-890f-189c4f90890b admin admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:09.864076 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab608b81-6771-4754-890f-189c4f90890b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:55:09.864385 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab608b81-6771-4754-890f-189c4f90890b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:09.866135 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab608b81-6771-4754-890f-189c4f90890b admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:09.880170 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1271/2547] 10.222.0.15 () {58 vars in 1152 bytes} [Tue May 31 14:55:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:55:09.885240 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d83bba-0e5d-4489-bdd4-6ce99ee46ae6 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:09.895322 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d83bba-0e5d-4489-bdd4-6ce99ee46ae6 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:09.900596 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2df07ed-df0c-4ced-a1f6-f15da9ec8ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:09.901308 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df07ed-df0c-4ced-a1f6-f15da9ec8ba7 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:09.901602 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df07ed-df0c-4ced-a1f6-f15da9ec8ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:09.901882 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df07ed-df0c-4ced-a1f6-f15da9ec8ba7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:09.902620 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2df07ed-df0c-4ced-a1f6-f15da9ec8ba7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:09.904548 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2df07ed-df0c-4ced-a1f6-f15da9ec8ba7 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:09.997201 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1277/2548] 10.222.0.15 () {60 vars in 1152 bytes} [Tue May 31 14:55:09 2022] POST /identity/v3/projects => generated 373 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:55:10.001415 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab608b81-6771-4754-890f-189c4f90890b admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:10.013512 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab608b81-6771-4754-890f-189c4f90890b admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:10.019420 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:55:10.094200 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655aafd7-6444-4a6c-a67f-350ee0c0f3b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:10.095021 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655aafd7-6444-4a6c-a67f-350ee0c0f3b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:10.095309 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655aafd7-6444-4a6c-a67f-350ee0c0f3b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:10.095594 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655aafd7-6444-4a6c-a67f-350ee0c0f3b9 admin admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:10.096401 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655aafd7-6444-4a6c-a67f-350ee0c0f3b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:10.098434 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655aafd7-6444-4a6c-a67f-350ee0c0f3b9 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:10.184713 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1272/2549] 10.222.0.15 () {60 vars in 1143 bytes} [Tue May 31 14:55:10 2022] POST /identity/v3/users => generated 287 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:55:10.189183 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2df07ed-df0c-4ced-a1f6-f15da9ec8ba7 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:10.200463 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2df07ed-df0c-4ced-a1f6-f15da9ec8ba7 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:10.205401 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b2c87c-ec27-4415-88de-d94c6d2e9abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:10.209595 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b2c87c-ec27-4415-88de-d94c6d2e9abf admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:10.209595 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b2c87c-ec27-4415-88de-d94c6d2e9abf admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:10.209595 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b2c87c-ec27-4415-88de-d94c6d2e9abf admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:10.209595 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b2c87c-ec27-4415-88de-d94c6d2e9abf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:10.209595 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b2c87c-ec27-4415-88de-d94c6d2e9abf admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:10.220720 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1278/2550] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:55:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 14:55:10.224698 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655aafd7-6444-4a6c-a67f-350ee0c0f3b9 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:10.236275 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655aafd7-6444-4a6c-a67f-350ee0c0f3b9 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:10.241182 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9557d0-0dbb-4fd2-b7b0-82a224b19d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:10.241871 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9557d0-0dbb-4fd2-b7b0-82a224b19d7d admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:10.242758 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9557d0-0dbb-4fd2-b7b0-82a224b19d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:10.243050 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9557d0-0dbb-4fd2-b7b0-82a224b19d7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:10.243796 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9557d0-0dbb-4fd2-b7b0-82a224b19d7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:10.245448 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9557d0-0dbb-4fd2-b7b0-82a224b19d7d admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:10.257674 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1273/2551] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:55:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:55:10.262276 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b2c87c-ec27-4415-88de-d94c6d2e9abf admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:10.282307 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b2c87c-ec27-4415-88de-d94c6d2e9abf admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:10.291253 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ceea52-eb52-4307-9eb5-451b06c28a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:10.292332 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ceea52-eb52-4307-9eb5-451b06c28a22 admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:10.292765 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ceea52-eb52-4307-9eb5-451b06c28a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:10.293172 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ceea52-eb52-4307-9eb5-451b06c28a22 admin admin] PATH_INFO: `/v3/projects/4c2eca09f80c4bbbaddff99df5469ad5/users/b0eff9174f1a4a97b6b7b08942c4ec1f/roles/317f725e26bf43648d8235bb1f7c4cb3` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:10.311892 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ceea52-eb52-4307-9eb5-451b06c28a22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c2eca09f80c4bbbaddff99df5469ad5, user_id=b0eff9174f1a4a97b6b7b08942c4ec1f, role_id=317f725e26bf43648d8235bb1f7c4cb3)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:10.314602 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ceea52-eb52-4307-9eb5-451b06c28a22 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:10.765018 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1279/2552] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:55:10 2022] PUT /identity/v3/projects/4c2eca09f80c4bbbaddff99df5469ad5/users/b0eff9174f1a4a97b6b7b08942c4ec1f/roles/317f725e26bf43648d8235bb1f7c4cb3 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:55:10.770424 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f822397d-9870-4419-9e83-6f3d51ceac41 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:10.770937 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f822397d-9870-4419-9e83-6f3d51ceac41 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:10.771070 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f822397d-9870-4419-9e83-6f3d51ceac41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:10.789573 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-f822397d-9870-4419-9e83-6f3d51ceac41 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:55:10.790732 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-f822397d-9870-4419-9e83-6f3d51ceac41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:55:10.849416 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1274/2553] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:55:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:55:10.859762 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ceea52-eb52-4307-9eb5-451b06c28a22 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:10.861492 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-b1ceea52-eb52-4307-9eb5-451b06c28a22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:55:10.937863 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ceea52-eb52-4307-9eb5-451b06c28a22 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:10.944547 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc63b3d-56f7-477f-b51e-85292674156c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:10.945830 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc63b3d-56f7-477f-b51e-85292674156c service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:10.946255 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc63b3d-56f7-477f-b51e-85292674156c service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:10.946606 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc63b3d-56f7-477f-b51e-85292674156c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:10.956621 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc63b3d-56f7-477f-b51e-85292674156c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:10.960288 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc63b3d-56f7-477f-b51e-85292674156c service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:10.969833 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1280/2554] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:55:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:55:12.467243 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f742f-5009-46c4-b2e4-38ea3f75e3db None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:12.474752 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f742f-5009-46c4-b2e4-38ea3f75e3db None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:12.474752 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f742f-5009-46c4-b2e4-38ea3f75e3db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:12.508121 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-3e6f742f-5009-46c4-b2e4-38ea3f75e3db None None] MFA Rules not processed for user `b0eff9174f1a4a97b6b7b08942c4ec1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:55:12.509615 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-3e6f742f-5009-46c4-b2e4-38ea3f75e3db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:55:12.612916 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1275/2555] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:55:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:55:12.614213 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc63b3d-56f7-477f-b51e-85292674156c service neutron] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:12.628338 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc63b3d-56f7-477f-b51e-85292674156c service neutron] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:12.637255 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f84c5dd-327d-4a6a-bd51-8aac51227a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:12.640635 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f84c5dd-327d-4a6a-bd51-8aac51227a7b admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:12.640635 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f84c5dd-327d-4a6a-bd51-8aac51227a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:12.640635 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f84c5dd-327d-4a6a-bd51-8aac51227a7b admin admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:12.640909 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f84c5dd-327d-4a6a-bd51-8aac51227a7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:12.643137 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f84c5dd-327d-4a6a-bd51-8aac51227a7b admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:12.651852 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:55:12.788779 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6f742f-5009-46c4-b2e4-38ea3f75e3db None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:12.789969 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1281/2556] 10.222.0.15 () {60 vars in 1152 bytes} [Tue May 31 14:55:12 2022] POST /identity/v3/projects => generated 373 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:55:12.802704 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6f742f-5009-46c4-b2e4-38ea3f75e3db None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:12.820766 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:55:12.882135 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7455dfc6-b97b-4940-8a2f-860fe02733f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:12.883434 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7455dfc6-b97b-4940-8a2f-860fe02733f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:12.884049 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7455dfc6-b97b-4940-8a2f-860fe02733f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:12.885056 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7455dfc6-b97b-4940-8a2f-860fe02733f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:12.891787 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7455dfc6-b97b-4940-8a2f-860fe02733f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:12.891787 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7455dfc6-b97b-4940-8a2f-860fe02733f0 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:12.981910 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1276/2557] 10.222.0.15 () {60 vars in 1143 bytes} [Tue May 31 14:55:12 2022] POST /identity/v3/users => generated 293 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:55:12.985828 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f84c5dd-327d-4a6a-bd51-8aac51227a7b admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:12.997878 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f84c5dd-327d-4a6a-bd51-8aac51227a7b admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:13.007253 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abc9e40-97d7-4220-b9b0-eb2268bb6bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:13.008545 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc9e40-97d7-4220-b9b0-eb2268bb6bb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:13.008830 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc9e40-97d7-4220-b9b0-eb2268bb6bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:13.009108 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc9e40-97d7-4220-b9b0-eb2268bb6bb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:13.010311 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abc9e40-97d7-4220-b9b0-eb2268bb6bb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:13.012246 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abc9e40-97d7-4220-b9b0-eb2268bb6bb9 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:13.040565 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7455dfc6-b97b-4940-8a2f-860fe02733f0 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:13.042875 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1282/2558] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:55:12 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:55:13.058044 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7455dfc6-b97b-4940-8a2f-860fe02733f0 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:13.064902 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48b3151-a631-48d1-b703-effac98026e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:13.066844 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b3151-a631-48d1-b703-effac98026e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:13.067378 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b3151-a631-48d1-b703-effac98026e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:13.067791 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b3151-a631-48d1-b703-effac98026e3 admin admin] PATH_INFO: `/v3/projects/5fe2cfa91313471c8f8f6b476118f30a/users/05b3afc6a5304c468947285edc595b8c/roles/76c53e2c353644f885028a0226c06146` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:13.094091 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48b3151-a631-48d1-b703-effac98026e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fe2cfa91313471c8f8f6b476118f30a, user_id=05b3afc6a5304c468947285edc595b8c, role_id=76c53e2c353644f885028a0226c06146)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:13.097205 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48b3151-a631-48d1-b703-effac98026e3 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:13.198305 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abc9e40-97d7-4220-b9b0-eb2268bb6bb9 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:13.199328 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1277/2559] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:55:13 2022] PUT /identity/v3/projects/5fe2cfa91313471c8f8f6b476118f30a/users/05b3afc6a5304c468947285edc595b8c/roles/76c53e2c353644f885028a0226c06146 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 14:55:13.209659 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abc9e40-97d7-4220-b9b0-eb2268bb6bb9 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:13.291770 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedf1822-7967-402a-983b-ab0682a78893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:13.292463 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedf1822-7967-402a-983b-ab0682a78893 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:13.292893 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedf1822-7967-402a-983b-ab0682a78893 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:13.293177 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedf1822-7967-402a-983b-ab0682a78893 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:13.293906 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedf1822-7967-402a-983b-ab0682a78893 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:13.298930 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedf1822-7967-402a-983b-ab0682a78893 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:13.317814 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1283/2560] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:55:13 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:55:13.322147 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48b3151-a631-48d1-b703-effac98026e3 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:13.339142 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48b3151-a631-48d1-b703-effac98026e3 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:13.345450 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f6dc00-fbd9-46a4-a970-dbcefe5b4c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:13.346353 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f6dc00-fbd9-46a4-a970-dbcefe5b4c43 admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:13.346670 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f6dc00-fbd9-46a4-a970-dbcefe5b4c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:13.346950 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f6dc00-fbd9-46a4-a970-dbcefe5b4c43 admin admin] PATH_INFO: `/v3/projects/5fe2cfa91313471c8f8f6b476118f30a/users/05b3afc6a5304c468947285edc595b8c/roles/76c53e2c353644f885028a0226c06146` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:13.349091 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f6dc00-fbd9-46a4-a970-dbcefe5b4c43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fe2cfa91313471c8f8f6b476118f30a, user_id=05b3afc6a5304c468947285edc595b8c, role_id=76c53e2c353644f885028a0226c06146)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:13.355779 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f6dc00-fbd9-46a4-a970-dbcefe5b4c43 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:13.377524 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1278/2561] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:55:13 2022] PUT /identity/v3/projects/5fe2cfa91313471c8f8f6b476118f30a/users/05b3afc6a5304c468947285edc595b8c/roles/76c53e2c353644f885028a0226c06146 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:55:15.166155 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f1bd5-e78d-440b-80c3-583a93ba663e None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:15.166728 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f1bd5-e78d-440b-80c3-583a93ba663e None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:15.166827 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f1bd5-e78d-440b-80c3-583a93ba663e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:15.210451 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-982f1bd5-e78d-440b-80c3-583a93ba663e None None] MFA Rules not processed for user `05b3afc6a5304c468947285edc595b8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:55:15.211854 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-982f1bd5-e78d-440b-80c3-583a93ba663e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:55:15.287650 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1284/2562] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:55:15 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:55:15.299351 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b13a9-7b49-412a-99e8-8f57e9b4dd2f None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:15.299768 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b13a9-7b49-412a-99e8-8f57e9b4dd2f None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:15.299917 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b13a9-7b49-412a-99e8-8f57e9b4dd2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:15.318682 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-7d1b13a9-7b49-412a-99e8-8f57e9b4dd2f None None] MFA Rules not processed for user `b0eff9174f1a4a97b6b7b08942c4ec1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:55:15.319917 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-7d1b13a9-7b49-412a-99e8-8f57e9b4dd2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:55:15.375676 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1279/2563] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:55:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:55:15.387052 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982f1bd5-e78d-440b-80c3-583a93ba663e None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:15.388457 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-982f1bd5-e78d-440b-80c3-583a93ba663e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:55:15.444851 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:55:15.463688 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982f1bd5-e78d-440b-80c3-583a93ba663e None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:15.469433 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23655be4-457d-4b4f-b191-1b41ba75bc45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57768d448e345ad8879bf29f21b48ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:15.470194 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23655be4-457d-4b4f-b191-1b41ba75bc45 service nova] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:15.470478 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23655be4-457d-4b4f-b191-1b41ba75bc45 service nova] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:15.470788 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23655be4-457d-4b4f-b191-1b41ba75bc45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:15.480458 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23655be4-457d-4b4f-b191-1b41ba75bc45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:15.482136 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23655be4-457d-4b4f-b191-1b41ba75bc45 service nova] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:15.491640 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1285/2564] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:55:15 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:55:15.567167 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1b13a9-7b49-412a-99e8-8f57e9b4dd2f None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:15.568878 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-7d1b13a9-7b49-412a-99e8-8f57e9b4dd2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:55:15.642032 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1b13a9-7b49-412a-99e8-8f57e9b4dd2f None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:15.647228 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b63082-1894-4e9a-bd2c-bc8ebd58a63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:15.648200 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b63082-1894-4e9a-bd2c-bc8ebd58a63f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:15.648577 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b63082-1894-4e9a-bd2c-bc8ebd58a63f admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:15.648923 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b63082-1894-4e9a-bd2c-bc8ebd58a63f admin admin] PATH_INFO: `/v3/users/c4758abd735a43cabbf54a14d1d31634` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:15.650245 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b63082-1894-4e9a-bd2c-bc8ebd58a63f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4758abd735a43cabbf54a14d1d31634)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:15.652278 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b63082-1894-4e9a-bd2c-bc8ebd58a63f admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:15.670110 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:55:15.734834 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23655be4-457d-4b4f-b191-1b41ba75bc45 service nova] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:15.787980 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23655be4-457d-4b4f-b191-1b41ba75bc45 service nova] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:15.792230 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb694e7-66fc-406b-9857-81c97b2423dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:15.792871 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb694e7-66fc-406b-9857-81c97b2423dc service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:15.793156 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb694e7-66fc-406b-9857-81c97b2423dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:15.793433 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb694e7-66fc-406b-9857-81c97b2423dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:15.795219 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-7cb694e7-66fc-406b-9857-81c97b2423dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:55:15.804780 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb694e7-66fc-406b-9857-81c97b2423dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:15.806220 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb694e7-66fc-406b-9857-81c97b2423dc service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:15.814393 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1286/2565] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:55:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 14:55:15.921753 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-79b63082-1894-4e9a-bd2c-bc8ebd58a63f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4758abd735a43cabbf54a14d1d31634'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:15.928610 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-79b63082-1894-4e9a-bd2c-bc8ebd58a63f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4758abd735a43cabbf54a14d1d31634'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:15.929288 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-79b63082-1894-4e9a-bd2c-bc8ebd58a63f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4758abd735a43cabbf54a14d1d31634'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:15.930393 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-79b63082-1894-4e9a-bd2c-bc8ebd58a63f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4758abd735a43cabbf54a14d1d31634'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:15.943411 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-79b63082-1894-4e9a-bd2c-bc8ebd58a63f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4758abd735a43cabbf54a14d1d31634'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:16.033343 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1280/2566] 10.222.0.15 () {58 vars in 1223 bytes} [Tue May 31 14:55:15 2022] DELETE /identity/v3/users/c4758abd735a43cabbf54a14d1d31634 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:55:16.044112 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79487336-3ba1-4152-854b-3b1376b73a0f None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:16.044112 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79487336-3ba1-4152-854b-3b1376b73a0f None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:16.044112 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79487336-3ba1-4152-854b-3b1376b73a0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:16.056625 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-79487336-3ba1-4152-854b-3b1376b73a0f None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:55:16.057877 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-79487336-3ba1-4152-854b-3b1376b73a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:55:16.118508 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1287/2567] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:55:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:55:16.128398 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b63082-1894-4e9a-bd2c-bc8ebd58a63f admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:16.129865 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-79b63082-1894-4e9a-bd2c-bc8ebd58a63f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:55:16.194429 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b63082-1894-4e9a-bd2c-bc8ebd58a63f admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:16.198097 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e429af3-a5e5-43d4-a480-f140be5610ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:16.198774 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e429af3-a5e5-43d4-a480-f140be5610ca service neutron] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:16.199061 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e429af3-a5e5-43d4-a480-f140be5610ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:16.199341 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e429af3-a5e5-43d4-a480-f140be5610ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:16.212063 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e429af3-a5e5-43d4-a480-f140be5610ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:16.213654 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e429af3-a5e5-43d4-a480-f140be5610ca service neutron] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:16.235337 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1281/2568] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:55:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:55:16.253345 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79487336-3ba1-4152-854b-3b1376b73a0f None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:16.255641 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-79487336-3ba1-4152-854b-3b1376b73a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:55:16.347102 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79487336-3ba1-4152-854b-3b1376b73a0f None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:16.352368 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea534af-51c2-4158-bba5-464cfd63cfd4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc959ca520c4816b5ff7f95655e53e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:16.353016 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea534af-51c2-4158-bba5-464cfd63cfd4 service placement] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:16.353296 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea534af-51c2-4158-bba5-464cfd63cfd4 service placement] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:16.353568 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea534af-51c2-4158-bba5-464cfd63cfd4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:16.355799 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-bea534af-51c2-4158-bba5-464cfd63cfd4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:55:16.367837 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea534af-51c2-4158-bba5-464cfd63cfd4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:16.371143 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea534af-51c2-4158-bba5-464cfd63cfd4 service placement] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:16.382279 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1288/2569] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:55:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:55:16.566890 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e429af3-a5e5-43d4-a480-f140be5610ca service neutron] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:16.568438 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-2e429af3-a5e5-43d4-a480-f140be5610ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:55:16.579830 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e429af3-a5e5-43d4-a480-f140be5610ca service neutron] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:16.583765 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d152d3-9065-4003-bfe2-0de8d7a9edf3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:16.585539 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d152d3-9065-4003-bfe2-0de8d7a9edf3 service neutron] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:16.585539 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d152d3-9065-4003-bfe2-0de8d7a9edf3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:16.585539 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d152d3-9065-4003-bfe2-0de8d7a9edf3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:16.587205 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-d6d152d3-9065-4003-bfe2-0de8d7a9edf3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:55:16.597187 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d152d3-9065-4003-bfe2-0de8d7a9edf3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:16.598706 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d152d3-9065-4003-bfe2-0de8d7a9edf3 service neutron] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:16.607708 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1282/2570] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:55:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:55:16.707636 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea534af-51c2-4158-bba5-464cfd63cfd4 service placement] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:16.709413 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-bea534af-51c2-4158-bba5-464cfd63cfd4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:55:16.724132 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea534af-51c2-4158-bba5-464cfd63cfd4 service placement] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:16.736228 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0afd1a6-fe8f-4bf6-bb95-b45856177fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:16.737210 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0afd1a6-fe8f-4bf6-bb95-b45856177fbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:16.737596 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0afd1a6-fe8f-4bf6-bb95-b45856177fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:16.737882 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0afd1a6-fe8f-4bf6-bb95-b45856177fbf admin admin] PATH_INFO: `/v3/projects/414a5239ae3446f49e546bc9d9181fa2` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:16.739375 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0afd1a6-fe8f-4bf6-bb95-b45856177fbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=414a5239ae3446f49e546bc9d9181fa2)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:16.741228 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0afd1a6-fe8f-4bf6-bb95-b45856177fbf admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:16.754521 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:55:16.869924 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-e0afd1a6-fe8f-4bf6-bb95-b45856177fbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '414a5239ae3446f49e546bc9d9181fa2', 'request_id': 'req-e0afd1a6-fe8f-4bf6-bb95-b45856177fbf'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:16.942348 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-e0afd1a6-fe8f-4bf6-bb95-b45856177fbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '414a5239ae3446f49e546bc9d9181fa2', 'request_id': 'req-e0afd1a6-fe8f-4bf6-bb95-b45856177fbf'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:16.950909 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-e0afd1a6-fe8f-4bf6-bb95-b45856177fbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '414a5239ae3446f49e546bc9d9181fa2', 'request_id': 'req-e0afd1a6-fe8f-4bf6-bb95-b45856177fbf'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:16.963128 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-e0afd1a6-fe8f-4bf6-bb95-b45856177fbf admin admin] The token cache is being invalidate because project 414a5239ae3446f49e546bc9d9181fa2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80503) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 14:55:16.963430 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-e0afd1a6-fe8f-4bf6-bb95-b45856177fbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:16.964133 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-e0afd1a6-fe8f-4bf6-bb95-b45856177fbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:16.965880 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1289/2571] 10.222.0.15 () {58 vars in 1232 bytes} [Tue May 31 14:55:16 2022] DELETE /identity/v3/projects/414a5239ae3446f49e546bc9d9181fa2 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:55:16.969955 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d152d3-9065-4003-bfe2-0de8d7a9edf3 service neutron] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:16.982290 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d152d3-9065-4003-bfe2-0de8d7a9edf3 service neutron] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:17.043616 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e7b6c7-a201-4079-a3c7-4d12581ad0ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:17.044489 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e7b6c7-a201-4079-a3c7-4d12581ad0ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:17.044783 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e7b6c7-a201-4079-a3c7-4d12581ad0ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:17.045064 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e7b6c7-a201-4079-a3c7-4d12581ad0ea admin admin] PATH_INFO: `/v3/users/e852e67d85e343f99edf56605c448079` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:17.046327 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e7b6c7-a201-4079-a3c7-4d12581ad0ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=e852e67d85e343f99edf56605c448079)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:17.048310 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e7b6c7-a201-4079-a3c7-4d12581ad0ea admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:17.164771 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:55:17.275136 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-45e7b6c7-a201-4079-a3c7-4d12581ad0ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e852e67d85e343f99edf56605c448079'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:17.282106 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-45e7b6c7-a201-4079-a3c7-4d12581ad0ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e852e67d85e343f99edf56605c448079'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:17.283777 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-45e7b6c7-a201-4079-a3c7-4d12581ad0ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e852e67d85e343f99edf56605c448079'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:17.285045 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-45e7b6c7-a201-4079-a3c7-4d12581ad0ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e852e67d85e343f99edf56605c448079'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:17.316297 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-45e7b6c7-a201-4079-a3c7-4d12581ad0ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e852e67d85e343f99edf56605c448079'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:17.412241 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1283/2572] 10.222.0.15 () {58 vars in 1223 bytes} [Tue May 31 14:55:16 2022] DELETE /identity/v3/users/e852e67d85e343f99edf56605c448079 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:55:17.920371 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0afd1a6-fe8f-4bf6-bb95-b45856177fbf admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:17.921827 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-e0afd1a6-fe8f-4bf6-bb95-b45856177fbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:55:17.935599 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0afd1a6-fe8f-4bf6-bb95-b45856177fbf admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:18.007154 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71c1810-8abd-4393-8655-13cb57785590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:18.008753 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71c1810-8abd-4393-8655-13cb57785590 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:18.009041 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71c1810-8abd-4393-8655-13cb57785590 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:18.009315 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71c1810-8abd-4393-8655-13cb57785590 admin admin] PATH_INFO: `/v3/projects/20245f09b6dc4effa2962156b106154e` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:18.010499 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71c1810-8abd-4393-8655-13cb57785590 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20245f09b6dc4effa2962156b106154e)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:18.012518 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71c1810-8abd-4393-8655-13cb57785590 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:18.137196 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-e71c1810-8abd-4393-8655-13cb57785590 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20245f09b6dc4effa2962156b106154e', 'request_id': 'req-e71c1810-8abd-4393-8655-13cb57785590'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:18.221632 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-e71c1810-8abd-4393-8655-13cb57785590 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20245f09b6dc4effa2962156b106154e', 'request_id': 'req-e71c1810-8abd-4393-8655-13cb57785590'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:18.227483 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-e71c1810-8abd-4393-8655-13cb57785590 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20245f09b6dc4effa2962156b106154e', 'request_id': 'req-e71c1810-8abd-4393-8655-13cb57785590'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:18.238382 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-e71c1810-8abd-4393-8655-13cb57785590 admin admin] The token cache is being invalidate because project 20245f09b6dc4effa2962156b106154e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80503) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 14:55:18.238701 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-e71c1810-8abd-4393-8655-13cb57785590 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:18.239328 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-e71c1810-8abd-4393-8655-13cb57785590 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:18.240863 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1290/2573] 10.222.0.15 () {58 vars in 1232 bytes} [Tue May 31 14:55:17 2022] DELETE /identity/v3/projects/20245f09b6dc4effa2962156b106154e => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:55:18.246185 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5e518b-b5d8-4b19-890a-cff02844fff4 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:18.246713 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5e518b-b5d8-4b19-890a-cff02844fff4 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:18.246817 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5e518b-b5d8-4b19-890a-cff02844fff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:18.265589 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-de5e518b-b5d8-4b19-890a-cff02844fff4 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:55:18.266810 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-de5e518b-b5d8-4b19-890a-cff02844fff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:55:18.326165 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1284/2574] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:55:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:55:18.338903 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13130ec-adaa-41fe-bfa0-fa377147a5f7 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:18.339121 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13130ec-adaa-41fe-bfa0-fa377147a5f7 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:18.339426 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13130ec-adaa-41fe-bfa0-fa377147a5f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:18.358406 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-f13130ec-adaa-41fe-bfa0-fa377147a5f7 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:55:18.359634 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-f13130ec-adaa-41fe-bfa0-fa377147a5f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:55:18.367637 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1291/2575] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:55:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:55:18.372422 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5e518b-b5d8-4b19-890a-cff02844fff4 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:18.382010 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5e518b-b5d8-4b19-890a-cff02844fff4 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:18.388243 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aaed9c-0f13-49f7-a8f6-83831e8e4c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:18.388998 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aaed9c-0f13-49f7-a8f6-83831e8e4c79 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:18.389282 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aaed9c-0f13-49f7-a8f6-83831e8e4c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:18.389567 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aaed9c-0f13-49f7-a8f6-83831e8e4c79 admin admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:18.390295 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aaed9c-0f13-49f7-a8f6-83831e8e4c79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:55:18.390633 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aaed9c-0f13-49f7-a8f6-83831e8e4c79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:18.392304 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aaed9c-0f13-49f7-a8f6-83831e8e4c79 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:18.404826 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1285/2576] 10.222.0.15 () {58 vars in 1152 bytes} [Tue May 31 14:55:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:55:18.409076 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13130ec-adaa-41fe-bfa0-fa377147a5f7 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:18.418883 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13130ec-adaa-41fe-bfa0-fa377147a5f7 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:18.423583 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93040082-5e7e-4317-8d4f-a709ec5d5cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:18.424226 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93040082-5e7e-4317-8d4f-a709ec5d5cd5 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:18.424506 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93040082-5e7e-4317-8d4f-a709ec5d5cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:18.424783 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93040082-5e7e-4317-8d4f-a709ec5d5cd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:18.425472 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93040082-5e7e-4317-8d4f-a709ec5d5cd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:18.427402 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93040082-5e7e-4317-8d4f-a709ec5d5cd5 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:18.537510 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:55:18.545337 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1292/2577] 10.222.0.15 () {60 vars in 1152 bytes} [Tue May 31 14:55:18 2022] POST /identity/v3/projects => generated 365 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:55:18.549480 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aaed9c-0f13-49f7-a8f6-83831e8e4c79 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:18.560844 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aaed9c-0f13-49f7-a8f6-83831e8e4c79 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:18.617789 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f70ff2-cab5-47a9-9b46-0647b8558fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:18.619149 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f70ff2-cab5-47a9-9b46-0647b8558fed admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:18.619441 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f70ff2-cab5-47a9-9b46-0647b8558fed admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:18.619728 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f70ff2-cab5-47a9-9b46-0647b8558fed admin admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:18.620539 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f70ff2-cab5-47a9-9b46-0647b8558fed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:18.622409 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f70ff2-cab5-47a9-9b46-0647b8558fed admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:18.742320 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1286/2578] 10.222.0.15 () {60 vars in 1143 bytes} [Tue May 31 14:55:18 2022] POST /identity/v3/users => generated 283 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:55:18.746624 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93040082-5e7e-4317-8d4f-a709ec5d5cd5 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:18.757125 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93040082-5e7e-4317-8d4f-a709ec5d5cd5 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:18.762723 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f7fcfc-af84-488c-b0da-6da9ea377fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:18.763871 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f7fcfc-af84-488c-b0da-6da9ea377fa3 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:18.763871 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f7fcfc-af84-488c-b0da-6da9ea377fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:18.764086 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f7fcfc-af84-488c-b0da-6da9ea377fa3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:18.764666 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f7fcfc-af84-488c-b0da-6da9ea377fa3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:18.766263 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f7fcfc-af84-488c-b0da-6da9ea377fa3 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:18.777934 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1293/2579] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:55:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:55:18.782120 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f70ff2-cab5-47a9-9b46-0647b8558fed admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:18.793023 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f70ff2-cab5-47a9-9b46-0647b8558fed admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:18.797612 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20aaba6-725d-4fc9-94fc-26445a078e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:18.798293 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20aaba6-725d-4fc9-94fc-26445a078e59 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:18.798629 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20aaba6-725d-4fc9-94fc-26445a078e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:18.798916 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20aaba6-725d-4fc9-94fc-26445a078e59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:18.799644 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20aaba6-725d-4fc9-94fc-26445a078e59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:18.801222 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20aaba6-725d-4fc9-94fc-26445a078e59 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:18.811312 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1287/2580] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:55:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:55:18.815757 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f7fcfc-af84-488c-b0da-6da9ea377fa3 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:18.825740 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f7fcfc-af84-488c-b0da-6da9ea377fa3 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:18.830477 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286ea3ea-d9d2-4778-bf65-6cbdd69047cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:18.831400 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286ea3ea-d9d2-4778-bf65-6cbdd69047cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:18.831685 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286ea3ea-d9d2-4778-bf65-6cbdd69047cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:18.831968 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286ea3ea-d9d2-4778-bf65-6cbdd69047cf admin admin] PATH_INFO: `/v3/projects/8b25044cc8ee4774b64db91c8a30384f/users/e0d7f7a60d2940bca217788616364bdf/roles/317f725e26bf43648d8235bb1f7c4cb3` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:18.846861 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286ea3ea-d9d2-4778-bf65-6cbdd69047cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b25044cc8ee4774b64db91c8a30384f, user_id=e0d7f7a60d2940bca217788616364bdf, role_id=317f725e26bf43648d8235bb1f7c4cb3)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:18.849572 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286ea3ea-d9d2-4778-bf65-6cbdd69047cf admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:18.941737 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1294/2581] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:55:18 2022] PUT /identity/v3/projects/8b25044cc8ee4774b64db91c8a30384f/users/e0d7f7a60d2940bca217788616364bdf/roles/317f725e26bf43648d8235bb1f7c4cb3 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 14:55:18.952102 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6239bba7-b96c-46a5-916f-eeda24ad2322 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:18.952399 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6239bba7-b96c-46a5-916f-eeda24ad2322 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:18.952678 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6239bba7-b96c-46a5-916f-eeda24ad2322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:18.972668 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:55:18.983876 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-6239bba7-b96c-46a5-916f-eeda24ad2322 None None] MFA Rules not processed for user `e0d7f7a60d2940bca217788616364bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:55:18.985229 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-6239bba7-b96c-46a5-916f-eeda24ad2322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:55:19.053965 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1288/2582] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:55:18 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:55:19.058497 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286ea3ea-d9d2-4778-bf65-6cbdd69047cf admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:19.129591 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286ea3ea-d9d2-4778-bf65-6cbdd69047cf admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:19.135501 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9be09d-e677-45dc-bf93-836deb9e6e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:19.136500 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9be09d-e677-45dc-bf93-836deb9e6e47 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:19.136948 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9be09d-e677-45dc-bf93-836deb9e6e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:19.137292 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9be09d-e677-45dc-bf93-836deb9e6e47 admin admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:19.137941 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9be09d-e677-45dc-bf93-836deb9e6e47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:19.139976 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9be09d-e677-45dc-bf93-836deb9e6e47 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:19.264265 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1295/2583] 10.222.0.15 () {60 vars in 1152 bytes} [Tue May 31 14:55:19 2022] POST /identity/v3/projects => generated 363 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 14:55:19.268420 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6239bba7-b96c-46a5-916f-eeda24ad2322 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:19.279879 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6239bba7-b96c-46a5-916f-eeda24ad2322 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:19.342138 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9241aa-bb8b-45f0-8aad-1b26710567c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:19.342764 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9241aa-bb8b-45f0-8aad-1b26710567c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:19.343048 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9241aa-bb8b-45f0-8aad-1b26710567c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:19.343323 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9241aa-bb8b-45f0-8aad-1b26710567c1 admin admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:19.344032 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9241aa-bb8b-45f0-8aad-1b26710567c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:19.345954 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9241aa-bb8b-45f0-8aad-1b26710567c1 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:19.488639 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1289/2584] 10.222.0.15 () {60 vars in 1143 bytes} [Tue May 31 14:55:19 2022] POST /identity/v3/users => generated 288 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 14:55:19.492165 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9be09d-e677-45dc-bf93-836deb9e6e47 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:19.504633 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9be09d-e677-45dc-bf93-836deb9e6e47 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:19.513788 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8ac8f8-af7d-4d37-a07b-50395ccd0fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:19.515037 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8ac8f8-af7d-4d37-a07b-50395ccd0fae admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:19.515465 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8ac8f8-af7d-4d37-a07b-50395ccd0fae admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:19.515843 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8ac8f8-af7d-4d37-a07b-50395ccd0fae admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:19.516880 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8ac8f8-af7d-4d37-a07b-50395ccd0fae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:19.519009 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8ac8f8-af7d-4d37-a07b-50395ccd0fae admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:19.535608 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1296/2585] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:55:19 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:55:19.542079 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9241aa-bb8b-45f0-8aad-1b26710567c1 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:19.552383 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9241aa-bb8b-45f0-8aad-1b26710567c1 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:19.557688 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11bcdc6-19e1-4353-9d64-c6df28761ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:19.558606 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11bcdc6-19e1-4353-9d64-c6df28761ba8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:19.558903 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11bcdc6-19e1-4353-9d64-c6df28761ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:19.559186 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11bcdc6-19e1-4353-9d64-c6df28761ba8 admin admin] PATH_INFO: `/v3/projects/4190009582d34fb3b75a6daa7cedff88/users/7493f291b8c84579a48d5026cdeea713/roles/76c53e2c353644f885028a0226c06146` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:19.574455 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11bcdc6-19e1-4353-9d64-c6df28761ba8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4190009582d34fb3b75a6daa7cedff88, user_id=7493f291b8c84579a48d5026cdeea713, role_id=76c53e2c353644f885028a0226c06146)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:19.577292 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11bcdc6-19e1-4353-9d64-c6df28761ba8 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:19.674443 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1290/2586] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:55:19 2022] PUT /identity/v3/projects/4190009582d34fb3b75a6daa7cedff88/users/7493f291b8c84579a48d5026cdeea713/roles/76c53e2c353644f885028a0226c06146 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:55:19.679612 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8ac8f8-af7d-4d37-a07b-50395ccd0fae admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:19.688629 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8ac8f8-af7d-4d37-a07b-50395ccd0fae admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:19.745267 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abc89a7-5c34-45ee-8acc-22ae9b5e3c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:19.745931 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abc89a7-5c34-45ee-8acc-22ae9b5e3c82 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:19.746216 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abc89a7-5c34-45ee-8acc-22ae9b5e3c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:19.746498 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abc89a7-5c34-45ee-8acc-22ae9b5e3c82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:19.747244 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abc89a7-5c34-45ee-8acc-22ae9b5e3c82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:19.748828 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abc89a7-5c34-45ee-8acc-22ae9b5e3c82 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:19.758489 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1297/2587] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:55:19 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:55:19.762662 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11bcdc6-19e1-4353-9d64-c6df28761ba8 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:19.773205 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11bcdc6-19e1-4353-9d64-c6df28761ba8 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:19.778530 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4302ec-ffbc-4938-a74e-df54feecf355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:19.779437 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4302ec-ffbc-4938-a74e-df54feecf355 admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:19.779726 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4302ec-ffbc-4938-a74e-df54feecf355 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:19.780008 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4302ec-ffbc-4938-a74e-df54feecf355 admin admin] PATH_INFO: `/v3/projects/4190009582d34fb3b75a6daa7cedff88/users/7493f291b8c84579a48d5026cdeea713/roles/76c53e2c353644f885028a0226c06146` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:19.781987 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4302ec-ffbc-4938-a74e-df54feecf355 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4190009582d34fb3b75a6daa7cedff88, user_id=7493f291b8c84579a48d5026cdeea713, role_id=76c53e2c353644f885028a0226c06146)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:19.784638 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4302ec-ffbc-4938-a74e-df54feecf355 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:19.795594 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1291/2588] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:55:19 2022] PUT /identity/v3/projects/4190009582d34fb3b75a6daa7cedff88/users/7493f291b8c84579a48d5026cdeea713/roles/76c53e2c353644f885028a0226c06146 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:55:19.805798 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f23ada-fe0d-4ab9-b86d-089f1de2fd5c None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:19.806093 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f23ada-fe0d-4ab9-b86d-089f1de2fd5c None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:19.806373 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f23ada-fe0d-4ab9-b86d-089f1de2fd5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:19.835591 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-81f23ada-fe0d-4ab9-b86d-089f1de2fd5c None None] MFA Rules not processed for user `7493f291b8c84579a48d5026cdeea713`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:55:19.836806 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-81f23ada-fe0d-4ab9-b86d-089f1de2fd5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:55:19.862699 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:55:19.907440 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1298/2589] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:55:19 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:55:19.918719 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4302ec-ffbc-4938-a74e-df54feecf355 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:19.920391 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-ba4302ec-ffbc-4938-a74e-df54feecf355 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:55:19.982013 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4302ec-ffbc-4938-a74e-df54feecf355 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:19.985637 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a28eaab-50ea-4f54-8d54-168672916dfc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afbf718dcd9b4741a926b0a2321bd53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:19.986276 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a28eaab-50ea-4f54-8d54-168672916dfc service cinder] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:19.986699 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a28eaab-50ea-4f54-8d54-168672916dfc service cinder] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:19.986977 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a28eaab-50ea-4f54-8d54-168672916dfc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:19.993695 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:55:19.997530 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a28eaab-50ea-4f54-8d54-168672916dfc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:19.999011 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a28eaab-50ea-4f54-8d54-168672916dfc service cinder] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:20.008403 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1292/2590] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:55:19 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:55:20.241587 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f23ada-fe0d-4ab9-b86d-089f1de2fd5c None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:20.251956 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f23ada-fe0d-4ab9-b86d-089f1de2fd5c None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:20.255908 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612cf3d7-f673-405e-8821-b6d33753e2fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afbf718dcd9b4741a926b0a2321bd53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:20.260565 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612cf3d7-f673-405e-8821-b6d33753e2fb service cinder] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:20.260565 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612cf3d7-f673-405e-8821-b6d33753e2fb service cinder] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:20.260565 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612cf3d7-f673-405e-8821-b6d33753e2fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:20.326318 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612cf3d7-f673-405e-8821-b6d33753e2fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:20.327980 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612cf3d7-f673-405e-8821-b6d33753e2fb service cinder] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:20.337325 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1299/2591] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:55:20 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:55:25.745796 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14988c4-5257-4045-86bd-f0f4edeaaa7c None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:25.746247 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14988c4-5257-4045-86bd-f0f4edeaaa7c None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:25.746451 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14988c4-5257-4045-86bd-f0f4edeaaa7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:25.764109 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-a14988c4-5257-4045-86bd-f0f4edeaaa7c None None] MFA Rules not processed for user `735d2518c8404bd991acee533b314039`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:55:25.765427 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-a14988c4-5257-4045-86bd-f0f4edeaaa7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:55:25.823249 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1293/2592] 10.222.0.15 () {58 vars in 1009 bytes} [Tue May 31 14:55:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:55:25.835088 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612cf3d7-f673-405e-8821-b6d33753e2fb service cinder] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:25.836532 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-612cf3d7-f673-405e-8821-b6d33753e2fb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:55:25.911611 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612cf3d7-f673-405e-8821-b6d33753e2fb service cinder] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:25.918643 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26728673-8f73-4d16-aa28-40b860468871 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e158f461c66e4d779f23fb7760672897', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:25.919450 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26728673-8f73-4d16-aa28-40b860468871 service swift] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:25.919804 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26728673-8f73-4d16-aa28-40b860468871 service swift] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:25.920149 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26728673-8f73-4d16-aa28-40b860468871 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:25.930718 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26728673-8f73-4d16-aa28-40b860468871 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:25.932788 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26728673-8f73-4d16-aa28-40b860468871 service swift] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:25.944131 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1300/2593] 10.222.0.15 () {60 vars in 1384 bytes} [Tue May 31 14:55:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 31 14:55:27.347669 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14988c4-5257-4045-86bd-f0f4edeaaa7c None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:27.423922 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14988c4-5257-4045-86bd-f0f4edeaaa7c None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:27.429345 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267e05dd-d19b-41bf-8b06-348847096767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:27.431466 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267e05dd-d19b-41bf-8b06-348847096767 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:27.433006 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267e05dd-d19b-41bf-8b06-348847096767 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:27.433472 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267e05dd-d19b-41bf-8b06-348847096767 admin admin] PATH_INFO: `/v3/users/e0d7f7a60d2940bca217788616364bdf` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:27.435047 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267e05dd-d19b-41bf-8b06-348847096767 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0d7f7a60d2940bca217788616364bdf)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:27.437264 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267e05dd-d19b-41bf-8b06-348847096767 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:27.671253 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-267e05dd-d19b-41bf-8b06-348847096767 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0d7f7a60d2940bca217788616364bdf'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:27.690214 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-267e05dd-d19b-41bf-8b06-348847096767 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0d7f7a60d2940bca217788616364bdf'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:27.691141 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-267e05dd-d19b-41bf-8b06-348847096767 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0d7f7a60d2940bca217788616364bdf'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:27.691849 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-267e05dd-d19b-41bf-8b06-348847096767 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0d7f7a60d2940bca217788616364bdf'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:27.716290 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-267e05dd-d19b-41bf-8b06-348847096767 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0d7f7a60d2940bca217788616364bdf'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:27.860021 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1294/2594] 10.222.0.15 () {58 vars in 1223 bytes} [Tue May 31 14:55:27 2022] DELETE /identity/v3/users/e0d7f7a60d2940bca217788616364bdf => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:55:27.865285 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65d9d73-1618-4ff4-9b26-19c0c12d60ea None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:27.865808 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65d9d73-1618-4ff4-9b26-19c0c12d60ea None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:27.865925 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65d9d73-1618-4ff4-9b26-19c0c12d60ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:27.906226 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-c65d9d73-1618-4ff4-9b26-19c0c12d60ea None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:55:27.907810 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-c65d9d73-1618-4ff4-9b26-19c0c12d60ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:55:27.990967 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:55:28.011646 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1301/2595] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:55:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 14:55:28.018417 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267e05dd-d19b-41bf-8b06-348847096767 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:28.020429 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-267e05dd-d19b-41bf-8b06-348847096767 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:55:28.047948 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:55:28.094730 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267e05dd-d19b-41bf-8b06-348847096767 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:28.098242 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a6d889-fd53-460a-a6c9-3707559a3f92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:28.098923 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a6d889-fd53-460a-a6c9-3707559a3f92 service neutron] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:28.099229 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a6d889-fd53-460a-a6c9-3707559a3f92 service neutron] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:28.099505 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a6d889-fd53-460a-a6c9-3707559a3f92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:28.109205 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a6d889-fd53-460a-a6c9-3707559a3f92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:28.110682 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a6d889-fd53-460a-a6c9-3707559a3f92 service neutron] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:28.122622 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1295/2596] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:55:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:55:28.638009 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65d9d73-1618-4ff4-9b26-19c0c12d60ea None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:28.641141 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-c65d9d73-1618-4ff4-9b26-19c0c12d60ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:55:28.662294 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65d9d73-1618-4ff4-9b26-19c0c12d60ea None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:28.667985 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bcbc4d-75dd-4129-847d-65b65e783af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:28.669649 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bcbc4d-75dd-4129-847d-65b65e783af0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:28.670157 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bcbc4d-75dd-4129-847d-65b65e783af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:28.670786 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bcbc4d-75dd-4129-847d-65b65e783af0 admin admin] PATH_INFO: `/v3/projects/8b25044cc8ee4774b64db91c8a30384f` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:28.688449 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bcbc4d-75dd-4129-847d-65b65e783af0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b25044cc8ee4774b64db91c8a30384f)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:28.688449 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bcbc4d-75dd-4129-847d-65b65e783af0 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:28.856525 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-51bcbc4d-75dd-4129-847d-65b65e783af0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b25044cc8ee4774b64db91c8a30384f', 'request_id': 'req-51bcbc4d-75dd-4129-847d-65b65e783af0'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:28.937180 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-51bcbc4d-75dd-4129-847d-65b65e783af0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b25044cc8ee4774b64db91c8a30384f', 'request_id': 'req-51bcbc4d-75dd-4129-847d-65b65e783af0'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:28.952429 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-51bcbc4d-75dd-4129-847d-65b65e783af0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b25044cc8ee4774b64db91c8a30384f', 'request_id': 'req-51bcbc4d-75dd-4129-847d-65b65e783af0'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:28.969464 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-51bcbc4d-75dd-4129-847d-65b65e783af0 admin admin] The token cache is being invalidate because project 8b25044cc8ee4774b64db91c8a30384f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80503) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 14:55:28.969843 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-51bcbc4d-75dd-4129-847d-65b65e783af0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:28.970480 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-51bcbc4d-75dd-4129-847d-65b65e783af0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:28.975265 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1302/2597] 10.222.0.15 () {58 vars in 1232 bytes} [Tue May 31 14:55:28 2022] DELETE /identity/v3/projects/8b25044cc8ee4774b64db91c8a30384f => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:55:28.976694 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a6d889-fd53-460a-a6c9-3707559a3f92 service neutron] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:28.991612 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a6d889-fd53-460a-a6c9-3707559a3f92 service neutron] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:29.142156 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003b1263-0306-4ec6-9379-ca41caaaa27f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:29.143785 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b1263-0306-4ec6-9379-ca41caaaa27f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:29.144268 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b1263-0306-4ec6-9379-ca41caaaa27f admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:29.144759 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b1263-0306-4ec6-9379-ca41caaaa27f admin admin] PATH_INFO: `/v3/users/7493f291b8c84579a48d5026cdeea713` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:29.146407 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003b1263-0306-4ec6-9379-ca41caaaa27f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7493f291b8c84579a48d5026cdeea713)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:29.151935 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003b1263-0306-4ec6-9379-ca41caaaa27f admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:29.345123 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-003b1263-0306-4ec6-9379-ca41caaaa27f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7493f291b8c84579a48d5026cdeea713'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:29.352829 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-003b1263-0306-4ec6-9379-ca41caaaa27f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7493f291b8c84579a48d5026cdeea713'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:29.353623 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-003b1263-0306-4ec6-9379-ca41caaaa27f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7493f291b8c84579a48d5026cdeea713'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:29.355876 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-003b1263-0306-4ec6-9379-ca41caaaa27f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7493f291b8c84579a48d5026cdeea713'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:29.370956 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-003b1263-0306-4ec6-9379-ca41caaaa27f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7493f291b8c84579a48d5026cdeea713'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:29.440467 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1296/2598] 10.222.0.15 () {58 vars in 1223 bytes} [Tue May 31 14:55:28 2022] DELETE /identity/v3/users/7493f291b8c84579a48d5026cdeea713 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:55:29.881224 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bcbc4d-75dd-4129-847d-65b65e783af0 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:29.882819 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-51bcbc4d-75dd-4129-847d-65b65e783af0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:55:29.904457 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bcbc4d-75dd-4129-847d-65b65e783af0 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:29.999627 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d527164-67a8-4f1c-80b2-0f7cffd83c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:30.000606 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d527164-67a8-4f1c-80b2-0f7cffd83c20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:30.000939 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d527164-67a8-4f1c-80b2-0f7cffd83c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:30.001288 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d527164-67a8-4f1c-80b2-0f7cffd83c20 admin admin] PATH_INFO: `/v3/projects/4190009582d34fb3b75a6daa7cedff88` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:30.002702 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d527164-67a8-4f1c-80b2-0f7cffd83c20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4190009582d34fb3b75a6daa7cedff88)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:30.004917 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d527164-67a8-4f1c-80b2-0f7cffd83c20 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:30.140057 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-4d527164-67a8-4f1c-80b2-0f7cffd83c20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4190009582d34fb3b75a6daa7cedff88', 'request_id': 'req-4d527164-67a8-4f1c-80b2-0f7cffd83c20'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:30.200259 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-4d527164-67a8-4f1c-80b2-0f7cffd83c20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4190009582d34fb3b75a6daa7cedff88', 'request_id': 'req-4d527164-67a8-4f1c-80b2-0f7cffd83c20'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:30.208072 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-4d527164-67a8-4f1c-80b2-0f7cffd83c20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4190009582d34fb3b75a6daa7cedff88', 'request_id': 'req-4d527164-67a8-4f1c-80b2-0f7cffd83c20'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:30.228357 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-4d527164-67a8-4f1c-80b2-0f7cffd83c20 admin admin] The token cache is being invalidate because project 4190009582d34fb3b75a6daa7cedff88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80503) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 14:55:30.228771 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-4d527164-67a8-4f1c-80b2-0f7cffd83c20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:30.229932 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-4d527164-67a8-4f1c-80b2-0f7cffd83c20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:30.231642 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1303/2599] 10.222.0.15 () {58 vars in 1232 bytes} [Tue May 31 14:55:29 2022] DELETE /identity/v3/projects/4190009582d34fb3b75a6daa7cedff88 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:55:30.236472 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dca69d-6e21-4587-bc33-af927f275cf2 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:30.236988 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dca69d-6e21-4587-bc33-af927f275cf2 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:30.237096 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dca69d-6e21-4587-bc33-af927f275cf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:30.270632 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-69dca69d-6e21-4587-bc33-af927f275cf2 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:55:30.270632 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-69dca69d-6e21-4587-bc33-af927f275cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:55:30.349361 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:55:30.387027 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1297/2600] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:55:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:55:30.398810 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da5d670-398c-4264-b610-183e45b1c6e4 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:30.398810 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da5d670-398c-4264-b610-183e45b1c6e4 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:30.398810 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da5d670-398c-4264-b610-183e45b1c6e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:30.410515 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:55:30.443270 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-6da5d670-398c-4264-b610-183e45b1c6e4 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:55:30.444508 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-6da5d670-398c-4264-b610-183e45b1c6e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:55:30.459691 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1304/2601] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:55:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:55:30.464489 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dca69d-6e21-4587-bc33-af927f275cf2 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:30.488877 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dca69d-6e21-4587-bc33-af927f275cf2 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:30.495026 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f8ae7c-76c8-41f7-af25-25f5c995e39d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:30.496919 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f8ae7c-76c8-41f7-af25-25f5c995e39d admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:30.507962 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f8ae7c-76c8-41f7-af25-25f5c995e39d admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:30.507962 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f8ae7c-76c8-41f7-af25-25f5c995e39d admin admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:30.507962 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f8ae7c-76c8-41f7-af25-25f5c995e39d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:55:30.507962 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f8ae7c-76c8-41f7-af25-25f5c995e39d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:30.507962 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f8ae7c-76c8-41f7-af25-25f5c995e39d admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:30.521863 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1298/2602] 10.222.0.15 () {58 vars in 1152 bytes} [Tue May 31 14:55:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:55:30.526595 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da5d670-398c-4264-b610-183e45b1c6e4 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:30.537636 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da5d670-398c-4264-b610-183e45b1c6e4 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:30.543178 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054d85ad-dad8-41de-be3d-b9d23c082630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:30.543883 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054d85ad-dad8-41de-be3d-b9d23c082630 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:30.544184 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054d85ad-dad8-41de-be3d-b9d23c082630 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:30.544468 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054d85ad-dad8-41de-be3d-b9d23c082630 admin admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:30.548258 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054d85ad-dad8-41de-be3d-b9d23c082630 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:30.548258 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054d85ad-dad8-41de-be3d-b9d23c082630 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:30.633006 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1305/2603] 10.222.0.15 () {60 vars in 1152 bytes} [Tue May 31 14:55:30 2022] POST /identity/v3/projects => generated 385 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:55:30.639654 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f8ae7c-76c8-41f7-af25-25f5c995e39d admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:30.649669 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f8ae7c-76c8-41f7-af25-25f5c995e39d admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:30.715963 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fe66f2-340f-4a98-8e0e-d6ae2c7cb581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:30.716639 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe66f2-340f-4a98-8e0e-d6ae2c7cb581 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:30.716921 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe66f2-340f-4a98-8e0e-d6ae2c7cb581 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:30.717195 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe66f2-340f-4a98-8e0e-d6ae2c7cb581 admin admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:30.717885 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fe66f2-340f-4a98-8e0e-d6ae2c7cb581 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:30.719844 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fe66f2-340f-4a98-8e0e-d6ae2c7cb581 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:30.800699 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1299/2604] 10.222.0.15 () {60 vars in 1143 bytes} [Tue May 31 14:55:30 2022] POST /identity/v3/users => generated 293 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:55:30.805103 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054d85ad-dad8-41de-be3d-b9d23c082630 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:30.817763 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054d85ad-dad8-41de-be3d-b9d23c082630 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:30.824135 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b68950-b0b6-4d97-98d7-b6402f360d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:30.824837 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b68950-b0b6-4d97-98d7-b6402f360d73 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:30.825346 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b68950-b0b6-4d97-98d7-b6402f360d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:30.825520 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b68950-b0b6-4d97-98d7-b6402f360d73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:30.826176 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b68950-b0b6-4d97-98d7-b6402f360d73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:30.827946 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b68950-b0b6-4d97-98d7-b6402f360d73 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:30.841742 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1306/2605] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:55:30 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:55:30.845763 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fe66f2-340f-4a98-8e0e-d6ae2c7cb581 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:30.860002 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fe66f2-340f-4a98-8e0e-d6ae2c7cb581 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:30.862682 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c48062a-6f2e-46db-bdc7-11a056fb5d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:30.863574 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c48062a-6f2e-46db-bdc7-11a056fb5d6e admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:30.863934 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c48062a-6f2e-46db-bdc7-11a056fb5d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:30.864363 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c48062a-6f2e-46db-bdc7-11a056fb5d6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:30.865099 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c48062a-6f2e-46db-bdc7-11a056fb5d6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:30.866748 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c48062a-6f2e-46db-bdc7-11a056fb5d6e admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:30.878616 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1300/2606] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:55:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:55:30.884101 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b68950-b0b6-4d97-98d7-b6402f360d73 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:30.898409 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b68950-b0b6-4d97-98d7-b6402f360d73 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:30.903599 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58974634-f9ee-4324-b5d0-f78e9c5b5414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:30.904447 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58974634-f9ee-4324-b5d0-f78e9c5b5414 admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:30.904728 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58974634-f9ee-4324-b5d0-f78e9c5b5414 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:30.904981 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58974634-f9ee-4324-b5d0-f78e9c5b5414 admin admin] PATH_INFO: `/v3/projects/93adca62dfa14b4c88b77b0759a58633/users/0740cc67c03142cdad796f37ed3c2044/roles/317f725e26bf43648d8235bb1f7c4cb3` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:30.922203 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58974634-f9ee-4324-b5d0-f78e9c5b5414 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93adca62dfa14b4c88b77b0759a58633, user_id=0740cc67c03142cdad796f37ed3c2044, role_id=317f725e26bf43648d8235bb1f7c4cb3)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:30.925409 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58974634-f9ee-4324-b5d0-f78e9c5b5414 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:31.023301 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1307/2607] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:55:30 2022] PUT /identity/v3/projects/93adca62dfa14b4c88b77b0759a58633/users/0740cc67c03142cdad796f37ed3c2044/roles/317f725e26bf43648d8235bb1f7c4cb3 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 14:55:31.034085 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a751f0-2677-4526-a72f-e6bddbcfba33 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:31.034373 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a751f0-2677-4526-a72f-e6bddbcfba33 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:31.034681 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a751f0-2677-4526-a72f-e6bddbcfba33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:31.073748 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-47a751f0-2677-4526-a72f-e6bddbcfba33 None None] MFA Rules not processed for user `0740cc67c03142cdad796f37ed3c2044`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:55:31.075020 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-47a751f0-2677-4526-a72f-e6bddbcfba33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:55:31.154015 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1301/2608] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:55:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:55:31.159273 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58974634-f9ee-4324-b5d0-f78e9c5b5414 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:31.236874 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58974634-f9ee-4324-b5d0-f78e9c5b5414 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:31.241689 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20978be-ba84-41d8-9704-4e8723863713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:31.242487 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20978be-ba84-41d8-9704-4e8723863713 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:31.242841 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20978be-ba84-41d8-9704-4e8723863713 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:31.243120 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20978be-ba84-41d8-9704-4e8723863713 admin admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:31.243822 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20978be-ba84-41d8-9704-4e8723863713 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:31.246343 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20978be-ba84-41d8-9704-4e8723863713 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:31.351431 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a751f0-2677-4526-a72f-e6bddbcfba33 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:31.353161 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1308/2609] 10.222.0.15 () {60 vars in 1152 bytes} [Tue May 31 14:55:31 2022] POST /identity/v3/projects => generated 385 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 14:55:31.363225 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a751f0-2677-4526-a72f-e6bddbcfba33 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:31.413651 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:55:31.465126 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9012fb-49d1-4034-96f7-334df90731ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:31.465843 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9012fb-49d1-4034-96f7-334df90731ef admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:31.466195 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9012fb-49d1-4034-96f7-334df90731ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:31.466533 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9012fb-49d1-4034-96f7-334df90731ef admin admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:31.467428 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9012fb-49d1-4034-96f7-334df90731ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:31.479377 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9012fb-49d1-4034-96f7-334df90731ef admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:31.603894 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1302/2610] 10.222.0.15 () {60 vars in 1143 bytes} [Tue May 31 14:55:31 2022] POST /identity/v3/users => generated 299 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 14:55:31.605266 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20978be-ba84-41d8-9704-4e8723863713 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:31.617242 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20978be-ba84-41d8-9704-4e8723863713 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:31.628949 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d1fc63-3947-48b2-8256-6f4512e665cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:31.629606 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d1fc63-3947-48b2-8256-6f4512e665cd admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:31.635210 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d1fc63-3947-48b2-8256-6f4512e665cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:31.635696 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d1fc63-3947-48b2-8256-6f4512e665cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:31.636492 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d1fc63-3947-48b2-8256-6f4512e665cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:31.638126 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d1fc63-3947-48b2-8256-6f4512e665cd admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:31.668490 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1309/2611] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:55:31 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 14:55:31.671601 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9012fb-49d1-4034-96f7-334df90731ef admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:31.683036 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9012fb-49d1-4034-96f7-334df90731ef admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:31.689415 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40089bf8-8561-438e-8966-2a53924ae395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:31.690347 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40089bf8-8561-438e-8966-2a53924ae395 admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:31.690688 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40089bf8-8561-438e-8966-2a53924ae395 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:31.690971 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40089bf8-8561-438e-8966-2a53924ae395 admin admin] PATH_INFO: `/v3/projects/ab2e075fd79247dbacfc35970c4d6746/users/173434719efe4a4b99609b43e07dc146/roles/76c53e2c353644f885028a0226c06146` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:31.716117 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40089bf8-8561-438e-8966-2a53924ae395 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab2e075fd79247dbacfc35970c4d6746, user_id=173434719efe4a4b99609b43e07dc146, role_id=76c53e2c353644f885028a0226c06146)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:31.719015 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40089bf8-8561-438e-8966-2a53924ae395 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:31.858359 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1303/2612] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:55:31 2022] PUT /identity/v3/projects/ab2e075fd79247dbacfc35970c4d6746/users/173434719efe4a4b99609b43e07dc146/roles/76c53e2c353644f885028a0226c06146 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:55:31.863071 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d1fc63-3947-48b2-8256-6f4512e665cd admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:31.881866 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d1fc63-3947-48b2-8256-6f4512e665cd admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:31.944850 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dea15a-d20c-4674-9d5c-5657782b3e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:31.945439 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dea15a-d20c-4674-9d5c-5657782b3e5d admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:31.945721 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dea15a-d20c-4674-9d5c-5657782b3e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:31.945995 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dea15a-d20c-4674-9d5c-5657782b3e5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:31.946746 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dea15a-d20c-4674-9d5c-5657782b3e5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:31.949003 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dea15a-d20c-4674-9d5c-5657782b3e5d admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:31.954650 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:55:31.959923 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1310/2613] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:55:31 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:55:31.964929 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40089bf8-8561-438e-8966-2a53924ae395 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:31.976621 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40089bf8-8561-438e-8966-2a53924ae395 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:31.981935 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d25aa9a-c03c-4325-a03a-40b5595a0b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:31.982864 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d25aa9a-c03c-4325-a03a-40b5595a0b77 admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:31.983149 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d25aa9a-c03c-4325-a03a-40b5595a0b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:31.983425 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d25aa9a-c03c-4325-a03a-40b5595a0b77 admin admin] PATH_INFO: `/v3/projects/ab2e075fd79247dbacfc35970c4d6746/users/173434719efe4a4b99609b43e07dc146/roles/76c53e2c353644f885028a0226c06146` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:31.985388 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d25aa9a-c03c-4325-a03a-40b5595a0b77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab2e075fd79247dbacfc35970c4d6746, user_id=173434719efe4a4b99609b43e07dc146, role_id=76c53e2c353644f885028a0226c06146)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:31.988385 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d25aa9a-c03c-4325-a03a-40b5595a0b77 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:32.000242 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1304/2614] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:55:31 2022] PUT /identity/v3/projects/ab2e075fd79247dbacfc35970c4d6746/users/173434719efe4a4b99609b43e07dc146/roles/76c53e2c353644f885028a0226c06146 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:55:32.012813 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ef5e6c-1521-48e9-a547-048169b3497f None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:32.013101 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ef5e6c-1521-48e9-a547-048169b3497f None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:32.013381 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ef5e6c-1521-48e9-a547-048169b3497f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:32.042925 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-99ef5e6c-1521-48e9-a547-048169b3497f None None] MFA Rules not processed for user `173434719efe4a4b99609b43e07dc146`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:55:32.044311 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-99ef5e6c-1521-48e9-a547-048169b3497f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:55:32.136955 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1311/2615] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:55:32 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:55:32.158976 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d25aa9a-c03c-4325-a03a-40b5595a0b77 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:32.160961 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-3d25aa9a-c03c-4325-a03a-40b5595a0b77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:55:32.240753 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d25aa9a-c03c-4325-a03a-40b5595a0b77 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:32.245134 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186793e5-a207-478d-8f6b-93710005f7df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afbf718dcd9b4741a926b0a2321bd53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:32.245836 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186793e5-a207-478d-8f6b-93710005f7df service cinder] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:32.246272 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186793e5-a207-478d-8f6b-93710005f7df service cinder] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:32.246731 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186793e5-a207-478d-8f6b-93710005f7df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:32.258370 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186793e5-a207-478d-8f6b-93710005f7df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:32.259995 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186793e5-a207-478d-8f6b-93710005f7df service cinder] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:32.270847 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1305/2616] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:55:32 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 14:55:34.762988 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ef5e6c-1521-48e9-a547-048169b3497f None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:34.824777 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ef5e6c-1521-48e9-a547-048169b3497f None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:34.829230 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aad908-9228-4ea2-bf7e-befbf4a2363e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:34.830092 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aad908-9228-4ea2-bf7e-befbf4a2363e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:34.830380 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aad908-9228-4ea2-bf7e-befbf4a2363e admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:34.830694 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aad908-9228-4ea2-bf7e-befbf4a2363e admin admin] PATH_INFO: `/v3/users/0740cc67c03142cdad796f37ed3c2044` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:34.831873 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aad908-9228-4ea2-bf7e-befbf4a2363e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0740cc67c03142cdad796f37ed3c2044)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:34.833962 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aad908-9228-4ea2-bf7e-befbf4a2363e admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:35.014708 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-f2aad908-9228-4ea2-bf7e-befbf4a2363e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0740cc67c03142cdad796f37ed3c2044'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:35.125239 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-f2aad908-9228-4ea2-bf7e-befbf4a2363e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0740cc67c03142cdad796f37ed3c2044'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:35.125859 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-f2aad908-9228-4ea2-bf7e-befbf4a2363e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0740cc67c03142cdad796f37ed3c2044'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:35.133263 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-f2aad908-9228-4ea2-bf7e-befbf4a2363e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0740cc67c03142cdad796f37ed3c2044'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:35.133907 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-f2aad908-9228-4ea2-bf7e-befbf4a2363e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0740cc67c03142cdad796f37ed3c2044'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:35.151282 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1312/2617] 10.222.0.15 () {58 vars in 1223 bytes} [Tue May 31 14:55:34 2022] DELETE /identity/v3/users/0740cc67c03142cdad796f37ed3c2044 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:55:35.156384 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009e14cd-82b7-4569-87a1-01dc18a285ab None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:35.156843 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009e14cd-82b7-4569-87a1-01dc18a285ab None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:35.156964 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009e14cd-82b7-4569-87a1-01dc18a285ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:35.175745 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-009e14cd-82b7-4569-87a1-01dc18a285ab None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:55:35.176960 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-009e14cd-82b7-4569-87a1-01dc18a285ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:55:35.239127 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1306/2618] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:55:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:55:35.250770 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aad908-9228-4ea2-bf7e-befbf4a2363e admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:35.252173 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-f2aad908-9228-4ea2-bf7e-befbf4a2363e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:55:35.258533 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:55:35.311933 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aad908-9228-4ea2-bf7e-befbf4a2363e admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:35.315945 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65833499-4b88-4452-8966-05dfbc5d74e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:35.319852 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65833499-4b88-4452-8966-05dfbc5d74e0 service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:35.319852 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65833499-4b88-4452-8966-05dfbc5d74e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:35.319852 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65833499-4b88-4452-8966-05dfbc5d74e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:35.327229 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65833499-4b88-4452-8966-05dfbc5d74e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:35.328653 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65833499-4b88-4452-8966-05dfbc5d74e0 service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:35.337906 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1313/2619] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:55:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:55:35.847133 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009e14cd-82b7-4569-87a1-01dc18a285ab None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:35.848806 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-009e14cd-82b7-4569-87a1-01dc18a285ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:55:35.861867 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009e14cd-82b7-4569-87a1-01dc18a285ab None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:35.866694 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d690cac-9f99-473e-9a53-c7970398a39c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:35.867541 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d690cac-9f99-473e-9a53-c7970398a39c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:35.867823 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d690cac-9f99-473e-9a53-c7970398a39c admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:35.868101 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d690cac-9f99-473e-9a53-c7970398a39c admin admin] PATH_INFO: `/v3/projects/93adca62dfa14b4c88b77b0759a58633` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:35.869314 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d690cac-9f99-473e-9a53-c7970398a39c admin admin] RBAC: Authorizing `identity:delete_project(project_id=93adca62dfa14b4c88b77b0759a58633)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:35.871989 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d690cac-9f99-473e-9a53-c7970398a39c admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:36.007292 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:55:36.024970 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-6d690cac-9f99-473e-9a53-c7970398a39c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93adca62dfa14b4c88b77b0759a58633', 'request_id': 'req-6d690cac-9f99-473e-9a53-c7970398a39c'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:36.031504 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-6d690cac-9f99-473e-9a53-c7970398a39c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93adca62dfa14b4c88b77b0759a58633', 'request_id': 'req-6d690cac-9f99-473e-9a53-c7970398a39c'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:36.148743 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-6d690cac-9f99-473e-9a53-c7970398a39c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93adca62dfa14b4c88b77b0759a58633', 'request_id': 'req-6d690cac-9f99-473e-9a53-c7970398a39c'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:36.162712 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-6d690cac-9f99-473e-9a53-c7970398a39c admin admin] The token cache is being invalidate because project 93adca62dfa14b4c88b77b0759a58633 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 14:55:36.164989 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-6d690cac-9f99-473e-9a53-c7970398a39c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:36.164989 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-6d690cac-9f99-473e-9a53-c7970398a39c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:36.165339 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1307/2620] 10.222.0.15 () {58 vars in 1232 bytes} [Tue May 31 14:55:35 2022] DELETE /identity/v3/projects/93adca62dfa14b4c88b77b0759a58633 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:55:36.171449 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65833499-4b88-4452-8966-05dfbc5d74e0 service neutron] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:36.184065 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65833499-4b88-4452-8966-05dfbc5d74e0 service neutron] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:36.268991 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f04631-9307-4a34-826b-eea614a54808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:36.269866 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f04631-9307-4a34-826b-eea614a54808 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:36.270142 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f04631-9307-4a34-826b-eea614a54808 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:36.270443 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f04631-9307-4a34-826b-eea614a54808 admin admin] PATH_INFO: `/v3/users/173434719efe4a4b99609b43e07dc146` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:36.271695 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f04631-9307-4a34-826b-eea614a54808 admin admin] RBAC: Authorizing `identity:delete_user(user_id=173434719efe4a4b99609b43e07dc146)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:36.273696 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f04631-9307-4a34-826b-eea614a54808 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:36.454824 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-02f04631-9307-4a34-826b-eea614a54808 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '173434719efe4a4b99609b43e07dc146'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:36.536886 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-02f04631-9307-4a34-826b-eea614a54808 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '173434719efe4a4b99609b43e07dc146'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:36.537622 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-02f04631-9307-4a34-826b-eea614a54808 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '173434719efe4a4b99609b43e07dc146'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:36.546051 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-02f04631-9307-4a34-826b-eea614a54808 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '173434719efe4a4b99609b43e07dc146'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:36.547023 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-02f04631-9307-4a34-826b-eea614a54808 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '173434719efe4a4b99609b43e07dc146'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:36.570345 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1314/2621] 10.222.0.15 () {58 vars in 1223 bytes} [Tue May 31 14:55:36 2022] DELETE /identity/v3/users/173434719efe4a4b99609b43e07dc146 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:55:36.990208 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d690cac-9f99-473e-9a53-c7970398a39c admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:36.991805 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-6d690cac-9f99-473e-9a53-c7970398a39c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:55:37.006809 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d690cac-9f99-473e-9a53-c7970398a39c admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:37.065671 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085fa25d-3e86-47ac-ad80-1cd33c8ac200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:37.066545 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085fa25d-3e86-47ac-ad80-1cd33c8ac200 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:37.066864 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085fa25d-3e86-47ac-ad80-1cd33c8ac200 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:37.067247 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085fa25d-3e86-47ac-ad80-1cd33c8ac200 admin admin] PATH_INFO: `/v3/projects/ab2e075fd79247dbacfc35970c4d6746` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:37.068453 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085fa25d-3e86-47ac-ad80-1cd33c8ac200 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab2e075fd79247dbacfc35970c4d6746)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:37.070370 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085fa25d-3e86-47ac-ad80-1cd33c8ac200 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:37.184565 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-085fa25d-3e86-47ac-ad80-1cd33c8ac200 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab2e075fd79247dbacfc35970c4d6746', 'request_id': 'req-085fa25d-3e86-47ac-ad80-1cd33c8ac200'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:37.191082 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-085fa25d-3e86-47ac-ad80-1cd33c8ac200 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab2e075fd79247dbacfc35970c4d6746', 'request_id': 'req-085fa25d-3e86-47ac-ad80-1cd33c8ac200'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:37.267646 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-085fa25d-3e86-47ac-ad80-1cd33c8ac200 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab2e075fd79247dbacfc35970c4d6746', 'request_id': 'req-085fa25d-3e86-47ac-ad80-1cd33c8ac200'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:37.279850 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-085fa25d-3e86-47ac-ad80-1cd33c8ac200 admin admin] The token cache is being invalidate because project ab2e075fd79247dbacfc35970c4d6746 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 14:55:37.280146 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-085fa25d-3e86-47ac-ad80-1cd33c8ac200 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:37.280821 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-085fa25d-3e86-47ac-ad80-1cd33c8ac200 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:37.282967 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1308/2622] 10.222.0.15 () {58 vars in 1232 bytes} [Tue May 31 14:55:36 2022] DELETE /identity/v3/projects/ab2e075fd79247dbacfc35970c4d6746 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:55:37.287946 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018da51b-5387-4bbb-95f9-a2b745d6c7b6 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:37.288508 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018da51b-5387-4bbb-95f9-a2b745d6c7b6 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:37.288508 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018da51b-5387-4bbb-95f9-a2b745d6c7b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:37.318137 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-018da51b-5387-4bbb-95f9-a2b745d6c7b6 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:55:37.319386 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-018da51b-5387-4bbb-95f9-a2b745d6c7b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:55:37.340603 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:55:37.384572 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1315/2623] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:55:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:55:37.392361 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f1d27-c5db-4699-9f90-cc8d1260b185 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:37.392784 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f1d27-c5db-4699-9f90-cc8d1260b185 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:37.393072 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f1d27-c5db-4699-9f90-cc8d1260b185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:37.412710 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-d85f1d27-c5db-4699-9f90-cc8d1260b185 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:55:37.413922 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-d85f1d27-c5db-4699-9f90-cc8d1260b185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:55:37.422938 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1309/2624] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:55:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:55:37.427363 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018da51b-5387-4bbb-95f9-a2b745d6c7b6 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:37.437555 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018da51b-5387-4bbb-95f9-a2b745d6c7b6 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:37.442214 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b63202-6b5f-4833-af0e-14e8554f19e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:37.443068 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b63202-6b5f-4833-af0e-14e8554f19e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:37.443495 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b63202-6b5f-4833-af0e-14e8554f19e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:37.443819 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b63202-6b5f-4833-af0e-14e8554f19e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:37.444610 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b63202-6b5f-4833-af0e-14e8554f19e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:55:37.444981 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b63202-6b5f-4833-af0e-14e8554f19e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:37.447788 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b63202-6b5f-4833-af0e-14e8554f19e7 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:37.467493 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1316/2625] 10.222.0.15 () {58 vars in 1152 bytes} [Tue May 31 14:55:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 31 14:55:37.468794 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85f1d27-c5db-4699-9f90-cc8d1260b185 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:37.478573 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85f1d27-c5db-4699-9f90-cc8d1260b185 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:37.484200 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829011d5-f277-49f7-a4ac-8ccac2682262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:37.484951 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829011d5-f277-49f7-a4ac-8ccac2682262 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:37.485305 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829011d5-f277-49f7-a4ac-8ccac2682262 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:37.485654 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829011d5-f277-49f7-a4ac-8ccac2682262 admin admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:37.486422 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829011d5-f277-49f7-a4ac-8ccac2682262 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:37.488459 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829011d5-f277-49f7-a4ac-8ccac2682262 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:37.576178 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1310/2626] 10.222.0.15 () {60 vars in 1152 bytes} [Tue May 31 14:55:37 2022] POST /identity/v3/projects => generated 371 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:55:37.577992 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b63202-6b5f-4833-af0e-14e8554f19e7 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:37.588866 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b63202-6b5f-4833-af0e-14e8554f19e7 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:37.657307 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0019eb41-ff56-49c4-9b75-d81e4aea932f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:37.658144 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0019eb41-ff56-49c4-9b75-d81e4aea932f admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:37.658430 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0019eb41-ff56-49c4-9b75-d81e4aea932f admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:37.658810 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0019eb41-ff56-49c4-9b75-d81e4aea932f admin admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:37.659549 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0019eb41-ff56-49c4-9b75-d81e4aea932f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:37.661746 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0019eb41-ff56-49c4-9b75-d81e4aea932f admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:37.786028 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1317/2627] 10.222.0.15 () {60 vars in 1143 bytes} [Tue May 31 14:55:37 2022] POST /identity/v3/users => generated 286 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:55:37.790012 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829011d5-f277-49f7-a4ac-8ccac2682262 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:37.801019 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829011d5-f277-49f7-a4ac-8ccac2682262 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:37.805749 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f251659-c499-4b55-ab23-133c5ae5f5ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:37.806418 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f251659-c499-4b55-ab23-133c5ae5f5ce admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:37.806752 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f251659-c499-4b55-ab23-133c5ae5f5ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:37.807026 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f251659-c499-4b55-ab23-133c5ae5f5ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:37.807774 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f251659-c499-4b55-ab23-133c5ae5f5ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:37.809357 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f251659-c499-4b55-ab23-133c5ae5f5ce admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:37.821539 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1311/2628] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:55:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 14:55:37.826320 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0019eb41-ff56-49c4-9b75-d81e4aea932f admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:37.836789 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0019eb41-ff56-49c4-9b75-d81e4aea932f admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:37.842143 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823e7830-27dc-468a-b1bb-340225352663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:37.842838 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e7830-27dc-468a-b1bb-340225352663 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:37.843134 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e7830-27dc-468a-b1bb-340225352663 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:37.843462 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e7830-27dc-468a-b1bb-340225352663 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:37.844231 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823e7830-27dc-468a-b1bb-340225352663 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:37.845843 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823e7830-27dc-468a-b1bb-340225352663 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:37.856619 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1318/2629] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:55:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:55:37.861157 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f251659-c499-4b55-ab23-133c5ae5f5ce admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:37.867940 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:55:37.871940 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f251659-c499-4b55-ab23-133c5ae5f5ce admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:37.876509 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b013ac18-0661-472d-b341-930ad76c83fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:37.877399 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b013ac18-0661-472d-b341-930ad76c83fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:37.877715 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b013ac18-0661-472d-b341-930ad76c83fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:37.877989 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b013ac18-0661-472d-b341-930ad76c83fd admin admin] PATH_INFO: `/v3/projects/49798b67f5634e22931935a466279297/users/b8a40b34ce86452ab2f77b7b019463f6/roles/317f725e26bf43648d8235bb1f7c4cb3` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:37.894034 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b013ac18-0661-472d-b341-930ad76c83fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=49798b67f5634e22931935a466279297, user_id=b8a40b34ce86452ab2f77b7b019463f6, role_id=317f725e26bf43648d8235bb1f7c4cb3)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:37.896708 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b013ac18-0661-472d-b341-930ad76c83fd admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:38.012365 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1312/2630] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:55:37 2022] PUT /identity/v3/projects/49798b67f5634e22931935a466279297/users/b8a40b34ce86452ab2f77b7b019463f6/roles/317f725e26bf43648d8235bb1f7c4cb3 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:55:38.022812 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8820f0fe-e657-4871-8a58-9b2c5097e6f6 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:38.026790 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8820f0fe-e657-4871-8a58-9b2c5097e6f6 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:38.026790 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8820f0fe-e657-4871-8a58-9b2c5097e6f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:38.053817 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-8820f0fe-e657-4871-8a58-9b2c5097e6f6 None None] MFA Rules not processed for user `b8a40b34ce86452ab2f77b7b019463f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:55:38.057802 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-8820f0fe-e657-4871-8a58-9b2c5097e6f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:55:38.126256 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1319/2631] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:55:38 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:55:38.137637 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b013ac18-0661-472d-b341-930ad76c83fd admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:38.139342 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-b013ac18-0661-472d-b341-930ad76c83fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:55:38.200039 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b013ac18-0661-472d-b341-930ad76c83fd admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:38.204134 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87b5fb6-4cdb-4fd8-8689-b9cbdc554f1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afbf718dcd9b4741a926b0a2321bd53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:38.204934 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87b5fb6-4cdb-4fd8-8689-b9cbdc554f1c service cinder] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:38.205223 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87b5fb6-4cdb-4fd8-8689-b9cbdc554f1c service cinder] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:38.205505 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87b5fb6-4cdb-4fd8-8689-b9cbdc554f1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:38.214097 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87b5fb6-4cdb-4fd8-8689-b9cbdc554f1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:38.215572 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87b5fb6-4cdb-4fd8-8689-b9cbdc554f1c service cinder] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:38.224226 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1313/2632] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:55:38 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:55:38.242938 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8820f0fe-e657-4871-8a58-9b2c5097e6f6 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:38.274298 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:55:38.314266 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8820f0fe-e657-4871-8a58-9b2c5097e6f6 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:38.320483 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0c3bfa-2d49-470a-b5a8-42fdc394eca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:38.321424 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0c3bfa-2d49-470a-b5a8-42fdc394eca6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:38.321709 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0c3bfa-2d49-470a-b5a8-42fdc394eca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:38.321980 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0c3bfa-2d49-470a-b5a8-42fdc394eca6 admin admin] PATH_INFO: `/v3/users/b8a40b34ce86452ab2f77b7b019463f6` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:38.323210 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0c3bfa-2d49-470a-b5a8-42fdc394eca6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8a40b34ce86452ab2f77b7b019463f6)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:38.325709 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0c3bfa-2d49-470a-b5a8-42fdc394eca6 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:38.648229 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-8f0c3bfa-2d49-470a-b5a8-42fdc394eca6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8a40b34ce86452ab2f77b7b019463f6'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:38.737298 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-8f0c3bfa-2d49-470a-b5a8-42fdc394eca6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8a40b34ce86452ab2f77b7b019463f6'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:38.737951 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-8f0c3bfa-2d49-470a-b5a8-42fdc394eca6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8a40b34ce86452ab2f77b7b019463f6'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:38.750008 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-8f0c3bfa-2d49-470a-b5a8-42fdc394eca6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8a40b34ce86452ab2f77b7b019463f6'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:38.750008 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-8f0c3bfa-2d49-470a-b5a8-42fdc394eca6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8a40b34ce86452ab2f77b7b019463f6'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:38.768128 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1320/2633] 10.222.0.15 () {58 vars in 1223 bytes} [Tue May 31 14:55:38 2022] DELETE /identity/v3/users/b8a40b34ce86452ab2f77b7b019463f6 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:55:38.772910 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb59f01a-1227-4596-851e-6d525cbd99e7 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:38.773204 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb59f01a-1227-4596-851e-6d525cbd99e7 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:38.773488 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb59f01a-1227-4596-851e-6d525cbd99e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:38.797510 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-fb59f01a-1227-4596-851e-6d525cbd99e7 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:55:38.798774 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-fb59f01a-1227-4596-851e-6d525cbd99e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:55:38.862061 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1314/2634] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:55:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:55:38.872706 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0c3bfa-2d49-470a-b5a8-42fdc394eca6 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:38.874192 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-8f0c3bfa-2d49-470a-b5a8-42fdc394eca6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:55:38.933474 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0c3bfa-2d49-470a-b5a8-42fdc394eca6 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:38.937208 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f20e99-1aea-4b41-93e6-f68263886271 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:38.938111 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f20e99-1aea-4b41-93e6-f68263886271 service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:38.938397 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f20e99-1aea-4b41-93e6-f68263886271 service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:38.938713 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f20e99-1aea-4b41-93e6-f68263886271 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:38.948294 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f20e99-1aea-4b41-93e6-f68263886271 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:38.949866 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f20e99-1aea-4b41-93e6-f68263886271 service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:38.959580 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1321/2635] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:55:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:55:39.543743 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb59f01a-1227-4596-851e-6d525cbd99e7 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:39.545355 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-fb59f01a-1227-4596-851e-6d525cbd99e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:55:39.558193 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb59f01a-1227-4596-851e-6d525cbd99e7 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:39.563292 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b950fb62-8961-4859-8800-4ab1acdcd115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:39.566263 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b950fb62-8961-4859-8800-4ab1acdcd115 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:39.566263 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b950fb62-8961-4859-8800-4ab1acdcd115 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:39.566263 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b950fb62-8961-4859-8800-4ab1acdcd115 admin admin] PATH_INFO: `/v3/projects/49798b67f5634e22931935a466279297` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:39.566263 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b950fb62-8961-4859-8800-4ab1acdcd115 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49798b67f5634e22931935a466279297)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:39.568663 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b950fb62-8961-4859-8800-4ab1acdcd115 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:39.701137 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-b950fb62-8961-4859-8800-4ab1acdcd115 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49798b67f5634e22931935a466279297', 'request_id': 'req-b950fb62-8961-4859-8800-4ab1acdcd115'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:39.711668 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-b950fb62-8961-4859-8800-4ab1acdcd115 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49798b67f5634e22931935a466279297', 'request_id': 'req-b950fb62-8961-4859-8800-4ab1acdcd115'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:39.788810 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-b950fb62-8961-4859-8800-4ab1acdcd115 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49798b67f5634e22931935a466279297', 'request_id': 'req-b950fb62-8961-4859-8800-4ab1acdcd115'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:39.802316 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-b950fb62-8961-4859-8800-4ab1acdcd115 admin admin] The token cache is being invalidate because project 49798b67f5634e22931935a466279297 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 14:55:39.802656 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-b950fb62-8961-4859-8800-4ab1acdcd115 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:39.803324 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-b950fb62-8961-4859-8800-4ab1acdcd115 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:39.804891 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1315/2636] 10.222.0.15 () {58 vars in 1232 bytes} [Tue May 31 14:55:39 2022] DELETE /identity/v3/projects/49798b67f5634e22931935a466279297 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 14:55:39.810660 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ec455-7aa1-4231-a6e6-0a884ae97552 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:39.811153 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ec455-7aa1-4231-a6e6-0a884ae97552 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:39.811303 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ec455-7aa1-4231-a6e6-0a884ae97552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:39.832731 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-465ec455-7aa1-4231-a6e6-0a884ae97552 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:55:39.834593 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-465ec455-7aa1-4231-a6e6-0a884ae97552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:55:39.894950 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:55:39.907417 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1322/2637] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:55:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:55:39.920492 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00efa4d5-d677-4663-b424-abdf1c8ab29d None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:39.920786 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00efa4d5-d677-4663-b424-abdf1c8ab29d None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:39.921072 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00efa4d5-d677-4663-b424-abdf1c8ab29d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:39.934220 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:55:39.941488 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-00efa4d5-d677-4663-b424-abdf1c8ab29d None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:55:39.944571 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-00efa4d5-d677-4663-b424-abdf1c8ab29d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:55:39.953517 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1316/2638] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:55:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:55:39.957771 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465ec455-7aa1-4231-a6e6-0a884ae97552 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:39.960440 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00efa4d5-d677-4663-b424-abdf1c8ab29d None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:39.961745 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-00efa4d5-d677-4663-b424-abdf1c8ab29d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:55:39.968364 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465ec455-7aa1-4231-a6e6-0a884ae97552 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:39.973066 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8a866d-4e56-4adb-bbab-4338dc73f8ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:39.973735 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8a866d-4e56-4adb-bbab-4338dc73f8ae admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:39.974016 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8a866d-4e56-4adb-bbab-4338dc73f8ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:39.974291 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8a866d-4e56-4adb-bbab-4338dc73f8ae admin admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:39.975053 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8a866d-4e56-4adb-bbab-4338dc73f8ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:55:39.981619 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8a866d-4e56-4adb-bbab-4338dc73f8ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:39.981619 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8a866d-4e56-4adb-bbab-4338dc73f8ae admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:39.989603 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1323/2639] 10.222.0.15 () {58 vars in 1152 bytes} [Tue May 31 14:55:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:55:39.993991 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8a866d-4e56-4adb-bbab-4338dc73f8ae admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:40.004148 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8a866d-4e56-4adb-bbab-4338dc73f8ae admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:40.008826 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0659c2f6-50a8-44f9-b71d-56b468048155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:40.009472 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0659c2f6-50a8-44f9-b71d-56b468048155 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:40.009755 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0659c2f6-50a8-44f9-b71d-56b468048155 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:40.010034 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0659c2f6-50a8-44f9-b71d-56b468048155 admin admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:40.010756 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0659c2f6-50a8-44f9-b71d-56b468048155 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:40.013359 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0659c2f6-50a8-44f9-b71d-56b468048155 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:40.024405 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00efa4d5-d677-4663-b424-abdf1c8ab29d None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:40.028897 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7819e75f-8900-48ff-aaee-546c18174114 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afbf718dcd9b4741a926b0a2321bd53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:40.029588 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7819e75f-8900-48ff-aaee-546c18174114 service cinder] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:40.029872 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7819e75f-8900-48ff-aaee-546c18174114 service cinder] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:40.030150 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7819e75f-8900-48ff-aaee-546c18174114 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:40.032217 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-7819e75f-8900-48ff-aaee-546c18174114 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:55:40.110477 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7819e75f-8900-48ff-aaee-546c18174114 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:40.111382 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1324/2640] 10.222.0.15 () {60 vars in 1152 bytes} [Tue May 31 14:55:39 2022] POST /identity/v3/projects => generated 375 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 14:55:40.115180 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7819e75f-8900-48ff-aaee-546c18174114 service cinder] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:40.115378 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0659c2f6-50a8-44f9-b71d-56b468048155 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:40.126418 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1317/2641] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:55:39 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 14:55:40.184126 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0659c2f6-50a8-44f9-b71d-56b468048155 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:40.189884 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd98e3a-ac5d-4544-b57a-50d755558604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:40.190589 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd98e3a-ac5d-4544-b57a-50d755558604 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:40.190875 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd98e3a-ac5d-4544-b57a-50d755558604 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:40.191152 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd98e3a-ac5d-4544-b57a-50d755558604 admin admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:40.191848 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd98e3a-ac5d-4544-b57a-50d755558604 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:40.193825 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd98e3a-ac5d-4544-b57a-50d755558604 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:40.309935 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1325/2642] 10.222.0.15 () {60 vars in 1143 bytes} [Tue May 31 14:55:40 2022] POST /identity/v3/users => generated 288 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 14:55:40.313936 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7819e75f-8900-48ff-aaee-546c18174114 service cinder] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:40.324871 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7819e75f-8900-48ff-aaee-546c18174114 service cinder] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:40.329411 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb40650-de76-437a-a1fd-bb46f11d6e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:40.330114 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb40650-de76-437a-a1fd-bb46f11d6e75 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:40.330399 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb40650-de76-437a-a1fd-bb46f11d6e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:40.330709 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb40650-de76-437a-a1fd-bb46f11d6e75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:40.331431 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb40650-de76-437a-a1fd-bb46f11d6e75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:40.333060 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb40650-de76-437a-a1fd-bb46f11d6e75 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:40.347296 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1318/2643] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:55:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:55:40.348328 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd98e3a-ac5d-4544-b57a-50d755558604 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:40.359724 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd98e3a-ac5d-4544-b57a-50d755558604 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:40.364678 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507719ee-e515-4cf3-8077-e6903f5c4980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:40.365375 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507719ee-e515-4cf3-8077-e6903f5c4980 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:40.365654 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507719ee-e515-4cf3-8077-e6903f5c4980 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:40.365927 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507719ee-e515-4cf3-8077-e6903f5c4980 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:40.366671 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507719ee-e515-4cf3-8077-e6903f5c4980 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:40.368681 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507719ee-e515-4cf3-8077-e6903f5c4980 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:40.380949 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1326/2644] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:55:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 14:55:40.384659 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb40650-de76-437a-a1fd-bb46f11d6e75 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:40.396275 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb40650-de76-437a-a1fd-bb46f11d6e75 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:40.402863 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7a51a0-be01-4c6c-9535-74eae76dfa94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:40.403755 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7a51a0-be01-4c6c-9535-74eae76dfa94 admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:40.404040 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7a51a0-be01-4c6c-9535-74eae76dfa94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:40.404314 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7a51a0-be01-4c6c-9535-74eae76dfa94 admin admin] PATH_INFO: `/v3/projects/18a2eee319374c0b947eab606092588a/users/9fe1d717e1ed44c58536dfb5aac5a50d/roles/317f725e26bf43648d8235bb1f7c4cb3` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:40.420061 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7a51a0-be01-4c6c-9535-74eae76dfa94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18a2eee319374c0b947eab606092588a, user_id=9fe1d717e1ed44c58536dfb5aac5a50d, role_id=317f725e26bf43648d8235bb1f7c4cb3)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:40.422765 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7a51a0-be01-4c6c-9535-74eae76dfa94 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:40.497440 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1319/2645] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:55:40 2022] PUT /identity/v3/projects/18a2eee319374c0b947eab606092588a/users/9fe1d717e1ed44c58536dfb5aac5a50d/roles/317f725e26bf43648d8235bb1f7c4cb3 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:55:40.508009 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff64e24-6998-48e1-9ec9-cebffb4e43e1 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:40.508327 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff64e24-6998-48e1-9ec9-cebffb4e43e1 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:40.508614 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff64e24-6998-48e1-9ec9-cebffb4e43e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:40.538487 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-0ff64e24-6998-48e1-9ec9-cebffb4e43e1 None None] MFA Rules not processed for user `9fe1d717e1ed44c58536dfb5aac5a50d`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:55:40.539742 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-0ff64e24-6998-48e1-9ec9-cebffb4e43e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:55:40.615066 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1327/2646] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:55:40 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:55:40.619651 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7a51a0-be01-4c6c-9535-74eae76dfa94 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:40.690480 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7a51a0-be01-4c6c-9535-74eae76dfa94 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:40.695385 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1310981b-e726-49a6-abdc-114cf91cc747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:40.696054 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1310981b-e726-49a6-abdc-114cf91cc747 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:40.696343 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1310981b-e726-49a6-abdc-114cf91cc747 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:40.696625 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1310981b-e726-49a6-abdc-114cf91cc747 admin admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:40.697532 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1310981b-e726-49a6-abdc-114cf91cc747 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:40.699330 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1310981b-e726-49a6-abdc-114cf91cc747 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:40.791815 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:55:40.803876 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1320/2647] 10.222.0.15 () {60 vars in 1152 bytes} [Tue May 31 14:55:40 2022] POST /identity/v3/projects => generated 375 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:55:40.808324 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff64e24-6998-48e1-9ec9-cebffb4e43e1 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:40.820029 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff64e24-6998-48e1-9ec9-cebffb4e43e1 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:40.835106 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:55:40.888460 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793f7cb9-5dd6-4292-b90b-db02484c3b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:40.889131 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f7cb9-5dd6-4292-b90b-db02484c3b5b admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:40.889410 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f7cb9-5dd6-4292-b90b-db02484c3b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:40.889683 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f7cb9-5dd6-4292-b90b-db02484c3b5b admin admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:40.890402 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793f7cb9-5dd6-4292-b90b-db02484c3b5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:40.892376 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793f7cb9-5dd6-4292-b90b-db02484c3b5b admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:41.007111 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1328/2648] 10.222.0.15 () {60 vars in 1143 bytes} [Tue May 31 14:55:40 2022] POST /identity/v3/users => generated 294 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:55:41.011875 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1310981b-e726-49a6-abdc-114cf91cc747 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:41.024437 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1310981b-e726-49a6-abdc-114cf91cc747 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:41.030117 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75fe4fa-af6b-4301-a4e1-b7c0f1c8d4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:41.030826 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75fe4fa-af6b-4301-a4e1-b7c0f1c8d4e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:41.031119 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75fe4fa-af6b-4301-a4e1-b7c0f1c8d4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:41.031398 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75fe4fa-af6b-4301-a4e1-b7c0f1c8d4e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:41.032129 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75fe4fa-af6b-4301-a4e1-b7c0f1c8d4e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:41.033724 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75fe4fa-af6b-4301-a4e1-b7c0f1c8d4e8 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:41.047373 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1321/2649] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:55:41 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:55:41.054142 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793f7cb9-5dd6-4292-b90b-db02484c3b5b admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:41.067476 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793f7cb9-5dd6-4292-b90b-db02484c3b5b admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:41.072748 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88447908-e50a-4d5a-971d-ef12241db631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:41.073636 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88447908-e50a-4d5a-971d-ef12241db631 admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:41.074453 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88447908-e50a-4d5a-971d-ef12241db631 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:41.074788 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88447908-e50a-4d5a-971d-ef12241db631 admin admin] PATH_INFO: `/v3/projects/7688086b165e4e7296be267831f2b7f9/users/73ec8df8ba7842b8b7b4684ba79e2ba0/roles/76c53e2c353644f885028a0226c06146` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:41.092099 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88447908-e50a-4d5a-971d-ef12241db631 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7688086b165e4e7296be267831f2b7f9, user_id=73ec8df8ba7842b8b7b4684ba79e2ba0, role_id=76c53e2c353644f885028a0226c06146)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:41.096802 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88447908-e50a-4d5a-971d-ef12241db631 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:41.162616 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a199bf-f093-4cf0-9c8c-fb54b27c29f0 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:41.162910 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a199bf-f093-4cf0-9c8c-fb54b27c29f0 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:41.163187 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a199bf-f093-4cf0-9c8c-fb54b27c29f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:41.181979 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-02a199bf-f093-4cf0-9c8c-fb54b27c29f0 None None] MFA Rules not processed for user `735d2518c8404bd991acee533b314039`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:55:41.185054 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-02a199bf-f093-4cf0-9c8c-fb54b27c29f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:55:41.219704 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1329/2650] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:55:41 2022] PUT /identity/v3/projects/7688086b165e4e7296be267831f2b7f9/users/73ec8df8ba7842b8b7b4684ba79e2ba0/roles/76c53e2c353644f885028a0226c06146 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:55:41.225450 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88447908-e50a-4d5a-971d-ef12241db631 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:41.249047 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1322/2651] 10.222.0.15 () {58 vars in 967 bytes} [Tue May 31 14:55:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 14:55:41.283263 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a199bf-f093-4cf0-9c8c-fb54b27c29f0 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:41.286625 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-02a199bf-f093-4cf0-9c8c-fb54b27c29f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:55:41.301074 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88447908-e50a-4d5a-971d-ef12241db631 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:41.306661 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53915d7-bac2-4128-84ba-285efd30ac9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:41.307329 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53915d7-bac2-4128-84ba-285efd30ac9c admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:41.307980 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53915d7-bac2-4128-84ba-285efd30ac9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:41.307980 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53915d7-bac2-4128-84ba-285efd30ac9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:41.309089 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53915d7-bac2-4128-84ba-285efd30ac9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:41.310880 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53915d7-bac2-4128-84ba-285efd30ac9c admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:41.322952 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1330/2652] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:55:41 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:55:41.327654 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53915d7-bac2-4128-84ba-285efd30ac9c admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:41.343951 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53915d7-bac2-4128-84ba-285efd30ac9c admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:41.351779 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656bfc56-78f9-42e8-af7f-92a3df99a8f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:41.351779 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656bfc56-78f9-42e8-af7f-92a3df99a8f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:41.351779 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656bfc56-78f9-42e8-af7f-92a3df99a8f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:41.357692 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656bfc56-78f9-42e8-af7f-92a3df99a8f3 admin admin] PATH_INFO: `/v3/projects/7688086b165e4e7296be267831f2b7f9/users/73ec8df8ba7842b8b7b4684ba79e2ba0/roles/76c53e2c353644f885028a0226c06146` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:41.357692 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656bfc56-78f9-42e8-af7f-92a3df99a8f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7688086b165e4e7296be267831f2b7f9, user_id=73ec8df8ba7842b8b7b4684ba79e2ba0, role_id=76c53e2c353644f885028a0226c06146)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:41.357692 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656bfc56-78f9-42e8-af7f-92a3df99a8f3 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:41.367669 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a199bf-f093-4cf0-9c8c-fb54b27c29f0 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:41.383244 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1331/2653] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:55:41 2022] PUT /identity/v3/projects/7688086b165e4e7296be267831f2b7f9/users/73ec8df8ba7842b8b7b4684ba79e2ba0/roles/76c53e2c353644f885028a0226c06146 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 14:55:41.384857 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537fbe41-b48d-4ae6-993b-1772976b9b8d None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:41.385221 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537fbe41-b48d-4ae6-993b-1772976b9b8d None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:41.385577 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537fbe41-b48d-4ae6-993b-1772976b9b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:41.418334 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-537fbe41-b48d-4ae6-993b-1772976b9b8d None None] MFA Rules not processed for user `73ec8df8ba7842b8b7b4684ba79e2ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:55:41.419596 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-537fbe41-b48d-4ae6-993b-1772976b9b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:55:41.441910 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0d54d9-c248-4810-a88c-d73248acf495 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e158f461c66e4d779f23fb7760672897', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:41.443185 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d54d9-c248-4810-a88c-d73248acf495 service swift] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:41.443476 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d54d9-c248-4810-a88c-d73248acf495 service swift] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:41.443750 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d54d9-c248-4810-a88c-d73248acf495 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:41.479418 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:55:41.485992 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:55:41.502701 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1332/2654] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:55:41 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 14:55:41.507209 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0d54d9-c248-4810-a88c-d73248acf495 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:41.509036 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0d54d9-c248-4810-a88c-d73248acf495 service swift] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:41.512968 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537fbe41-b48d-4ae6-993b-1772976b9b8d None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:41.515510 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-537fbe41-b48d-4ae6-993b-1772976b9b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:55:41.518480 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1323/2655] 10.222.0.15 () {60 vars in 1384 bytes} [Tue May 31 14:55:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 31 14:55:41.577536 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537fbe41-b48d-4ae6-993b-1772976b9b8d None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:41.581298 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcc2388-55b6-4538-b5d7-738d9fe07216 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afbf718dcd9b4741a926b0a2321bd53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:41.581946 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc2388-55b6-4538-b5d7-738d9fe07216 service cinder] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:41.582226 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc2388-55b6-4538-b5d7-738d9fe07216 service cinder] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:41.582530 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc2388-55b6-4538-b5d7-738d9fe07216 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:41.638840 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcc2388-55b6-4538-b5d7-738d9fe07216 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:41.640307 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcc2388-55b6-4538-b5d7-738d9fe07216 service cinder] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:41.649196 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1333/2656] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:55:41 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 14:55:44.998855 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0d54d9-c248-4810-a88c-d73248acf495 service swift] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:45.061197 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0d54d9-c248-4810-a88c-d73248acf495 service swift] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:45.066177 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab57077-2bee-492d-a923-f91663274c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:45.067174 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab57077-2bee-492d-a923-f91663274c4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:45.067490 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab57077-2bee-492d-a923-f91663274c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:45.067722 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab57077-2bee-492d-a923-f91663274c4e admin admin] PATH_INFO: `/v3/users/9fe1d717e1ed44c58536dfb5aac5a50d` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:45.068932 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab57077-2bee-492d-a923-f91663274c4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fe1d717e1ed44c58536dfb5aac5a50d)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:45.070878 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab57077-2bee-492d-a923-f91663274c4e admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:45.259912 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-9ab57077-2bee-492d-a923-f91663274c4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fe1d717e1ed44c58536dfb5aac5a50d'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:45.266800 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-9ab57077-2bee-492d-a923-f91663274c4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fe1d717e1ed44c58536dfb5aac5a50d'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:45.267478 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-9ab57077-2bee-492d-a923-f91663274c4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fe1d717e1ed44c58536dfb5aac5a50d'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:45.268078 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-9ab57077-2bee-492d-a923-f91663274c4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fe1d717e1ed44c58536dfb5aac5a50d'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:45.279704 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-9ab57077-2bee-492d-a923-f91663274c4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fe1d717e1ed44c58536dfb5aac5a50d'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:45.348944 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1324/2657] 10.222.0.15 () {58 vars in 1223 bytes} [Tue May 31 14:55:44 2022] DELETE /identity/v3/users/9fe1d717e1ed44c58536dfb5aac5a50d => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:55:45.353622 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4eeaf9-d9cd-40df-9dbb-bb3260ae4bad None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:45.354117 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4eeaf9-d9cd-40df-9dbb-bb3260ae4bad None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:45.354217 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4eeaf9-d9cd-40df-9dbb-bb3260ae4bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:45.372740 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-5a4eeaf9-d9cd-40df-9dbb-bb3260ae4bad None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:55:45.373944 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-5a4eeaf9-d9cd-40df-9dbb-bb3260ae4bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:55:45.440994 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1334/2658] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:55:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:55:45.452713 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab57077-2bee-492d-a923-f91663274c4e admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:45.452713 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-9ab57077-2bee-492d-a923-f91663274c4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:55:45.512632 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab57077-2bee-492d-a923-f91663274c4e admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:45.516330 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a7c30d-f163-4dad-a540-82c24a107100 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:45.516992 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a7c30d-f163-4dad-a540-82c24a107100 service neutron] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:45.517282 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a7c30d-f163-4dad-a540-82c24a107100 service neutron] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:45.517567 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a7c30d-f163-4dad-a540-82c24a107100 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:45.527469 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a7c30d-f163-4dad-a540-82c24a107100 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:45.528969 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a7c30d-f163-4dad-a540-82c24a107100 service neutron] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:45.534221 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:55:45.540281 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1325/2659] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:55:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:55:46.007739 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4eeaf9-d9cd-40df-9dbb-bb3260ae4bad None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:46.010725 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-5a4eeaf9-d9cd-40df-9dbb-bb3260ae4bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:55:46.023773 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4eeaf9-d9cd-40df-9dbb-bb3260ae4bad None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:46.029683 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b035c599-22e7-4682-8648-b53ccfecbd08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:46.035187 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b035c599-22e7-4682-8648-b53ccfecbd08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:46.035479 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b035c599-22e7-4682-8648-b53ccfecbd08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:46.035763 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b035c599-22e7-4682-8648-b53ccfecbd08 admin admin] PATH_INFO: `/v3/projects/18a2eee319374c0b947eab606092588a` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:46.037223 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b035c599-22e7-4682-8648-b53ccfecbd08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18a2eee319374c0b947eab606092588a)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:46.039246 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b035c599-22e7-4682-8648-b53ccfecbd08 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:46.166761 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:55:46.174033 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-b035c599-22e7-4682-8648-b53ccfecbd08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18a2eee319374c0b947eab606092588a', 'request_id': 'req-b035c599-22e7-4682-8648-b53ccfecbd08'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:46.246360 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-b035c599-22e7-4682-8648-b53ccfecbd08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18a2eee319374c0b947eab606092588a', 'request_id': 'req-b035c599-22e7-4682-8648-b53ccfecbd08'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:46.253782 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-b035c599-22e7-4682-8648-b53ccfecbd08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18a2eee319374c0b947eab606092588a', 'request_id': 'req-b035c599-22e7-4682-8648-b53ccfecbd08'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:46.265508 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-b035c599-22e7-4682-8648-b53ccfecbd08 admin admin] The token cache is being invalidate because project 18a2eee319374c0b947eab606092588a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80503) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 14:55:46.265962 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-b035c599-22e7-4682-8648-b53ccfecbd08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:46.266607 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-b035c599-22e7-4682-8648-b53ccfecbd08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:46.268225 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1335/2660] 10.222.0.15 () {58 vars in 1232 bytes} [Tue May 31 14:55:46 2022] DELETE /identity/v3/projects/18a2eee319374c0b947eab606092588a => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:55:46.272970 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a7c30d-f163-4dad-a540-82c24a107100 service neutron] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:46.284735 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a7c30d-f163-4dad-a540-82c24a107100 service neutron] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:46.344457 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c43f676-02b3-4da0-b195-681ebd7ea5e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:46.345373 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c43f676-02b3-4da0-b195-681ebd7ea5e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:46.345667 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c43f676-02b3-4da0-b195-681ebd7ea5e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:46.345946 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c43f676-02b3-4da0-b195-681ebd7ea5e3 admin admin] PATH_INFO: `/v3/users/73ec8df8ba7842b8b7b4684ba79e2ba0` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:46.347234 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c43f676-02b3-4da0-b195-681ebd7ea5e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73ec8df8ba7842b8b7b4684ba79e2ba0)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:46.349414 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c43f676-02b3-4da0-b195-681ebd7ea5e3 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:46.545092 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-9c43f676-02b3-4da0-b195-681ebd7ea5e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73ec8df8ba7842b8b7b4684ba79e2ba0'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:46.549105 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-9c43f676-02b3-4da0-b195-681ebd7ea5e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73ec8df8ba7842b8b7b4684ba79e2ba0'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:46.549833 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-9c43f676-02b3-4da0-b195-681ebd7ea5e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73ec8df8ba7842b8b7b4684ba79e2ba0'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:46.550429 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-9c43f676-02b3-4da0-b195-681ebd7ea5e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73ec8df8ba7842b8b7b4684ba79e2ba0'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:46.566562 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-9c43f676-02b3-4da0-b195-681ebd7ea5e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73ec8df8ba7842b8b7b4684ba79e2ba0'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:46.628977 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1326/2661] 10.222.0.15 () {58 vars in 1223 bytes} [Tue May 31 14:55:46 2022] DELETE /identity/v3/users/73ec8df8ba7842b8b7b4684ba79e2ba0 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:55:47.133446 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b035c599-22e7-4682-8648-b53ccfecbd08 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:47.135001 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-b035c599-22e7-4682-8648-b53ccfecbd08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:55:47.149956 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b035c599-22e7-4682-8648-b53ccfecbd08 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:47.210022 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab87226-8117-4bac-89ca-7fd1db3993bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:47.210919 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab87226-8117-4bac-89ca-7fd1db3993bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:47.211207 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab87226-8117-4bac-89ca-7fd1db3993bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:47.216077 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab87226-8117-4bac-89ca-7fd1db3993bb admin admin] PATH_INFO: `/v3/projects/7688086b165e4e7296be267831f2b7f9` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:47.216077 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab87226-8117-4bac-89ca-7fd1db3993bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=7688086b165e4e7296be267831f2b7f9)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:47.216077 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab87226-8117-4bac-89ca-7fd1db3993bb admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:47.371536 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-6ab87226-8117-4bac-89ca-7fd1db3993bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7688086b165e4e7296be267831f2b7f9', 'request_id': 'req-6ab87226-8117-4bac-89ca-7fd1db3993bb'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:47.440565 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-6ab87226-8117-4bac-89ca-7fd1db3993bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7688086b165e4e7296be267831f2b7f9', 'request_id': 'req-6ab87226-8117-4bac-89ca-7fd1db3993bb'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:47.446534 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-6ab87226-8117-4bac-89ca-7fd1db3993bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7688086b165e4e7296be267831f2b7f9', 'request_id': 'req-6ab87226-8117-4bac-89ca-7fd1db3993bb'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:47.458228 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-6ab87226-8117-4bac-89ca-7fd1db3993bb admin admin] The token cache is being invalidate because project 7688086b165e4e7296be267831f2b7f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80503) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 14:55:47.458515 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-6ab87226-8117-4bac-89ca-7fd1db3993bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:47.459172 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-6ab87226-8117-4bac-89ca-7fd1db3993bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:55:47.460698 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1336/2662] 10.222.0.15 () {58 vars in 1232 bytes} [Tue May 31 14:55:47 2022] DELETE /identity/v3/projects/7688086b165e4e7296be267831f2b7f9 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:55:47.466634 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e57f6-ef00-4da5-bcc1-b8bf5419cbda None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:47.467141 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e57f6-ef00-4da5-bcc1-b8bf5419cbda None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:47.467350 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e57f6-ef00-4da5-bcc1-b8bf5419cbda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:47.485958 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-096e57f6-ef00-4da5-bcc1-b8bf5419cbda None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:55:47.487180 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-096e57f6-ef00-4da5-bcc1-b8bf5419cbda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:55:47.550303 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1327/2663] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:55:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:55:47.559243 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b6ec82-e202-4a11-9c65-1ec2d276a011 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:47.560142 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b6ec82-e202-4a11-9c65-1ec2d276a011 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:47.560436 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b6ec82-e202-4a11-9c65-1ec2d276a011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:47.579928 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-25b6ec82-e202-4a11-9c65-1ec2d276a011 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:55:47.581139 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-25b6ec82-e202-4a11-9c65-1ec2d276a011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:55:47.589573 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1337/2664] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:55:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:55:47.593875 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e57f6-ef00-4da5-bcc1-b8bf5419cbda None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:47.603655 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e57f6-ef00-4da5-bcc1-b8bf5419cbda None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:47.608716 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e35d748-ea42-413b-88fd-1b95a10607d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:47.609370 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e35d748-ea42-413b-88fd-1b95a10607d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:47.609654 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e35d748-ea42-413b-88fd-1b95a10607d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:47.609934 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e35d748-ea42-413b-88fd-1b95a10607d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:47.610699 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e35d748-ea42-413b-88fd-1b95a10607d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:55:47.611008 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e35d748-ea42-413b-88fd-1b95a10607d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:47.612597 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e35d748-ea42-413b-88fd-1b95a10607d2 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:47.624812 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1328/2665] 10.222.0.15 () {58 vars in 1152 bytes} [Tue May 31 14:55:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:55:47.629159 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b6ec82-e202-4a11-9c65-1ec2d276a011 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:47.638515 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b6ec82-e202-4a11-9c65-1ec2d276a011 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:47.643269 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7db116-d178-46c4-8aea-f94ecaa3f7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:47.643908 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7db116-d178-46c4-8aea-f94ecaa3f7bd admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:47.644188 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7db116-d178-46c4-8aea-f94ecaa3f7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:47.644479 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7db116-d178-46c4-8aea-f94ecaa3f7bd admin admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:47.645141 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7db116-d178-46c4-8aea-f94ecaa3f7bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:47.647197 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7db116-d178-46c4-8aea-f94ecaa3f7bd admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:47.749792 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1338/2666] 10.222.0.15 () {60 vars in 1152 bytes} [Tue May 31 14:55:47 2022] POST /identity/v3/projects => generated 373 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:55:47.754181 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e35d748-ea42-413b-88fd-1b95a10607d2 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:47.764691 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e35d748-ea42-413b-88fd-1b95a10607d2 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:47.768704 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:55:47.823501 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6305bf7-9074-43a4-b3ed-a84193d9c0e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:47.824174 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6305bf7-9074-43a4-b3ed-a84193d9c0e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:47.824462 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6305bf7-9074-43a4-b3ed-a84193d9c0e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:47.824742 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6305bf7-9074-43a4-b3ed-a84193d9c0e1 admin admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:47.825465 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6305bf7-9074-43a4-b3ed-a84193d9c0e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:47.827417 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6305bf7-9074-43a4-b3ed-a84193d9c0e1 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:47.897770 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1329/2667] 10.222.0.15 () {60 vars in 1143 bytes} [Tue May 31 14:55:47 2022] POST /identity/v3/users => generated 287 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 14:55:47.901891 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7db116-d178-46c4-8aea-f94ecaa3f7bd admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:47.912865 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7db116-d178-46c4-8aea-f94ecaa3f7bd admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:47.917560 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db15a0c-3651-4bb8-ba94-5902a2d06184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:47.918231 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db15a0c-3651-4bb8-ba94-5902a2d06184 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:47.918516 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db15a0c-3651-4bb8-ba94-5902a2d06184 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:47.919900 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db15a0c-3651-4bb8-ba94-5902a2d06184 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:47.920273 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db15a0c-3651-4bb8-ba94-5902a2d06184 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:47.921856 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db15a0c-3651-4bb8-ba94-5902a2d06184 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:47.933607 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1339/2668] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:55:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:55:47.939498 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6305bf7-9074-43a4-b3ed-a84193d9c0e1 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:47.951090 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6305bf7-9074-43a4-b3ed-a84193d9c0e1 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:47.956578 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578fe0c4-028f-4621-b3fb-2a32fdcd1f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:47.957260 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578fe0c4-028f-4621-b3fb-2a32fdcd1f01 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:47.957554 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578fe0c4-028f-4621-b3fb-2a32fdcd1f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:47.957832 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578fe0c4-028f-4621-b3fb-2a32fdcd1f01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:47.958596 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578fe0c4-028f-4621-b3fb-2a32fdcd1f01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:47.960241 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578fe0c4-028f-4621-b3fb-2a32fdcd1f01 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:47.971553 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1330/2669] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:55:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:55:47.975787 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db15a0c-3651-4bb8-ba94-5902a2d06184 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:47.986979 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db15a0c-3651-4bb8-ba94-5902a2d06184 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:47.992102 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e4fcf8-02d3-4be7-8f95-f51ad17aeee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:47.993146 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e4fcf8-02d3-4be7-8f95-f51ad17aeee0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:47.993488 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e4fcf8-02d3-4be7-8f95-f51ad17aeee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:47.993838 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e4fcf8-02d3-4be7-8f95-f51ad17aeee0 admin admin] PATH_INFO: `/v3/projects/ffa3312976b44f7a859eda0130fc4eb8/users/d0625845858d4287a43881b79aa9b490/roles/317f725e26bf43648d8235bb1f7c4cb3` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:48.009543 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e4fcf8-02d3-4be7-8f95-f51ad17aeee0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffa3312976b44f7a859eda0130fc4eb8, user_id=d0625845858d4287a43881b79aa9b490, role_id=317f725e26bf43648d8235bb1f7c4cb3)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:48.012277 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e4fcf8-02d3-4be7-8f95-f51ad17aeee0 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:48.015469 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:55:48.144359 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1340/2670] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:55:47 2022] PUT /identity/v3/projects/ffa3312976b44f7a859eda0130fc4eb8/users/d0625845858d4287a43881b79aa9b490/roles/317f725e26bf43648d8235bb1f7c4cb3 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:55:48.155711 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b8b924-1662-4f86-9736-817d23a56131 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:48.156063 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b8b924-1662-4f86-9736-817d23a56131 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:48.156369 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b8b924-1662-4f86-9736-817d23a56131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:48.185788 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-c0b8b924-1662-4f86-9736-817d23a56131 None None] MFA Rules not processed for user `d0625845858d4287a43881b79aa9b490`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:55:48.187049 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-c0b8b924-1662-4f86-9736-817d23a56131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:55:48.257376 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1331/2671] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:55:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:55:48.269183 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e4fcf8-02d3-4be7-8f95-f51ad17aeee0 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:55:48.270926 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-06e4fcf8-02d3-4be7-8f95-f51ad17aeee0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:55:48.330691 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e4fcf8-02d3-4be7-8f95-f51ad17aeee0 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:55:48.334498 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8864c7d-b164-41be-8aae-a968c3c1ae15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afbf718dcd9b4741a926b0a2321bd53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:55:48.335193 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8864c7d-b164-41be-8aae-a968c3c1ae15 service cinder] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:48.335477 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8864c7d-b164-41be-8aae-a968c3c1ae15 service cinder] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:48.339794 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8864c7d-b164-41be-8aae-a968c3c1ae15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:48.345761 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8864c7d-b164-41be-8aae-a968c3c1ae15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:55:48.347261 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8864c7d-b164-41be-8aae-a968c3c1ae15 service cinder] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:55:48.356829 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1341/2672] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:55:48 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:55:50.090185 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4140d0b6-52b5-46d7-8a1d-52a57eab8a25 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:55:50.090818 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4140d0b6-52b5-46d7-8a1d-52a57eab8a25 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:55:50.090818 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4140d0b6-52b5-46d7-8a1d-52a57eab8a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:55:50.110106 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-4140d0b6-52b5-46d7-8a1d-52a57eab8a25 None None] MFA Rules not processed for user `d0625845858d4287a43881b79aa9b490`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:55:50.111358 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-4140d0b6-52b5-46d7-8a1d-52a57eab8a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:55:50.118258 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1332/2673] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:55:50 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:55:58.352372 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=28 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:56:00.102889 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=66,keystone:INSERT=3 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:56:03.988931 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8864c7d-b164-41be-8aae-a968c3c1ae15 service cinder] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:56:03.990358 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-e8864c7d-b164-41be-8aae-a968c3c1ae15 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:56:04.056095 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8864c7d-b164-41be-8aae-a968c3c1ae15 service cinder] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:56:04.060635 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3a3a0d-805e-4cfe-af78-01d07aa20fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:56:04.061501 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a3a0d-805e-4cfe-af78-01d07aa20fc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:56:04.062400 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a3a0d-805e-4cfe-af78-01d07aa20fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:56:04.062721 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a3a0d-805e-4cfe-af78-01d07aa20fc6 admin admin] PATH_INFO: `/v3/users/b0eff9174f1a4a97b6b7b08942c4ec1f` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:56:04.064163 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3a3a0d-805e-4cfe-af78-01d07aa20fc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0eff9174f1a4a97b6b7b08942c4ec1f)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:56:04.066068 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3a3a0d-805e-4cfe-af78-01d07aa20fc6 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:56:04.242735 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-0d3a3a0d-805e-4cfe-af78-01d07aa20fc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0eff9174f1a4a97b6b7b08942c4ec1f'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:56:04.308944 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-0d3a3a0d-805e-4cfe-af78-01d07aa20fc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0eff9174f1a4a97b6b7b08942c4ec1f'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:56:04.309570 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-0d3a3a0d-805e-4cfe-af78-01d07aa20fc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0eff9174f1a4a97b6b7b08942c4ec1f'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:56:04.318194 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-0d3a3a0d-805e-4cfe-af78-01d07aa20fc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0eff9174f1a4a97b6b7b08942c4ec1f'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:56:04.319760 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-0d3a3a0d-805e-4cfe-af78-01d07aa20fc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0eff9174f1a4a97b6b7b08942c4ec1f'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:56:04.335986 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1342/2674] 10.222.0.15 () {58 vars in 1223 bytes} [Tue May 31 14:56:03 2022] DELETE /identity/v3/users/b0eff9174f1a4a97b6b7b08942c4ec1f => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:56:04.572910 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4140d0b6-52b5-46d7-8a1d-52a57eab8a25 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:56:04.584841 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4140d0b6-52b5-46d7-8a1d-52a57eab8a25 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:56:04.640037 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7515ee8e-46b3-4308-803e-1566dca7bf4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:56:04.640904 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7515ee8e-46b3-4308-803e-1566dca7bf4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:56:04.641189 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7515ee8e-46b3-4308-803e-1566dca7bf4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:56:04.641481 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7515ee8e-46b3-4308-803e-1566dca7bf4d admin admin] PATH_INFO: `/v3/projects/4c2eca09f80c4bbbaddff99df5469ad5` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:56:04.642683 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7515ee8e-46b3-4308-803e-1566dca7bf4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c2eca09f80c4bbbaddff99df5469ad5)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:56:04.644620 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7515ee8e-46b3-4308-803e-1566dca7bf4d admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:56:04.849257 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-7515ee8e-46b3-4308-803e-1566dca7bf4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c2eca09f80c4bbbaddff99df5469ad5', 'request_id': 'req-7515ee8e-46b3-4308-803e-1566dca7bf4d'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:56:04.861097 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-7515ee8e-46b3-4308-803e-1566dca7bf4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c2eca09f80c4bbbaddff99df5469ad5', 'request_id': 'req-7515ee8e-46b3-4308-803e-1566dca7bf4d'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:56:04.938340 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-7515ee8e-46b3-4308-803e-1566dca7bf4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c2eca09f80c4bbbaddff99df5469ad5', 'request_id': 'req-7515ee8e-46b3-4308-803e-1566dca7bf4d'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:56:04.950359 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-7515ee8e-46b3-4308-803e-1566dca7bf4d admin admin] The token cache is being invalidate because project 4c2eca09f80c4bbbaddff99df5469ad5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 14:56:04.950671 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-7515ee8e-46b3-4308-803e-1566dca7bf4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:56:04.951325 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-7515ee8e-46b3-4308-803e-1566dca7bf4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:56:04.953368 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1333/2675] 10.222.0.15 () {58 vars in 1232 bytes} [Tue May 31 14:56:04 2022] DELETE /identity/v3/projects/4c2eca09f80c4bbbaddff99df5469ad5 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:56:04.957647 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3a3a0d-805e-4cfe-af78-01d07aa20fc6 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:56:04.959086 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-0d3a3a0d-805e-4cfe-af78-01d07aa20fc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:56:04.973640 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3a3a0d-805e-4cfe-af78-01d07aa20fc6 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:56:05.033666 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a1e0be-86b1-4d49-96e5-06bb98fbe6e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:56:05.034544 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a1e0be-86b1-4d49-96e5-06bb98fbe6e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:56:05.034865 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a1e0be-86b1-4d49-96e5-06bb98fbe6e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:56:05.035167 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a1e0be-86b1-4d49-96e5-06bb98fbe6e1 admin admin] PATH_INFO: `/v3/users/05b3afc6a5304c468947285edc595b8c` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:56:05.036639 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a1e0be-86b1-4d49-96e5-06bb98fbe6e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05b3afc6a5304c468947285edc595b8c)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:56:05.038325 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a1e0be-86b1-4d49-96e5-06bb98fbe6e1 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:56:05.061325 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:56:05.266788 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-28a1e0be-86b1-4d49-96e5-06bb98fbe6e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05b3afc6a5304c468947285edc595b8c'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:56:05.355101 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-28a1e0be-86b1-4d49-96e5-06bb98fbe6e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05b3afc6a5304c468947285edc595b8c'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:56:05.355731 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-28a1e0be-86b1-4d49-96e5-06bb98fbe6e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05b3afc6a5304c468947285edc595b8c'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:56:05.363524 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-28a1e0be-86b1-4d49-96e5-06bb98fbe6e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05b3afc6a5304c468947285edc595b8c'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:56:05.364169 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-28a1e0be-86b1-4d49-96e5-06bb98fbe6e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05b3afc6a5304c468947285edc595b8c'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:56:05.382851 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1343/2676] 10.222.0.15 () {58 vars in 1223 bytes} [Tue May 31 14:56:04 2022] DELETE /identity/v3/users/05b3afc6a5304c468947285edc595b8c => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:56:05.636300 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7515ee8e-46b3-4308-803e-1566dca7bf4d admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:56:05.637787 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-7515ee8e-46b3-4308-803e-1566dca7bf4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:56:05.651210 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7515ee8e-46b3-4308-803e-1566dca7bf4d admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:56:05.706857 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233f4ef5-9fc4-450f-9aac-c1499c91ed46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:56:05.707715 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f4ef5-9fc4-450f-9aac-c1499c91ed46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:56:05.707997 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f4ef5-9fc4-450f-9aac-c1499c91ed46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:56:05.708272 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f4ef5-9fc4-450f-9aac-c1499c91ed46 admin admin] PATH_INFO: `/v3/projects/5fe2cfa91313471c8f8f6b476118f30a` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:56:05.709485 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233f4ef5-9fc4-450f-9aac-c1499c91ed46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fe2cfa91313471c8f8f6b476118f30a)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:56:05.711418 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233f4ef5-9fc4-450f-9aac-c1499c91ed46 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:56:05.795629 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:56:05.808028 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-233f4ef5-9fc4-450f-9aac-c1499c91ed46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fe2cfa91313471c8f8f6b476118f30a', 'request_id': 'req-233f4ef5-9fc4-450f-9aac-c1499c91ed46'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:56:05.814981 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-233f4ef5-9fc4-450f-9aac-c1499c91ed46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fe2cfa91313471c8f8f6b476118f30a', 'request_id': 'req-233f4ef5-9fc4-450f-9aac-c1499c91ed46'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:56:05.886290 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-233f4ef5-9fc4-450f-9aac-c1499c91ed46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fe2cfa91313471c8f8f6b476118f30a', 'request_id': 'req-233f4ef5-9fc4-450f-9aac-c1499c91ed46'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:56:05.896823 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-233f4ef5-9fc4-450f-9aac-c1499c91ed46 admin admin] The token cache is being invalidate because project 5fe2cfa91313471c8f8f6b476118f30a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 14:56:05.897278 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-233f4ef5-9fc4-450f-9aac-c1499c91ed46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:56:05.898248 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-233f4ef5-9fc4-450f-9aac-c1499c91ed46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:56:05.899790 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1334/2677] 10.222.0.15 () {58 vars in 1232 bytes} [Tue May 31 14:56:05 2022] DELETE /identity/v3/projects/5fe2cfa91313471c8f8f6b476118f30a => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:56:05.904794 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b35ec-2214-4c48-92ba-8f6abb4f570e None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:56:05.905085 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b35ec-2214-4c48-92ba-8f6abb4f570e None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:56:05.905859 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b35ec-2214-4c48-92ba-8f6abb4f570e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:56:05.924703 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-4d0b35ec-2214-4c48-92ba-8f6abb4f570e None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:56:05.925916 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-4d0b35ec-2214-4c48-92ba-8f6abb4f570e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:56:05.984564 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1344/2678] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:56:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:56:05.992121 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3359a5-43ac-44da-a4b3-6d1e5089bcae None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:56:05.992425 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3359a5-43ac-44da-a4b3-6d1e5089bcae None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:56:05.992725 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3359a5-43ac-44da-a4b3-6d1e5089bcae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:56:06.010478 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-ca3359a5-43ac-44da-a4b3-6d1e5089bcae None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:56:06.011693 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-ca3359a5-43ac-44da-a4b3-6d1e5089bcae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:56:06.019505 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1335/2679] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:56:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:56:06.023506 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0b35ec-2214-4c48-92ba-8f6abb4f570e None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:56:06.033535 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0b35ec-2214-4c48-92ba-8f6abb4f570e None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:56:06.038257 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02ba0da-a9dd-49a9-be4f-d57dffee2987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:56:06.038948 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ba0da-a9dd-49a9-be4f-d57dffee2987 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:56:06.039232 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ba0da-a9dd-49a9-be4f-d57dffee2987 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:56:06.039512 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ba0da-a9dd-49a9-be4f-d57dffee2987 admin admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:56:06.040227 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02ba0da-a9dd-49a9-be4f-d57dffee2987 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:56:06.040557 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02ba0da-a9dd-49a9-be4f-d57dffee2987 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:56:06.042175 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02ba0da-a9dd-49a9-be4f-d57dffee2987 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:56:06.054504 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1345/2680] 10.222.0.15 () {58 vars in 1152 bytes} [Tue May 31 14:56:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:56:06.058471 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3359a5-43ac-44da-a4b3-6d1e5089bcae None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:56:06.067823 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3359a5-43ac-44da-a4b3-6d1e5089bcae None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:56:06.072456 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c610d60a-184f-4fb2-aef9-01eb9f43f27a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:56:06.073110 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c610d60a-184f-4fb2-aef9-01eb9f43f27a admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:56:06.073394 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c610d60a-184f-4fb2-aef9-01eb9f43f27a admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:56:06.073673 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c610d60a-184f-4fb2-aef9-01eb9f43f27a admin admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:56:06.074365 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c610d60a-184f-4fb2-aef9-01eb9f43f27a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:56:06.076301 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c610d60a-184f-4fb2-aef9-01eb9f43f27a admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:56:06.166157 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1336/2681] 10.222.0.15 () {60 vars in 1152 bytes} [Tue May 31 14:56:06 2022] POST /identity/v3/projects => generated 365 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:56:06.170212 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02ba0da-a9dd-49a9-be4f-d57dffee2987 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:56:06.180661 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02ba0da-a9dd-49a9-be4f-d57dffee2987 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:56:06.238111 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0031ab2e-9f08-45fc-9ef7-628aba0b6d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:56:06.238821 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0031ab2e-9f08-45fc-9ef7-628aba0b6d96 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:56:06.239103 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0031ab2e-9f08-45fc-9ef7-628aba0b6d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:56:06.239436 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0031ab2e-9f08-45fc-9ef7-628aba0b6d96 admin admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:56:06.240072 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0031ab2e-9f08-45fc-9ef7-628aba0b6d96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:56:06.241986 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0031ab2e-9f08-45fc-9ef7-628aba0b6d96 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:56:06.333186 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1346/2682] 10.222.0.15 () {60 vars in 1143 bytes} [Tue May 31 14:56:06 2022] POST /identity/v3/users => generated 283 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:56:06.337160 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c610d60a-184f-4fb2-aef9-01eb9f43f27a admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:56:06.348347 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c610d60a-184f-4fb2-aef9-01eb9f43f27a admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:56:06.353043 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb323f63-51c4-4399-8573-2c6542536da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:56:06.353701 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb323f63-51c4-4399-8573-2c6542536da3 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:56:06.353987 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb323f63-51c4-4399-8573-2c6542536da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:56:06.354264 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb323f63-51c4-4399-8573-2c6542536da3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:56:06.355031 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb323f63-51c4-4399-8573-2c6542536da3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:56:06.356620 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb323f63-51c4-4399-8573-2c6542536da3 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:56:06.367072 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1337/2683] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:56:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:56:06.375390 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0031ab2e-9f08-45fc-9ef7-628aba0b6d96 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:56:06.385813 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0031ab2e-9f08-45fc-9ef7-628aba0b6d96 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:56:06.391826 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0f3661-0f8e-4708-9dff-d43976c19e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:56:06.392488 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0f3661-0f8e-4708-9dff-d43976c19e1f admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:56:06.392779 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0f3661-0f8e-4708-9dff-d43976c19e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:56:06.393062 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0f3661-0f8e-4708-9dff-d43976c19e1f admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:56:06.393817 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0f3661-0f8e-4708-9dff-d43976c19e1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:56:06.395504 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0f3661-0f8e-4708-9dff-d43976c19e1f admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:56:06.406074 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1347/2684] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:56:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:56:06.410278 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb323f63-51c4-4399-8573-2c6542536da3 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:56:06.420387 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb323f63-51c4-4399-8573-2c6542536da3 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:56:06.425068 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322d3baf-2c69-4a38-8a11-a0f27a9e3f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:56:06.425943 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d3baf-2c69-4a38-8a11-a0f27a9e3f74 admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:56:06.426228 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d3baf-2c69-4a38-8a11-a0f27a9e3f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:56:06.426513 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d3baf-2c69-4a38-8a11-a0f27a9e3f74 admin admin] PATH_INFO: `/v3/projects/8bd9ef125aed4159954bcc67cbfa7ee5/users/afb76149ece24157a0d61962757200bf/roles/317f725e26bf43648d8235bb1f7c4cb3` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:56:06.441014 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322d3baf-2c69-4a38-8a11-a0f27a9e3f74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bd9ef125aed4159954bcc67cbfa7ee5, user_id=afb76149ece24157a0d61962757200bf, role_id=317f725e26bf43648d8235bb1f7c4cb3)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:56:06.443696 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322d3baf-2c69-4a38-8a11-a0f27a9e3f74 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:56:06.539030 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1338/2685] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:56:06 2022] PUT /identity/v3/projects/8bd9ef125aed4159954bcc67cbfa7ee5/users/afb76149ece24157a0d61962757200bf/roles/317f725e26bf43648d8235bb1f7c4cb3 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:56:06.548995 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b327068c-d2c1-446e-9013-476738ebe6ec None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:56:06.549286 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b327068c-d2c1-446e-9013-476738ebe6ec None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:56:06.549565 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b327068c-d2c1-446e-9013-476738ebe6ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:56:06.556534 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:56:06.576793 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-b327068c-d2c1-446e-9013-476738ebe6ec None None] MFA Rules not processed for user `afb76149ece24157a0d61962757200bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:56:06.578686 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-b327068c-d2c1-446e-9013-476738ebe6ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:56:06.646530 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1348/2686] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:56:06 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:56:06.657747 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322d3baf-2c69-4a38-8a11-a0f27a9e3f74 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:56:06.659473 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-322d3baf-2c69-4a38-8a11-a0f27a9e3f74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:56:06.716090 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322d3baf-2c69-4a38-8a11-a0f27a9e3f74 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:56:06.719794 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31b77a1-518c-4158-b1b0-04d95534b2d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afbf718dcd9b4741a926b0a2321bd53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:56:06.724180 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b77a1-518c-4158-b1b0-04d95534b2d5 service cinder] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:56:06.724180 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b77a1-518c-4158-b1b0-04d95534b2d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:56:06.724180 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b77a1-518c-4158-b1b0-04d95534b2d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:56:06.729189 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31b77a1-518c-4158-b1b0-04d95534b2d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:56:06.730660 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31b77a1-518c-4158-b1b0-04d95534b2d5 service cinder] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:56:06.739945 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1339/2687] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:56:06 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:56:09.001066 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86897efa-062a-4b1e-a312-bd63d18df38c None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:56:09.001547 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86897efa-062a-4b1e-a312-bd63d18df38c None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:56:09.001665 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86897efa-062a-4b1e-a312-bd63d18df38c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:56:09.018832 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-86897efa-062a-4b1e-a312-bd63d18df38c None None] MFA Rules not processed for user `735d2518c8404bd991acee533b314039`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:56:09.020024 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-86897efa-062a-4b1e-a312-bd63d18df38c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:56:09.074692 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1349/2688] 10.222.0.15 () {58 vars in 1009 bytes} [Tue May 31 14:56:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:56:09.086723 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31b77a1-518c-4158-b1b0-04d95534b2d5 service cinder] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:56:09.088233 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-e31b77a1-518c-4158-b1b0-04d95534b2d5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:56:09.152145 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:56:09.158468 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31b77a1-518c-4158-b1b0-04d95534b2d5 service cinder] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:56:09.163756 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a07850e-1981-4d68-9e49-31b305e6e142 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e158f461c66e4d779f23fb7760672897', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:56:09.164399 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a07850e-1981-4d68-9e49-31b305e6e142 service swift] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:56:09.164750 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a07850e-1981-4d68-9e49-31b305e6e142 service swift] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:56:09.165044 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a07850e-1981-4d68-9e49-31b305e6e142 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:56:09.173758 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a07850e-1981-4d68-9e49-31b305e6e142 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:56:09.175401 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a07850e-1981-4d68-9e49-31b305e6e142 service swift] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:56:09.183560 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1340/2689] 10.222.0.15 () {60 vars in 1384 bytes} [Tue May 31 14:56:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 31 14:56:10.334406 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570fad32-7973-413a-9a93-3406bff63a1b None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:56:10.334921 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570fad32-7973-413a-9a93-3406bff63a1b None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:56:10.335030 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570fad32-7973-413a-9a93-3406bff63a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:56:10.352135 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-570fad32-7973-413a-9a93-3406bff63a1b None None] MFA Rules not processed for user `735d2518c8404bd991acee533b314039`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:56:10.353310 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-570fad32-7973-413a-9a93-3406bff63a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:56:10.360587 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1350/2690] 10.222.0.15 () {58 vars in 967 bytes} [Tue May 31 14:56:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:56:10.372849 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a07850e-1981-4d68-9e49-31b305e6e142 service swift] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:56:10.383655 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a07850e-1981-4d68-9e49-31b305e6e142 service swift] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:56:10.388688 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafc37c6-44a7-48e0-91d1-e0da9f1e0cf7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e158f461c66e4d779f23fb7760672897', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:56:10.389306 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafc37c6-44a7-48e0-91d1-e0da9f1e0cf7 service swift] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:56:10.389588 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafc37c6-44a7-48e0-91d1-e0da9f1e0cf7 service swift] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:56:10.390447 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafc37c6-44a7-48e0-91d1-e0da9f1e0cf7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:56:10.398524 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafc37c6-44a7-48e0-91d1-e0da9f1e0cf7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:56:10.400155 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafc37c6-44a7-48e0-91d1-e0da9f1e0cf7 service swift] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:56:10.408150 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1341/2691] 10.222.0.15 () {60 vars in 1384 bytes} [Tue May 31 14:56:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 31 14:56:11.069817 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c890c6a4-4e21-43fa-bfa8-90a4e6966ee9 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:56:11.070113 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c890c6a4-4e21-43fa-bfa8-90a4e6966ee9 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:56:11.070394 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c890c6a4-4e21-43fa-bfa8-90a4e6966ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:56:11.087909 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-c890c6a4-4e21-43fa-bfa8-90a4e6966ee9 None None] MFA Rules not processed for user `735d2518c8404bd991acee533b314039`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:56:11.089122 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-c890c6a4-4e21-43fa-bfa8-90a4e6966ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:56:11.098367 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1351/2692] 10.222.0.15 () {58 vars in 1009 bytes} [Tue May 31 14:56:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:56:11.110997 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafc37c6-44a7-48e0-91d1-e0da9f1e0cf7 service swift] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:56:11.121717 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafc37c6-44a7-48e0-91d1-e0da9f1e0cf7 service swift] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:56:11.126929 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20917552-d994-4bed-8509-c64a9d9f7363 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e158f461c66e4d779f23fb7760672897', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:56:11.127610 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20917552-d994-4bed-8509-c64a9d9f7363 service swift] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:56:11.127894 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20917552-d994-4bed-8509-c64a9d9f7363 service swift] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:56:11.128170 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20917552-d994-4bed-8509-c64a9d9f7363 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:56:11.136489 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20917552-d994-4bed-8509-c64a9d9f7363 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:56:11.138166 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20917552-d994-4bed-8509-c64a9d9f7363 service swift] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:56:11.146378 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1342/2693] 10.222.0.15 () {60 vars in 1384 bytes} [Tue May 31 14:56:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 31 14:56:11.796044 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e37178b-f0d3-4e62-9cb9-e5ccc234fada None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:56:11.797086 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e37178b-f0d3-4e62-9cb9-e5ccc234fada None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:56:11.797185 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e37178b-f0d3-4e62-9cb9-e5ccc234fada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:56:11.815365 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-9e37178b-f0d3-4e62-9cb9-e5ccc234fada None None] MFA Rules not processed for user `735d2518c8404bd991acee533b314039`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:56:11.816551 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-9e37178b-f0d3-4e62-9cb9-e5ccc234fada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:56:11.823604 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1352/2694] 10.222.0.15 () {58 vars in 967 bytes} [Tue May 31 14:56:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:56:11.837153 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20917552-d994-4bed-8509-c64a9d9f7363 service swift] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:56:11.848274 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20917552-d994-4bed-8509-c64a9d9f7363 service swift] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:56:11.853284 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6a22bc-a98a-4ef5-aace-24a1254c15d7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e158f461c66e4d779f23fb7760672897', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:56:11.853917 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a22bc-a98a-4ef5-aace-24a1254c15d7 service swift] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:56:11.854203 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a22bc-a98a-4ef5-aace-24a1254c15d7 service swift] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:56:11.854482 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a22bc-a98a-4ef5-aace-24a1254c15d7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:56:11.863034 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6a22bc-a98a-4ef5-aace-24a1254c15d7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:56:11.864602 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6a22bc-a98a-4ef5-aace-24a1254c15d7 service swift] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:56:11.872525 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1343/2695] 10.222.0.15 () {60 vars in 1384 bytes} [Tue May 31 14:56:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 31 14:56:14.481008 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e37178b-f0d3-4e62-9cb9-e5ccc234fada None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:56:14.482465 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-9e37178b-f0d3-4e62-9cb9-e5ccc234fada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:56:14.548186 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e37178b-f0d3-4e62-9cb9-e5ccc234fada None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:56:14.552935 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008a4ace-4c10-4335-bce9-2583cba7a787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:56:14.553800 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008a4ace-4c10-4335-bce9-2583cba7a787 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:56:14.554084 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008a4ace-4c10-4335-bce9-2583cba7a787 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:56:14.554434 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008a4ace-4c10-4335-bce9-2583cba7a787 admin admin] PATH_INFO: `/v3/users/d0625845858d4287a43881b79aa9b490` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:56:14.555595 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008a4ace-4c10-4335-bce9-2583cba7a787 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0625845858d4287a43881b79aa9b490)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:56:14.557515 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008a4ace-4c10-4335-bce9-2583cba7a787 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:56:14.581778 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:56:14.768400 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-008a4ace-4c10-4335-bce9-2583cba7a787 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0625845858d4287a43881b79aa9b490'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:56:14.840640 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-008a4ace-4c10-4335-bce9-2583cba7a787 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0625845858d4287a43881b79aa9b490'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:56:14.841232 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-008a4ace-4c10-4335-bce9-2583cba7a787 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0625845858d4287a43881b79aa9b490'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:56:14.849328 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-008a4ace-4c10-4335-bce9-2583cba7a787 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0625845858d4287a43881b79aa9b490'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:56:14.849972 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-008a4ace-4c10-4335-bce9-2583cba7a787 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0625845858d4287a43881b79aa9b490'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:56:14.869108 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1353/2696] 10.222.0.15 () {58 vars in 1223 bytes} [Tue May 31 14:56:14 2022] DELETE /identity/v3/users/d0625845858d4287a43881b79aa9b490 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 14:56:14.874002 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8582c046-cefb-4b21-86f3-b48ecedbfbf8 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:56:14.874492 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8582c046-cefb-4b21-86f3-b48ecedbfbf8 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:56:14.874708 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8582c046-cefb-4b21-86f3-b48ecedbfbf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:56:14.893109 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-8582c046-cefb-4b21-86f3-b48ecedbfbf8 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:56:14.894303 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-8582c046-cefb-4b21-86f3-b48ecedbfbf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:56:14.957375 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1344/2697] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:56:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:56:14.967207 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008a4ace-4c10-4335-bce9-2583cba7a787 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:56:14.968702 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-008a4ace-4c10-4335-bce9-2583cba7a787 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:56:15.031670 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008a4ace-4c10-4335-bce9-2583cba7a787 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:56:15.036714 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e54aeb-a474-4b19-aecc-0c9bbd043dbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:56:15.037837 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e54aeb-a474-4b19-aecc-0c9bbd043dbc service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:56:15.038139 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e54aeb-a474-4b19-aecc-0c9bbd043dbc service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:56:15.038420 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e54aeb-a474-4b19-aecc-0c9bbd043dbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:56:15.048949 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e54aeb-a474-4b19-aecc-0c9bbd043dbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:56:15.054975 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e54aeb-a474-4b19-aecc-0c9bbd043dbc service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:56:15.061541 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1354/2698] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:56:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:56:15.316193 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8582c046-cefb-4b21-86f3-b48ecedbfbf8 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:56:15.321889 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-8582c046-cefb-4b21-86f3-b48ecedbfbf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:56:15.330441 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8582c046-cefb-4b21-86f3-b48ecedbfbf8 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:56:15.335128 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8afa31-51e9-40a8-9d9b-ca23b4b2068d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:56:15.336001 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8afa31-51e9-40a8-9d9b-ca23b4b2068d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:56:15.336372 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8afa31-51e9-40a8-9d9b-ca23b4b2068d admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:56:15.336625 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8afa31-51e9-40a8-9d9b-ca23b4b2068d admin admin] PATH_INFO: `/v3/projects/ffa3312976b44f7a859eda0130fc4eb8` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:56:15.337815 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8afa31-51e9-40a8-9d9b-ca23b4b2068d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffa3312976b44f7a859eda0130fc4eb8)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:56:15.339757 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8afa31-51e9-40a8-9d9b-ca23b4b2068d admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:56:15.480487 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-4a8afa31-51e9-40a8-9d9b-ca23b4b2068d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffa3312976b44f7a859eda0130fc4eb8', 'request_id': 'req-4a8afa31-51e9-40a8-9d9b-ca23b4b2068d'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:56:15.486855 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-4a8afa31-51e9-40a8-9d9b-ca23b4b2068d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffa3312976b44f7a859eda0130fc4eb8', 'request_id': 'req-4a8afa31-51e9-40a8-9d9b-ca23b4b2068d'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:56:15.578275 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-4a8afa31-51e9-40a8-9d9b-ca23b4b2068d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffa3312976b44f7a859eda0130fc4eb8', 'request_id': 'req-4a8afa31-51e9-40a8-9d9b-ca23b4b2068d'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:56:15.589906 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-4a8afa31-51e9-40a8-9d9b-ca23b4b2068d admin admin] The token cache is being invalidate because project ffa3312976b44f7a859eda0130fc4eb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 14:56:15.590197 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-4a8afa31-51e9-40a8-9d9b-ca23b4b2068d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:56:15.590836 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-4a8afa31-51e9-40a8-9d9b-ca23b4b2068d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:56:15.592404 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1345/2699] 10.222.0.15 () {58 vars in 1232 bytes} [Tue May 31 14:56:15 2022] DELETE /identity/v3/projects/ffa3312976b44f7a859eda0130fc4eb8 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:56:23.736213 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e54aeb-a474-4b19-aecc-0c9bbd043dbc service neutron] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:56:23.745226 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e54aeb-a474-4b19-aecc-0c9bbd043dbc service neutron] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:56:23.795336 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ca7909-b190-426c-87f2-d9b40d0842e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:56:23.795994 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ca7909-b190-426c-87f2-d9b40d0842e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:56:23.796282 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ca7909-b190-426c-87f2-d9b40d0842e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:56:23.796563 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ca7909-b190-426c-87f2-d9b40d0842e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:56:23.798348 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-73ca7909-b190-426c-87f2-d9b40d0842e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:56:23.853432 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:56:23.866007 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ca7909-b190-426c-87f2-d9b40d0842e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:56:23.867506 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ca7909-b190-426c-87f2-d9b40d0842e5 service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:56:23.878834 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1355/2700] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:56:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:56:25.587029 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=77,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:56:27.638781 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8afa31-51e9-40a8-9d9b-ca23b4b2068d admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:56:27.640393 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-4a8afa31-51e9-40a8-9d9b-ca23b4b2068d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:56:27.656923 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8afa31-51e9-40a8-9d9b-ca23b4b2068d admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:56:27.666697 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944cd2ce-81d4-40f2-a7e9-6a7f016cbd7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:56:27.666697 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944cd2ce-81d4-40f2-a7e9-6a7f016cbd7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:56:27.666697 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944cd2ce-81d4-40f2-a7e9-6a7f016cbd7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:56:27.666697 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944cd2ce-81d4-40f2-a7e9-6a7f016cbd7c admin admin] PATH_INFO: `/v3/users/3ba53ede9ae9426f9f89c885aea9e32e` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:56:27.667178 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944cd2ce-81d4-40f2-a7e9-6a7f016cbd7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ba53ede9ae9426f9f89c885aea9e32e)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:56:27.667778 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944cd2ce-81d4-40f2-a7e9-6a7f016cbd7c admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:56:27.832704 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-944cd2ce-81d4-40f2-a7e9-6a7f016cbd7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ba53ede9ae9426f9f89c885aea9e32e'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:56:27.840048 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-944cd2ce-81d4-40f2-a7e9-6a7f016cbd7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ba53ede9ae9426f9f89c885aea9e32e'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:56:27.840711 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-944cd2ce-81d4-40f2-a7e9-6a7f016cbd7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ba53ede9ae9426f9f89c885aea9e32e'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:56:27.841311 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-944cd2ce-81d4-40f2-a7e9-6a7f016cbd7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ba53ede9ae9426f9f89c885aea9e32e'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:56:27.853268 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-944cd2ce-81d4-40f2-a7e9-6a7f016cbd7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ba53ede9ae9426f9f89c885aea9e32e'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:56:27.906018 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1346/2701] 10.222.0.15 () {58 vars in 1223 bytes} [Tue May 31 14:56:27 2022] DELETE /identity/v3/users/3ba53ede9ae9426f9f89c885aea9e32e => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:56:28.168834 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ca7909-b190-426c-87f2-d9b40d0842e5 service neutron] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:56:28.182543 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ca7909-b190-426c-87f2-d9b40d0842e5 service neutron] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:56:28.242334 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bff544-8d9e-42d3-b10d-2fa2d92a09d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:56:28.243224 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bff544-8d9e-42d3-b10d-2fa2d92a09d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:56:28.243512 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bff544-8d9e-42d3-b10d-2fa2d92a09d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:56:28.243785 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bff544-8d9e-42d3-b10d-2fa2d92a09d6 admin admin] PATH_INFO: `/v3/projects/0503c5c3583140358334771a93bf9572` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:56:28.244963 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bff544-8d9e-42d3-b10d-2fa2d92a09d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0503c5c3583140358334771a93bf9572)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:56:28.247090 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bff544-8d9e-42d3-b10d-2fa2d92a09d6 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:56:28.385548 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-e7bff544-8d9e-42d3-b10d-2fa2d92a09d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0503c5c3583140358334771a93bf9572', 'request_id': 'req-e7bff544-8d9e-42d3-b10d-2fa2d92a09d6'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:56:28.464227 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-e7bff544-8d9e-42d3-b10d-2fa2d92a09d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0503c5c3583140358334771a93bf9572', 'request_id': 'req-e7bff544-8d9e-42d3-b10d-2fa2d92a09d6'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:56:28.470152 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-e7bff544-8d9e-42d3-b10d-2fa2d92a09d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0503c5c3583140358334771a93bf9572', 'request_id': 'req-e7bff544-8d9e-42d3-b10d-2fa2d92a09d6'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:56:28.481192 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-e7bff544-8d9e-42d3-b10d-2fa2d92a09d6 admin admin] The token cache is being invalidate because project 0503c5c3583140358334771a93bf9572 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80503) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 14:56:28.481479 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-e7bff544-8d9e-42d3-b10d-2fa2d92a09d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:56:28.482104 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-e7bff544-8d9e-42d3-b10d-2fa2d92a09d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:56:28.483680 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1356/2702] 10.222.0.15 () {58 vars in 1232 bytes} [Tue May 31 14:56:28 2022] DELETE /identity/v3/projects/0503c5c3583140358334771a93bf9572 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:56:28.488872 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fa52ca-c485-4a5f-a669-82f7a62b8219 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:56:28.489196 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fa52ca-c485-4a5f-a669-82f7a62b8219 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:56:28.489480 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fa52ca-c485-4a5f-a669-82f7a62b8219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:56:28.507665 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-58fa52ca-c485-4a5f-a669-82f7a62b8219 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:56:28.508873 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-58fa52ca-c485-4a5f-a669-82f7a62b8219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:56:28.571817 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1347/2703] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:56:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:56:28.579648 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd36e84-1df0-4cab-b59a-8b295f7a216b None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:56:28.579937 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd36e84-1df0-4cab-b59a-8b295f7a216b None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:56:28.580238 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd36e84-1df0-4cab-b59a-8b295f7a216b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:56:28.600306 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-7fd36e84-1df0-4cab-b59a-8b295f7a216b None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:56:28.601518 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-7fd36e84-1df0-4cab-b59a-8b295f7a216b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:56:28.609475 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1357/2704] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:56:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:56:28.614383 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fa52ca-c485-4a5f-a669-82f7a62b8219 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:56:28.624149 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fa52ca-c485-4a5f-a669-82f7a62b8219 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:56:28.628900 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7ff890-893d-497e-82e5-7f509641a3fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:56:28.629550 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7ff890-893d-497e-82e5-7f509641a3fb admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:56:28.629834 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7ff890-893d-497e-82e5-7f509641a3fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:56:28.630116 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7ff890-893d-497e-82e5-7f509641a3fb admin admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:56:28.630946 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7ff890-893d-497e-82e5-7f509641a3fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:56:28.631258 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7ff890-893d-497e-82e5-7f509641a3fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:56:28.632854 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7ff890-893d-497e-82e5-7f509641a3fb admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:56:28.645582 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1348/2705] 10.222.0.15 () {58 vars in 1152 bytes} [Tue May 31 14:56:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:56:28.650022 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd36e84-1df0-4cab-b59a-8b295f7a216b None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:56:28.659908 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd36e84-1df0-4cab-b59a-8b295f7a216b None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:56:28.676574 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98deeb6e-b1ca-40a9-8060-daec1a3ac2d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:56:28.676574 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98deeb6e-b1ca-40a9-8060-daec1a3ac2d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:56:28.676574 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98deeb6e-b1ca-40a9-8060-daec1a3ac2d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:56:28.676574 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98deeb6e-b1ca-40a9-8060-daec1a3ac2d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:56:28.677041 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98deeb6e-b1ca-40a9-8060-daec1a3ac2d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:56:28.677041 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98deeb6e-b1ca-40a9-8060-daec1a3ac2d6 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:56:28.746241 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1358/2706] 10.222.0.15 () {60 vars in 1152 bytes} [Tue May 31 14:56:28 2022] POST /identity/v3/projects => generated 385 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:56:28.750456 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7ff890-893d-497e-82e5-7f509641a3fb admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:56:28.762454 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7ff890-893d-497e-82e5-7f509641a3fb admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:56:28.821433 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aaa7cf-984a-444f-8098-4db447fc7fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:56:28.822114 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aaa7cf-984a-444f-8098-4db447fc7fed admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:56:28.822398 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aaa7cf-984a-444f-8098-4db447fc7fed admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:56:28.822715 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aaa7cf-984a-444f-8098-4db447fc7fed admin admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:56:28.823449 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aaa7cf-984a-444f-8098-4db447fc7fed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:56:28.825404 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aaa7cf-984a-444f-8098-4db447fc7fed admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:56:28.832518 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:56:28.888110 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1349/2707] 10.222.0.15 () {60 vars in 1143 bytes} [Tue May 31 14:56:28 2022] POST /identity/v3/users => generated 293 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:56:28.892279 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98deeb6e-b1ca-40a9-8060-daec1a3ac2d6 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:56:28.903563 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98deeb6e-b1ca-40a9-8060-daec1a3ac2d6 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:56:28.908221 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6775a114-7ce9-4096-8ed8-1209e99d59fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:56:28.909453 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6775a114-7ce9-4096-8ed8-1209e99d59fb admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:56:28.909740 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6775a114-7ce9-4096-8ed8-1209e99d59fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:56:28.910024 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6775a114-7ce9-4096-8ed8-1209e99d59fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:56:28.910788 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6775a114-7ce9-4096-8ed8-1209e99d59fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:56:28.913395 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6775a114-7ce9-4096-8ed8-1209e99d59fb admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:56:28.923231 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1359/2708] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:56:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:56:28.927437 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aaa7cf-984a-444f-8098-4db447fc7fed admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:56:28.937714 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aaa7cf-984a-444f-8098-4db447fc7fed admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:56:28.942630 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a226dbe-ef54-412e-80ac-120ae38e0b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:56:28.943292 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a226dbe-ef54-412e-80ac-120ae38e0b5c admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:56:28.943578 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a226dbe-ef54-412e-80ac-120ae38e0b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:56:28.943855 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a226dbe-ef54-412e-80ac-120ae38e0b5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:56:28.944599 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a226dbe-ef54-412e-80ac-120ae38e0b5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:56:28.946185 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a226dbe-ef54-412e-80ac-120ae38e0b5c admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:56:28.956461 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1350/2709] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:56:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:56:28.960751 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6775a114-7ce9-4096-8ed8-1209e99d59fb admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:56:28.970819 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6775a114-7ce9-4096-8ed8-1209e99d59fb admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:56:28.976136 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981bcf92-06f7-4141-98cc-0ee4be37be9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:56:28.977042 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981bcf92-06f7-4141-98cc-0ee4be37be9c admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:56:28.977324 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981bcf92-06f7-4141-98cc-0ee4be37be9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:56:28.977602 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981bcf92-06f7-4141-98cc-0ee4be37be9c admin admin] PATH_INFO: `/v3/projects/a9e3375917e2432896095fab39d37439/users/9a448e88dfc140bd9646480d34564516/roles/317f725e26bf43648d8235bb1f7c4cb3` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:56:28.992516 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981bcf92-06f7-4141-98cc-0ee4be37be9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9e3375917e2432896095fab39d37439, user_id=9a448e88dfc140bd9646480d34564516, role_id=317f725e26bf43648d8235bb1f7c4cb3)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:56:28.995202 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981bcf92-06f7-4141-98cc-0ee4be37be9c admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:56:29.071768 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1360/2710] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:56:28 2022] PUT /identity/v3/projects/a9e3375917e2432896095fab39d37439/users/9a448e88dfc140bd9646480d34564516/roles/317f725e26bf43648d8235bb1f7c4cb3 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:56:29.077066 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2f8d69-b113-404b-819b-e9e1f76aab01 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:56:29.077363 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2f8d69-b113-404b-819b-e9e1f76aab01 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:56:29.077647 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2f8d69-b113-404b-819b-e9e1f76aab01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:56:29.097221 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-9d2f8d69-b113-404b-819b-e9e1f76aab01 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:56:29.104388 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-9d2f8d69-b113-404b-819b-e9e1f76aab01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:56:29.163739 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1351/2711] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:56:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:56:29.173516 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981bcf92-06f7-4141-98cc-0ee4be37be9c admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:56:29.175418 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-981bcf92-06f7-4141-98cc-0ee4be37be9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:56:29.196925 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:56:29.235659 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981bcf92-06f7-4141-98cc-0ee4be37be9c admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:56:29.239598 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff13eb44-4121-4ccd-9ac1-1d95d9c835a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:56:29.240344 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff13eb44-4121-4ccd-9ac1-1d95d9c835a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:56:29.240629 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff13eb44-4121-4ccd-9ac1-1d95d9c835a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:56:29.240920 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff13eb44-4121-4ccd-9ac1-1d95d9c835a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:56:29.251267 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff13eb44-4121-4ccd-9ac1-1d95d9c835a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:56:29.253376 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff13eb44-4121-4ccd-9ac1-1d95d9c835a9 service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:56:29.263838 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1361/2712] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:56:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:56:34.675138 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357524f7-733f-4f22-931c-5ff1abfba882 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:56:34.676207 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357524f7-733f-4f22-931c-5ff1abfba882 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:56:34.676207 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357524f7-733f-4f22-931c-5ff1abfba882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:56:34.704891 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-357524f7-733f-4f22-931c-5ff1abfba882 None None] MFA Rules not processed for user `9a448e88dfc140bd9646480d34564516`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:56:34.706113 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-357524f7-733f-4f22-931c-5ff1abfba882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:56:34.775664 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1352/2713] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:56:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:56:34.791802 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff13eb44-4121-4ccd-9ac1-1d95d9c835a9 service neutron] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:56:34.793331 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-ff13eb44-4121-4ccd-9ac1-1d95d9c835a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:56:34.874856 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff13eb44-4121-4ccd-9ac1-1d95d9c835a9 service neutron] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:56:34.881355 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e160975-5692-4bae-8ccd-4abed261916d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57768d448e345ad8879bf29f21b48ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:56:34.882018 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e160975-5692-4bae-8ccd-4abed261916d service nova] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:56:34.882304 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e160975-5692-4bae-8ccd-4abed261916d service nova] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:56:34.882614 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e160975-5692-4bae-8ccd-4abed261916d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:56:34.891239 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e160975-5692-4bae-8ccd-4abed261916d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:56:34.892868 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e160975-5692-4bae-8ccd-4abed261916d service nova] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:56:34.902483 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1362/2714] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:56:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:56:37.531656 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d0b0b6-650a-46fe-8ae5-aede5e4f295e None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:56:37.532545 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d0b0b6-650a-46fe-8ae5-aede5e4f295e None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:56:37.532863 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d0b0b6-650a-46fe-8ae5-aede5e4f295e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:56:37.553992 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-52d0b0b6-650a-46fe-8ae5-aede5e4f295e None None] MFA Rules not processed for user `9a448e88dfc140bd9646480d34564516`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:56:37.555558 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-52d0b0b6-650a-46fe-8ae5-aede5e4f295e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:56:37.563486 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1353/2715] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:56:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:56:40.733284 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e160975-5692-4bae-8ccd-4abed261916d service nova] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:56:40.734791 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-4e160975-5692-4bae-8ccd-4abed261916d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:56:40.749097 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e160975-5692-4bae-8ccd-4abed261916d service nova] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:56:40.753722 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2486af5-baec-4ea7-923c-273463b61ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:56:40.755304 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2486af5-baec-4ea7-923c-273463b61ca9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:56:40.755589 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2486af5-baec-4ea7-923c-273463b61ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:56:40.755867 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2486af5-baec-4ea7-923c-273463b61ca9 admin admin] PATH_INFO: `/v3/users/afb76149ece24157a0d61962757200bf` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:56:40.757085 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2486af5-baec-4ea7-923c-273463b61ca9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=afb76149ece24157a0d61962757200bf)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:56:40.759104 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2486af5-baec-4ea7-923c-273463b61ca9 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:56:41.056680 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-a2486af5-baec-4ea7-923c-273463b61ca9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afb76149ece24157a0d61962757200bf'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:56:41.127776 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-a2486af5-baec-4ea7-923c-273463b61ca9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afb76149ece24157a0d61962757200bf'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:56:41.128390 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-a2486af5-baec-4ea7-923c-273463b61ca9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afb76149ece24157a0d61962757200bf'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:56:41.140249 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-a2486af5-baec-4ea7-923c-273463b61ca9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afb76149ece24157a0d61962757200bf'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:56:41.140906 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-a2486af5-baec-4ea7-923c-273463b61ca9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afb76149ece24157a0d61962757200bf'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:56:41.158890 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1363/2716] 10.222.0.15 () {58 vars in 1223 bytes} [Tue May 31 14:56:40 2022] DELETE /identity/v3/users/afb76149ece24157a0d61962757200bf => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:56:41.163576 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ffc137-2053-4434-ba4b-79e93a4f783b None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:56:41.172039 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ffc137-2053-4434-ba4b-79e93a4f783b None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:56:41.172039 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ffc137-2053-4434-ba4b-79e93a4f783b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:56:41.181687 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-a6ffc137-2053-4434-ba4b-79e93a4f783b None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:56:41.182929 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-a6ffc137-2053-4434-ba4b-79e93a4f783b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:56:41.248500 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1354/2717] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:56:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:56:41.262174 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2486af5-baec-4ea7-923c-273463b61ca9 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:56:41.263677 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-a2486af5-baec-4ea7-923c-273463b61ca9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:56:41.293539 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:56:41.343695 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2486af5-baec-4ea7-923c-273463b61ca9 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:56:41.347719 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805171bb-960b-4324-b61d-e6c79b67df46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:56:41.352128 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805171bb-960b-4324-b61d-e6c79b67df46 service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:56:41.352128 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805171bb-960b-4324-b61d-e6c79b67df46 service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:56:41.352128 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805171bb-960b-4324-b61d-e6c79b67df46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:56:41.359185 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805171bb-960b-4324-b61d-e6c79b67df46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:56:41.360641 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805171bb-960b-4324-b61d-e6c79b67df46 service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:56:41.373430 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1364/2718] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:56:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:56:41.847624 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ffc137-2053-4434-ba4b-79e93a4f783b None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:56:41.849771 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-a6ffc137-2053-4434-ba4b-79e93a4f783b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:56:41.860103 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:56:41.862697 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ffc137-2053-4434-ba4b-79e93a4f783b None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:56:41.868023 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d542a581-8944-43da-9010-88e5d82b6c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:56:41.869075 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d542a581-8944-43da-9010-88e5d82b6c33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:56:41.869364 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d542a581-8944-43da-9010-88e5d82b6c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:56:41.869644 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d542a581-8944-43da-9010-88e5d82b6c33 admin admin] PATH_INFO: `/v3/projects/8bd9ef125aed4159954bcc67cbfa7ee5` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:56:41.871015 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d542a581-8944-43da-9010-88e5d82b6c33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bd9ef125aed4159954bcc67cbfa7ee5)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:56:41.872966 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d542a581-8944-43da-9010-88e5d82b6c33 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:56:42.012129 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-d542a581-8944-43da-9010-88e5d82b6c33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bd9ef125aed4159954bcc67cbfa7ee5', 'request_id': 'req-d542a581-8944-43da-9010-88e5d82b6c33'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:56:42.021464 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-d542a581-8944-43da-9010-88e5d82b6c33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bd9ef125aed4159954bcc67cbfa7ee5', 'request_id': 'req-d542a581-8944-43da-9010-88e5d82b6c33'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:56:42.070466 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-d542a581-8944-43da-9010-88e5d82b6c33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bd9ef125aed4159954bcc67cbfa7ee5', 'request_id': 'req-d542a581-8944-43da-9010-88e5d82b6c33'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:56:42.083139 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-d542a581-8944-43da-9010-88e5d82b6c33 admin admin] The token cache is being invalidate because project 8bd9ef125aed4159954bcc67cbfa7ee5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 14:56:42.087127 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-d542a581-8944-43da-9010-88e5d82b6c33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:56:42.087911 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-d542a581-8944-43da-9010-88e5d82b6c33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 14:56:42.089667 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1355/2719] 10.222.0.15 () {58 vars in 1232 bytes} [Tue May 31 14:56:41 2022] DELETE /identity/v3/projects/8bd9ef125aed4159954bcc67cbfa7ee5 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:56:42.095097 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873e84c8-65b6-4b77-9481-4d5e26fc78ef None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:56:42.095956 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873e84c8-65b6-4b77-9481-4d5e26fc78ef None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:56:42.096393 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873e84c8-65b6-4b77-9481-4d5e26fc78ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:56:42.120051 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-873e84c8-65b6-4b77-9481-4d5e26fc78ef None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:56:42.121313 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-873e84c8-65b6-4b77-9481-4d5e26fc78ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:56:42.183947 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1365/2720] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:56:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:56:42.192217 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8895c47-2e07-4d6a-bcb9-56336ec3eb8e None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:56:42.193214 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8895c47-2e07-4d6a-bcb9-56336ec3eb8e None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:56:42.196093 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8895c47-2e07-4d6a-bcb9-56336ec3eb8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:56:42.228604 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-f8895c47-2e07-4d6a-bcb9-56336ec3eb8e None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:56:42.228604 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-f8895c47-2e07-4d6a-bcb9-56336ec3eb8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:56:42.237564 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1356/2721] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:56:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:56:42.241460 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873e84c8-65b6-4b77-9481-4d5e26fc78ef None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:56:42.253962 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873e84c8-65b6-4b77-9481-4d5e26fc78ef None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:56:42.260477 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cae7d9-d362-4b20-8ee7-bca3fa80b440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:56:42.261226 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cae7d9-d362-4b20-8ee7-bca3fa80b440 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:56:42.261513 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cae7d9-d362-4b20-8ee7-bca3fa80b440 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:56:42.261788 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cae7d9-d362-4b20-8ee7-bca3fa80b440 admin admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:56:42.262520 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cae7d9-d362-4b20-8ee7-bca3fa80b440 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 14:56:42.262855 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cae7d9-d362-4b20-8ee7-bca3fa80b440 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:56:42.264497 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cae7d9-d362-4b20-8ee7-bca3fa80b440 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:56:42.284423 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1366/2722] 10.222.0.15 () {58 vars in 1152 bytes} [Tue May 31 14:56:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 14:56:42.289987 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8895c47-2e07-4d6a-bcb9-56336ec3eb8e None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:56:42.310452 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8895c47-2e07-4d6a-bcb9-56336ec3eb8e None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:56:42.316126 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ed9c1a-d6dc-4605-b27c-688461d10f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:56:42.317116 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ed9c1a-d6dc-4605-b27c-688461d10f1c admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:56:42.317466 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ed9c1a-d6dc-4605-b27c-688461d10f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:56:42.317830 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ed9c1a-d6dc-4605-b27c-688461d10f1c admin admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:56:42.318643 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ed9c1a-d6dc-4605-b27c-688461d10f1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:56:42.320825 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ed9c1a-d6dc-4605-b27c-688461d10f1c admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:56:42.416240 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1357/2723] 10.222.0.15 () {60 vars in 1152 bytes} [Tue May 31 14:56:42 2022] POST /identity/v3/projects => generated 371 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:56:42.421045 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cae7d9-d362-4b20-8ee7-bca3fa80b440 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:56:42.431224 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cae7d9-d362-4b20-8ee7-bca3fa80b440 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:56:42.491431 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6c1236-cf0c-4aa4-8e18-c23a0c1775c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:56:42.492110 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6c1236-cf0c-4aa4-8e18-c23a0c1775c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:56:42.492401 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6c1236-cf0c-4aa4-8e18-c23a0c1775c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:56:42.492685 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6c1236-cf0c-4aa4-8e18-c23a0c1775c0 admin admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:56:42.493395 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6c1236-cf0c-4aa4-8e18-c23a0c1775c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:56:42.495400 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6c1236-cf0c-4aa4-8e18-c23a0c1775c0 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:56:42.611832 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1367/2724] 10.222.0.15 () {60 vars in 1143 bytes} [Tue May 31 14:56:42 2022] POST /identity/v3/users => generated 286 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 14:56:42.612963 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ed9c1a-d6dc-4605-b27c-688461d10f1c admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:56:42.623568 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ed9c1a-d6dc-4605-b27c-688461d10f1c admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:56:42.628102 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e91683-c67a-4897-a0ee-aeccb10b2126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:56:42.628770 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e91683-c67a-4897-a0ee-aeccb10b2126 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:56:42.629540 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e91683-c67a-4897-a0ee-aeccb10b2126 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:56:42.629816 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e91683-c67a-4897-a0ee-aeccb10b2126 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:56:42.630532 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e91683-c67a-4897-a0ee-aeccb10b2126 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:56:42.632164 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e91683-c67a-4897-a0ee-aeccb10b2126 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:56:42.642659 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1358/2725] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:56:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:56:42.647515 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6c1236-cf0c-4aa4-8e18-c23a0c1775c0 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:56:42.658162 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6c1236-cf0c-4aa4-8e18-c23a0c1775c0 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:56:42.663445 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c17840-b5cc-4532-a3a8-606e0217fa1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:56:42.664171 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c17840-b5cc-4532-a3a8-606e0217fa1a admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:56:42.664461 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c17840-b5cc-4532-a3a8-606e0217fa1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:56:42.664761 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c17840-b5cc-4532-a3a8-606e0217fa1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:56:42.665489 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c17840-b5cc-4532-a3a8-606e0217fa1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:56:42.667196 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c17840-b5cc-4532-a3a8-606e0217fa1a admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:56:42.679672 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1368/2726] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:56:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:56:42.683831 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e91683-c67a-4897-a0ee-aeccb10b2126 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:56:42.695261 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e91683-c67a-4897-a0ee-aeccb10b2126 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:56:42.700005 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b75dbd3-b6fe-4b24-864c-9c669d544f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:56:42.700881 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b75dbd3-b6fe-4b24-864c-9c669d544f93 admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:56:42.701289 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b75dbd3-b6fe-4b24-864c-9c669d544f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:56:42.701508 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b75dbd3-b6fe-4b24-864c-9c669d544f93 admin admin] PATH_INFO: `/v3/projects/5c2db01ac9ce43359c8857bb3aab5df5/users/93ba1a1e765740c297d67014348022c8/roles/317f725e26bf43648d8235bb1f7c4cb3` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:56:42.716907 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b75dbd3-b6fe-4b24-864c-9c669d544f93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c2db01ac9ce43359c8857bb3aab5df5, user_id=93ba1a1e765740c297d67014348022c8, role_id=317f725e26bf43648d8235bb1f7c4cb3)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:56:42.719668 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b75dbd3-b6fe-4b24-864c-9c669d544f93 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:56:42.796533 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1359/2727] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:56:42 2022] PUT /identity/v3/projects/5c2db01ac9ce43359c8857bb3aab5df5/users/93ba1a1e765740c297d67014348022c8/roles/317f725e26bf43648d8235bb1f7c4cb3 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 14:56:42.801772 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e3ba0-9a75-4177-afad-4254362a603c None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:56:42.802096 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e3ba0-9a75-4177-afad-4254362a603c None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:56:42.802496 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e3ba0-9a75-4177-afad-4254362a603c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:56:42.821758 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-d02e3ba0-9a75-4177-afad-4254362a603c None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:56:42.823689 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-d02e3ba0-9a75-4177-afad-4254362a603c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:56:42.848086 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:56:42.902344 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1369/2728] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:56:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:56:42.914206 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b75dbd3-b6fe-4b24-864c-9c669d544f93 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:56:42.915937 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-4b75dbd3-b6fe-4b24-864c-9c669d544f93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:56:42.982984 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b75dbd3-b6fe-4b24-864c-9c669d544f93 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:56:42.986780 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665c471f-e898-4f0e-822d-85c6a908a16e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:56:42.987473 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665c471f-e898-4f0e-822d-85c6a908a16e service neutron] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:56:42.987762 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665c471f-e898-4f0e-822d-85c6a908a16e service neutron] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:56:42.988049 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665c471f-e898-4f0e-822d-85c6a908a16e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:56:42.999066 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665c471f-e898-4f0e-822d-85c6a908a16e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:56:43.000545 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665c471f-e898-4f0e-822d-85c6a908a16e service neutron] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:56:43.011632 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1360/2729] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:56:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:56:48.491950 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed37b1-0cb6-4f38-ac9b-b8f11dfaa216 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:56:48.492503 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed37b1-0cb6-4f38-ac9b-b8f11dfaa216 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:56:48.492503 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed37b1-0cb6-4f38-ac9b-b8f11dfaa216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:56:48.519661 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-d6ed37b1-0cb6-4f38-ac9b-b8f11dfaa216 None None] MFA Rules not processed for user `93ba1a1e765740c297d67014348022c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:56:48.520923 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-d6ed37b1-0cb6-4f38-ac9b-b8f11dfaa216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:56:48.585528 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1370/2730] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:56:48 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:56:48.589859 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665c471f-e898-4f0e-822d-85c6a908a16e service neutron] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:56:48.600194 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665c471f-e898-4f0e-822d-85c6a908a16e service neutron] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:56:48.604803 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d7db98-26fc-4e13-b244-6f04fa02a690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:56:48.605447 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d7db98-26fc-4e13-b244-6f04fa02a690 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:56:48.605735 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d7db98-26fc-4e13-b244-6f04fa02a690 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:56:48.606029 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d7db98-26fc-4e13-b244-6f04fa02a690 admin admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:56:48.606782 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d7db98-26fc-4e13-b244-6f04fa02a690 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:56:48.608664 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d7db98-26fc-4e13-b244-6f04fa02a690 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:56:48.690293 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1361/2731] 10.222.0.15 () {60 vars in 1152 bytes} [Tue May 31 14:56:48 2022] POST /identity/v3/projects => generated 373 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:56:48.697668 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ed37b1-0cb6-4f38-ac9b-b8f11dfaa216 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:56:48.708900 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ed37b1-0cb6-4f38-ac9b-b8f11dfaa216 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:56:48.771849 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b1fc9a-89ee-436e-8e8a-37be9bb63c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:56:48.772820 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b1fc9a-89ee-436e-8e8a-37be9bb63c0a admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:56:48.773107 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b1fc9a-89ee-436e-8e8a-37be9bb63c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:56:48.773384 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b1fc9a-89ee-436e-8e8a-37be9bb63c0a admin admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:56:48.774074 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b1fc9a-89ee-436e-8e8a-37be9bb63c0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:56:48.776055 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b1fc9a-89ee-436e-8e8a-37be9bb63c0a admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:56:48.842901 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1371/2732] 10.222.0.15 () {60 vars in 1143 bytes} [Tue May 31 14:56:48 2022] POST /identity/v3/users => generated 293 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 14:56:48.846743 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d7db98-26fc-4e13-b244-6f04fa02a690 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:56:48.852928 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:56:48.858158 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d7db98-26fc-4e13-b244-6f04fa02a690 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:56:48.863295 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803d2a3d-b305-4145-81dd-0e9c5f998b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:56:48.863471 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803d2a3d-b305-4145-81dd-0e9c5f998b7c admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:56:48.863760 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803d2a3d-b305-4145-81dd-0e9c5f998b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:56:48.864037 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803d2a3d-b305-4145-81dd-0e9c5f998b7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:56:48.864802 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803d2a3d-b305-4145-81dd-0e9c5f998b7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:56:48.866409 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803d2a3d-b305-4145-81dd-0e9c5f998b7c admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:56:48.877199 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1362/2733] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:56:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 14:56:48.881363 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b1fc9a-89ee-436e-8e8a-37be9bb63c0a admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:56:48.892212 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b1fc9a-89ee-436e-8e8a-37be9bb63c0a admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:56:48.897966 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b10a20-afe2-4ea3-80b7-92c6796071dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:56:48.898895 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b10a20-afe2-4ea3-80b7-92c6796071dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:56:48.899201 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b10a20-afe2-4ea3-80b7-92c6796071dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:56:48.899452 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b10a20-afe2-4ea3-80b7-92c6796071dc admin admin] PATH_INFO: `/v3/projects/5881a99420f0412fb326131d597c97fe/users/2cdcca27d0df4627a5512132dffebf58/roles/76c53e2c353644f885028a0226c06146` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:56:48.916265 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b10a20-afe2-4ea3-80b7-92c6796071dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=5881a99420f0412fb326131d597c97fe, user_id=2cdcca27d0df4627a5512132dffebf58, role_id=76c53e2c353644f885028a0226c06146)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:56:48.921186 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b10a20-afe2-4ea3-80b7-92c6796071dc admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:56:48.995783 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1372/2734] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:56:48 2022] PUT /identity/v3/projects/5881a99420f0412fb326131d597c97fe/users/2cdcca27d0df4627a5512132dffebf58/roles/76c53e2c353644f885028a0226c06146 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:56:48.999664 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803d2a3d-b305-4145-81dd-0e9c5f998b7c admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:56:49.014013 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803d2a3d-b305-4145-81dd-0e9c5f998b7c admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:56:49.071024 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc433281-de78-40d5-9311-771c64a42d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:56:49.071867 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc433281-de78-40d5-9311-771c64a42d99 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:56:49.072381 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc433281-de78-40d5-9311-771c64a42d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:56:49.072729 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc433281-de78-40d5-9311-771c64a42d99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:56:49.073459 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc433281-de78-40d5-9311-771c64a42d99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:56:49.075103 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc433281-de78-40d5-9311-771c64a42d99 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:56:49.085758 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1363/2735] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 14:56:48 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 14:56:49.090102 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b10a20-afe2-4ea3-80b7-92c6796071dc admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:56:49.100875 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b10a20-afe2-4ea3-80b7-92c6796071dc admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:56:49.106191 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6aa0f6-0d43-46da-9f95-05d9c69bf8cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:56:49.107219 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6aa0f6-0d43-46da-9f95-05d9c69bf8cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:56:49.107504 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6aa0f6-0d43-46da-9f95-05d9c69bf8cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:56:49.107810 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6aa0f6-0d43-46da-9f95-05d9c69bf8cb admin admin] PATH_INFO: `/v3/projects/5881a99420f0412fb326131d597c97fe/users/2cdcca27d0df4627a5512132dffebf58/roles/76c53e2c353644f885028a0226c06146` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:56:49.109815 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6aa0f6-0d43-46da-9f95-05d9c69bf8cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=5881a99420f0412fb326131d597c97fe, user_id=2cdcca27d0df4627a5512132dffebf58, role_id=76c53e2c353644f885028a0226c06146)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:56:49.112513 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6aa0f6-0d43-46da-9f95-05d9c69bf8cb admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:56:49.123390 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1373/2736] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 14:56:49 2022] PUT /identity/v3/projects/5881a99420f0412fb326131d597c97fe/users/2cdcca27d0df4627a5512132dffebf58/roles/76c53e2c353644f885028a0226c06146 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 14:56:51.900672 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc433281-de78-40d5-9311-771c64a42d99 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:56:51.903732 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-bc433281-de78-40d5-9311-771c64a42d99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:56:52.044787 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc433281-de78-40d5-9311-771c64a42d99 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:56:52.232087 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ee99f4-4ef0-435d-9d41-453c50b6c67b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57768d448e345ad8879bf29f21b48ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:56:52.232791 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee99f4-4ef0-435d-9d41-453c50b6c67b service nova] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:56:52.233076 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee99f4-4ef0-435d-9d41-453c50b6c67b service nova] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:56:52.233363 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee99f4-4ef0-435d-9d41-453c50b6c67b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:56:52.255305 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-51ee99f4-4ef0-435d-9d41-453c50b6c67b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:56:52.284677 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ee99f4-4ef0-435d-9d41-453c50b6c67b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:56:52.287087 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ee99f4-4ef0-435d-9d41-453c50b6c67b service nova] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:56:52.317633 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1364/2737] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:56:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:56:55.493063 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651856a7-648a-424b-bc92-26fe40130a03 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:56:55.493596 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651856a7-648a-424b-bc92-26fe40130a03 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:56:55.493708 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651856a7-648a-424b-bc92-26fe40130a03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:56:55.516185 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:56:55.527284 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-651856a7-648a-424b-bc92-26fe40130a03 None None] MFA Rules not processed for user `2cdcca27d0df4627a5512132dffebf58`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:56:55.528517 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-651856a7-648a-424b-bc92-26fe40130a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:56:55.611870 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1374/2738] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:56:55 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:56:55.625322 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ee99f4-4ef0-435d-9d41-453c50b6c67b service nova] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:56:55.627258 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-51ee99f4-4ef0-435d-9d41-453c50b6c67b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:56:55.641682 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ee99f4-4ef0-435d-9d41-453c50b6c67b service nova] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:56:55.649863 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9030be48-0814-4c0b-9647-bf1de0b3798c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57768d448e345ad8879bf29f21b48ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:56:55.649863 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9030be48-0814-4c0b-9647-bf1de0b3798c service nova] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:56:55.649863 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9030be48-0814-4c0b-9647-bf1de0b3798c service nova] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:56:55.649863 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9030be48-0814-4c0b-9647-bf1de0b3798c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:56:55.659509 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=100 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:56:55.709257 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9030be48-0814-4c0b-9647-bf1de0b3798c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:56:55.711059 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9030be48-0814-4c0b-9647-bf1de0b3798c service nova] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:56:55.720497 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1365/2739] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:56:55 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:56:58.409798 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb7a622-4e7c-462d-9e9b-54bfe99a1e1f None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:56:58.410692 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb7a622-4e7c-462d-9e9b-54bfe99a1e1f None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:56:58.411663 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb7a622-4e7c-462d-9e9b-54bfe99a1e1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:56:58.430680 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-bcb7a622-4e7c-462d-9e9b-54bfe99a1e1f None None] MFA Rules not processed for user `93ba1a1e765740c297d67014348022c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:56:58.431926 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-bcb7a622-4e7c-462d-9e9b-54bfe99a1e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:56:58.438966 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1375/2740] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:56:58 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:57:05.739317 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=23 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:57:08.424759 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=33 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:57:24.601680 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9030be48-0814-4c0b-9647-bf1de0b3798c service nova] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:57:24.603220 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-9030be48-0814-4c0b-9647-bf1de0b3798c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:57:24.662301 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9030be48-0814-4c0b-9647-bf1de0b3798c service nova] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:57:24.666001 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd598e9-1447-4b18-829b-eb46ea9b93df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:57:24.667047 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd598e9-1447-4b18-829b-eb46ea9b93df service neutron] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:57:24.667047 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd598e9-1447-4b18-829b-eb46ea9b93df service neutron] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:57:24.667343 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd598e9-1447-4b18-829b-eb46ea9b93df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:57:24.677123 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd598e9-1447-4b18-829b-eb46ea9b93df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:57:24.678815 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd598e9-1447-4b18-829b-eb46ea9b93df service neutron] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:57:24.689075 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1366/2741] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:57:24 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:57:34.684202 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=26 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:57:35.193190 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04087446-2d2d-453c-a058-1a839e959641 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:57:35.194030 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04087446-2d2d-453c-a058-1a839e959641 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:57:35.194266 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04087446-2d2d-453c-a058-1a839e959641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:57:35.212371 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-04087446-2d2d-453c-a058-1a839e959641 None None] MFA Rules not processed for user `9a448e88dfc140bd9646480d34564516`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:57:35.215812 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-04087446-2d2d-453c-a058-1a839e959641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:57:35.269270 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1376/2742] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:57:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:57:45.262244 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=25 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:58:27.796600 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd598e9-1447-4b18-829b-eb46ea9b93df service neutron] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:58:27.806951 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-6bd598e9-1447-4b18-829b-eb46ea9b93df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:58:27.875827 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd598e9-1447-4b18-829b-eb46ea9b93df service neutron] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:58:27.882203 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbbe72b-80e5-4dd9-b2d9-51d7a04dcff2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc959ca520c4816b5ff7f95655e53e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:58:27.882900 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbbe72b-80e5-4dd9-b2d9-51d7a04dcff2 service placement] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:58:27.883185 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbbe72b-80e5-4dd9-b2d9-51d7a04dcff2 service placement] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:58:27.883474 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbbe72b-80e5-4dd9-b2d9-51d7a04dcff2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:58:27.885334 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-5fbbe72b-80e5-4dd9-b2d9-51d7a04dcff2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:58:27.897990 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbbe72b-80e5-4dd9-b2d9-51d7a04dcff2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:58:27.899724 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbbe72b-80e5-4dd9-b2d9-51d7a04dcff2 service placement] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:58:27.911944 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1367/2743] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:58:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:58:37.907014 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=32 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:58:45.363548 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f66c634-9700-41c6-8896-25693d0714e8 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:58:45.364143 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f66c634-9700-41c6-8896-25693d0714e8 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:58:45.364143 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f66c634-9700-41c6-8896-25693d0714e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:58:45.383333 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-2f66c634-9700-41c6-8896-25693d0714e8 None None] MFA Rules not processed for user `9a448e88dfc140bd9646480d34564516`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:58:45.384587 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-2f66c634-9700-41c6-8896-25693d0714e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:58:45.391830 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1377/2744] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:58:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:58:55.376898 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=3 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:59:27.144751 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbbe72b-80e5-4dd9-b2d9-51d7a04dcff2 service placement] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:59:27.165668 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbbe72b-80e5-4dd9-b2d9-51d7a04dcff2 service placement] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:59:27.170013 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7054dc-6858-440b-a5c6-b3b7bef87313 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:59:27.170697 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7054dc-6858-440b-a5c6-b3b7bef87313 service neutron] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:59:27.170991 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7054dc-6858-440b-a5c6-b3b7bef87313 service neutron] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:59:27.171278 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7054dc-6858-440b-a5c6-b3b7bef87313 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:59:27.173087 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-ce7054dc-6858-440b-a5c6-b3b7bef87313 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:59:27.189231 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7054dc-6858-440b-a5c6-b3b7bef87313 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:59:27.190767 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7054dc-6858-440b-a5c6-b3b7bef87313 service neutron] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:59:27.205796 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1368/2745] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:59:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:59:28.413663 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f66c634-9700-41c6-8896-25693d0714e8 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:59:28.424331 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f66c634-9700-41c6-8896-25693d0714e8 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:59:28.428178 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d21444-4354-4753-aab4-15ad41ae5121 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:59:28.428822 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d21444-4354-4753-aab4-15ad41ae5121 service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:59:28.429102 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d21444-4354-4753-aab4-15ad41ae5121 service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:59:28.429387 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d21444-4354-4753-aab4-15ad41ae5121 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:59:28.431262 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-03d21444-4354-4753-aab4-15ad41ae5121 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:59:28.446943 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d21444-4354-4753-aab4-15ad41ae5121 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:59:28.448385 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d21444-4354-4753-aab4-15ad41ae5121 service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:59:28.460533 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1378/2746] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:59:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:59:36.081648 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7054dc-6858-440b-a5c6-b3b7bef87313 service neutron] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:59:36.096959 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7054dc-6858-440b-a5c6-b3b7bef87313 service neutron] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:59:36.101493 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71f500e-dce4-40ce-85b1-7a3a5777b63f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:59:36.102313 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71f500e-dce4-40ce-85b1-7a3a5777b63f service neutron] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:59:36.102641 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71f500e-dce4-40ce-85b1-7a3a5777b63f service neutron] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:59:36.106924 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71f500e-dce4-40ce-85b1-7a3a5777b63f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:59:36.106924 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-c71f500e-dce4-40ce-85b1-7a3a5777b63f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:59:36.117299 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71f500e-dce4-40ce-85b1-7a3a5777b63f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:59:36.120192 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71f500e-dce4-40ce-85b1-7a3a5777b63f service neutron] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:59:36.135932 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1369/2747] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:59:36 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 14:59:36.217477 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d21444-4354-4753-aab4-15ad41ae5121 service neutron] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:59:36.227604 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d21444-4354-4753-aab4-15ad41ae5121 service neutron] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:59:36.231418 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e00ae4-67b6-4421-87e0-6c4c3c1b6ddd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:59:36.232080 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e00ae4-67b6-4421-87e0-6c4c3c1b6ddd service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:59:36.232360 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e00ae4-67b6-4421-87e0-6c4c3c1b6ddd service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:59:36.232648 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e00ae4-67b6-4421-87e0-6c4c3c1b6ddd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:59:36.234496 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-31e00ae4-67b6-4421-87e0-6c4c3c1b6ddd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:59:36.248790 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e00ae4-67b6-4421-87e0-6c4c3c1b6ddd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:59:36.250223 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e00ae4-67b6-4421-87e0-6c4c3c1b6ddd service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:59:36.270480 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1379/2748] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:59:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 14:59:46.128594 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=12 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:59:46.256996 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=12 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 14:59:50.346683 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e599e2e4-f09b-42e2-9313-fbf156dc725c None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:59:50.347209 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e599e2e4-f09b-42e2-9313-fbf156dc725c None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:59:50.347334 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e599e2e4-f09b-42e2-9313-fbf156dc725c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:59:50.365637 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-e599e2e4-f09b-42e2-9313-fbf156dc725c None None] MFA Rules not processed for user `9a448e88dfc140bd9646480d34564516`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 14:59:50.366005 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-e599e2e4-f09b-42e2-9313-fbf156dc725c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:59:50.372905 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1370/2749] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 14:59:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 14:59:50.683519 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e00ae4-67b6-4421-87e0-6c4c3c1b6ddd service neutron] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:59:50.692407 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e00ae4-67b6-4421-87e0-6c4c3c1b6ddd service neutron] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:59:50.696047 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c602d1-5bf5-454b-aec4-2c16b3ccbc9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:59:50.696684 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c602d1-5bf5-454b-aec4-2c16b3ccbc9e service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:59:50.696966 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c602d1-5bf5-454b-aec4-2c16b3ccbc9e service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:59:50.697242 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c602d1-5bf5-454b-aec4-2c16b3ccbc9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:59:50.699054 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-54c602d1-5bf5-454b-aec4-2c16b3ccbc9e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:59:50.709170 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c602d1-5bf5-454b-aec4-2c16b3ccbc9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:59:50.711340 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c602d1-5bf5-454b-aec4-2c16b3ccbc9e service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:59:50.718599 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1380/2750] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:59:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 14:59:54.853024 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e599e2e4-f09b-42e2-9313-fbf156dc725c None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 14:59:54.870618 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e599e2e4-f09b-42e2-9313-fbf156dc725c None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 14:59:54.884612 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3bfe27-501c-43f6-b4ae-6f3fa4c0ad87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57768d448e345ad8879bf29f21b48ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 14:59:54.885291 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3bfe27-501c-43f6-b4ae-6f3fa4c0ad87 service nova] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 14:59:54.885584 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3bfe27-501c-43f6-b4ae-6f3fa4c0ad87 service nova] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 14:59:54.885859 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3bfe27-501c-43f6-b4ae-6f3fa4c0ad87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 14:59:54.887965 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-bb3bfe27-501c-43f6-b4ae-6f3fa4c0ad87 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 14:59:54.901345 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3bfe27-501c-43f6-b4ae-6f3fa4c0ad87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 14:59:54.903129 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3bfe27-501c-43f6-b4ae-6f3fa4c0ad87 service nova] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 14:59:54.914938 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1371/2751] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 14:59:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 15:00:00.715093 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=6 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:00:04.909707 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=9 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:01:01.240884 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c602d1-5bf5-454b-aec4-2c16b3ccbc9e service neutron] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:01:01.291786 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c602d1-5bf5-454b-aec4-2c16b3ccbc9e service neutron] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:01:01.298731 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eed05c-a855-4708-9305-82646b5fab5c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc959ca520c4816b5ff7f95655e53e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:01:01.299402 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eed05c-a855-4708-9305-82646b5fab5c service placement] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:01.299691 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eed05c-a855-4708-9305-82646b5fab5c service placement] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:01.300000 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eed05c-a855-4708-9305-82646b5fab5c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:01.302167 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-44eed05c-a855-4708-9305-82646b5fab5c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 15:01:01.338230 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eed05c-a855-4708-9305-82646b5fab5c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:01:01.341605 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eed05c-a855-4708-9305-82646b5fab5c service placement] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:01:01.350584 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1381/2752] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 15:01:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 15:01:01.378532 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3bfe27-501c-43f6-b4ae-6f3fa4c0ad87 service nova] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:01:01.380068 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-bb3bfe27-501c-43f6-b4ae-6f3fa4c0ad87 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 15:01:01.525758 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3bfe27-501c-43f6-b4ae-6f3fa4c0ad87 service nova] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:01:01.530810 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fc6e38-aca3-4ca5-9a16-667f88c34255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:01:01.531793 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fc6e38-aca3-4ca5-9a16-667f88c34255 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:01.532145 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fc6e38-aca3-4ca5-9a16-667f88c34255 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:01.532489 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fc6e38-aca3-4ca5-9a16-667f88c34255 admin admin] PATH_INFO: `/v3/users/9a448e88dfc140bd9646480d34564516` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:01.533943 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fc6e38-aca3-4ca5-9a16-667f88c34255 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a448e88dfc140bd9646480d34564516)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:01:01.536257 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fc6e38-aca3-4ca5-9a16-667f88c34255 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:01:01.768158 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-98fc6e38-aca3-4ca5-9a16-667f88c34255 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a448e88dfc140bd9646480d34564516'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:01.775999 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-98fc6e38-aca3-4ca5-9a16-667f88c34255 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a448e88dfc140bd9646480d34564516'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:01.776705 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-98fc6e38-aca3-4ca5-9a16-667f88c34255 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a448e88dfc140bd9646480d34564516'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:01.777322 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-98fc6e38-aca3-4ca5-9a16-667f88c34255 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a448e88dfc140bd9646480d34564516'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:01.789407 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-98fc6e38-aca3-4ca5-9a16-667f88c34255 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a448e88dfc140bd9646480d34564516'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:01.945433 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1372/2753] 10.222.0.15 () {58 vars in 1223 bytes} [Tue May 31 15:01:01 2022] DELETE /identity/v3/users/9a448e88dfc140bd9646480d34564516 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 15:01:02.000686 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eed05c-a855-4708-9305-82646b5fab5c service placement] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:01:02.010905 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eed05c-a855-4708-9305-82646b5fab5c service placement] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:01:02.078823 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc1d94c-fe7a-42d1-9e57-cf6c9459793a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:01:02.079846 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc1d94c-fe7a-42d1-9e57-cf6c9459793a service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:02.080189 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc1d94c-fe7a-42d1-9e57-cf6c9459793a service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:02.080890 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc1d94c-fe7a-42d1-9e57-cf6c9459793a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:02.082776 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-0dc1d94c-fe7a-42d1-9e57-cf6c9459793a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 15:01:02.095420 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc1d94c-fe7a-42d1-9e57-cf6c9459793a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:01:02.097021 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc1d94c-fe7a-42d1-9e57-cf6c9459793a service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:01:02.107510 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1382/2754] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 15:01:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 15:01:02.306206 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fc6e38-aca3-4ca5-9a16-667f88c34255 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:01:02.306206 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-98fc6e38-aca3-4ca5-9a16-667f88c34255 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 15:01:02.377721 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:01:02.409917 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fc6e38-aca3-4ca5-9a16-667f88c34255 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:01:02.414739 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f879c88f-2974-415c-81b7-0708a7be3e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:01:02.415608 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f879c88f-2974-415c-81b7-0708a7be3e1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:02.415953 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f879c88f-2974-415c-81b7-0708a7be3e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:02.416426 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f879c88f-2974-415c-81b7-0708a7be3e1c admin admin] PATH_INFO: `/v3/projects/a9e3375917e2432896095fab39d37439` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:02.418001 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f879c88f-2974-415c-81b7-0708a7be3e1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9e3375917e2432896095fab39d37439)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:01:02.419982 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f879c88f-2974-415c-81b7-0708a7be3e1c admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:01:02.558188 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-f879c88f-2974-415c-81b7-0708a7be3e1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9e3375917e2432896095fab39d37439', 'request_id': 'req-f879c88f-2974-415c-81b7-0708a7be3e1c'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:02.564602 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-f879c88f-2974-415c-81b7-0708a7be3e1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9e3375917e2432896095fab39d37439', 'request_id': 'req-f879c88f-2974-415c-81b7-0708a7be3e1c'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:02.649291 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-f879c88f-2974-415c-81b7-0708a7be3e1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9e3375917e2432896095fab39d37439', 'request_id': 'req-f879c88f-2974-415c-81b7-0708a7be3e1c'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:02.661531 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-f879c88f-2974-415c-81b7-0708a7be3e1c admin admin] The token cache is being invalidate because project a9e3375917e2432896095fab39d37439 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 15:01:02.661840 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-f879c88f-2974-415c-81b7-0708a7be3e1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:02.662504 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-f879c88f-2974-415c-81b7-0708a7be3e1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:02.664131 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1373/2755] 10.222.0.15 () {58 vars in 1232 bytes} [Tue May 31 15:01:02 2022] DELETE /identity/v3/projects/a9e3375917e2432896095fab39d37439 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 15:01:02.669129 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b53f2eb-b5e5-4639-922f-be838f7b1315 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:02.669578 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b53f2eb-b5e5-4639-922f-be838f7b1315 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:02.669744 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b53f2eb-b5e5-4639-922f-be838f7b1315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:02.689635 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-3b53f2eb-b5e5-4639-922f-be838f7b1315 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 15:01:02.689635 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-3b53f2eb-b5e5-4639-922f-be838f7b1315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 15:01:02.765120 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1383/2756] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 15:01:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 15:01:02.775441 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9764dd83-7713-49c9-b670-35bfc2af56b7 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:02.775441 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9764dd83-7713-49c9-b670-35bfc2af56b7 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:02.775441 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9764dd83-7713-49c9-b670-35bfc2af56b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:02.794507 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-9764dd83-7713-49c9-b670-35bfc2af56b7 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 15:01:02.795796 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-9764dd83-7713-49c9-b670-35bfc2af56b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 15:01:02.804312 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1374/2757] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 15:01:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 15:01:02.809411 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b53f2eb-b5e5-4639-922f-be838f7b1315 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:01:02.821004 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b53f2eb-b5e5-4639-922f-be838f7b1315 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:01:02.826742 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09cf9e0-0efd-4943-988e-2dfe46782e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:01:02.827530 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09cf9e0-0efd-4943-988e-2dfe46782e53 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:02.827888 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09cf9e0-0efd-4943-988e-2dfe46782e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:02.828229 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09cf9e0-0efd-4943-988e-2dfe46782e53 admin admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:02.829038 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09cf9e0-0efd-4943-988e-2dfe46782e53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 15:01:02.829718 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09cf9e0-0efd-4943-988e-2dfe46782e53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:01:02.831492 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09cf9e0-0efd-4943-988e-2dfe46782e53 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:01:02.846263 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1384/2758] 10.222.0.15 () {58 vars in 1152 bytes} [Tue May 31 15:01:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 15:01:02.852390 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9764dd83-7713-49c9-b670-35bfc2af56b7 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:01:02.863092 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9764dd83-7713-49c9-b670-35bfc2af56b7 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:01:02.868054 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290a6bc3-2949-4283-8621-eb24cf72ff70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:01:02.868758 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a6bc3-2949-4283-8621-eb24cf72ff70 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:02.869043 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a6bc3-2949-4283-8621-eb24cf72ff70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:02.869321 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a6bc3-2949-4283-8621-eb24cf72ff70 admin admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:02.870022 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290a6bc3-2949-4283-8621-eb24cf72ff70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:01:02.872479 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290a6bc3-2949-4283-8621-eb24cf72ff70 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:01:03.002080 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1375/2759] 10.222.0.15 () {60 vars in 1152 bytes} [Tue May 31 15:01:02 2022] POST /identity/v3/projects => generated 385 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 15:01:03.006522 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09cf9e0-0efd-4943-988e-2dfe46782e53 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:01:03.017664 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09cf9e0-0efd-4943-988e-2dfe46782e53 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:01:03.045716 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=100 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:01:03.080338 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e169bde-9aec-4a3a-af3a-4d22124162f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:01:03.081001 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e169bde-9aec-4a3a-af3a-4d22124162f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:03.081514 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e169bde-9aec-4a3a-af3a-4d22124162f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:03.082039 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e169bde-9aec-4a3a-af3a-4d22124162f2 admin admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:03.083510 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e169bde-9aec-4a3a-af3a-4d22124162f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:01:03.085116 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e169bde-9aec-4a3a-af3a-4d22124162f2 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:01:03.189361 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1385/2760] 10.222.0.15 () {60 vars in 1143 bytes} [Tue May 31 15:01:03 2022] POST /identity/v3/users => generated 293 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 15:01:03.193292 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290a6bc3-2949-4283-8621-eb24cf72ff70 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:01:03.203863 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290a6bc3-2949-4283-8621-eb24cf72ff70 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:01:03.208745 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef19c53-fb7b-4f5d-9189-29d1e21d8b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:01:03.209407 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef19c53-fb7b-4f5d-9189-29d1e21d8b4d admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:03.209691 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef19c53-fb7b-4f5d-9189-29d1e21d8b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:03.209972 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef19c53-fb7b-4f5d-9189-29d1e21d8b4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:03.210732 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef19c53-fb7b-4f5d-9189-29d1e21d8b4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:01:03.212322 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef19c53-fb7b-4f5d-9189-29d1e21d8b4d admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:01:03.222259 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1376/2761] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 15:01:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 15:01:03.226405 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e169bde-9aec-4a3a-af3a-4d22124162f2 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:01:03.238007 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e169bde-9aec-4a3a-af3a-4d22124162f2 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:01:03.242787 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c1b3bf-2f85-4e56-8c6c-77aab15dcabd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:01:03.243541 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c1b3bf-2f85-4e56-8c6c-77aab15dcabd admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:03.243825 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c1b3bf-2f85-4e56-8c6c-77aab15dcabd admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:03.244103 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c1b3bf-2f85-4e56-8c6c-77aab15dcabd admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:03.244815 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c1b3bf-2f85-4e56-8c6c-77aab15dcabd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:01:03.247063 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c1b3bf-2f85-4e56-8c6c-77aab15dcabd admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:01:03.256958 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1386/2762] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 15:01:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 15:01:03.261325 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef19c53-fb7b-4f5d-9189-29d1e21d8b4d admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:01:03.271615 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef19c53-fb7b-4f5d-9189-29d1e21d8b4d admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:01:03.276239 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc8020e-153d-4f3a-88ed-70013340a3f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:01:03.277106 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc8020e-153d-4f3a-88ed-70013340a3f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:03.277387 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc8020e-153d-4f3a-88ed-70013340a3f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:03.277682 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc8020e-153d-4f3a-88ed-70013340a3f8 admin admin] PATH_INFO: `/v3/projects/f46b61f69be84b52ba14b823430d6e78/users/05b686c5615b46e4bf3d198ea8ba2eee/roles/317f725e26bf43648d8235bb1f7c4cb3` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:03.293209 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc8020e-153d-4f3a-88ed-70013340a3f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f46b61f69be84b52ba14b823430d6e78, user_id=05b686c5615b46e4bf3d198ea8ba2eee, role_id=317f725e26bf43648d8235bb1f7c4cb3)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:01:03.295969 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc8020e-153d-4f3a-88ed-70013340a3f8 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:01:03.377405 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1377/2763] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 15:01:03 2022] PUT /identity/v3/projects/f46b61f69be84b52ba14b823430d6e78/users/05b686c5615b46e4bf3d198ea8ba2eee/roles/317f725e26bf43648d8235bb1f7c4cb3 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 15:01:03.387572 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d35019-a6cc-40b3-95f5-dc2c54e04589 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:03.387931 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d35019-a6cc-40b3-95f5-dc2c54e04589 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:03.388278 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d35019-a6cc-40b3-95f5-dc2c54e04589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:03.418195 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-34d35019-a6cc-40b3-95f5-dc2c54e04589 None None] MFA Rules not processed for user `05b686c5615b46e4bf3d198ea8ba2eee`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 15:01:03.419882 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-34d35019-a6cc-40b3-95f5-dc2c54e04589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 15:01:03.490705 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1387/2764] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 15:01:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 15:01:03.502126 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc8020e-153d-4f3a-88ed-70013340a3f8 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:01:03.506604 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-8cc8020e-153d-4f3a-88ed-70013340a3f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 15:01:03.573088 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:01:03.589985 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc8020e-153d-4f3a-88ed-70013340a3f8 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:01:03.595902 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b345f5-6fc7-416a-9718-8bbb396892de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b57768d448e345ad8879bf29f21b48ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:01:03.596709 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b345f5-6fc7-416a-9718-8bbb396892de service nova] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:03.597063 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b345f5-6fc7-416a-9718-8bbb396892de service nova] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:03.597412 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b345f5-6fc7-416a-9718-8bbb396892de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:03.606832 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b345f5-6fc7-416a-9718-8bbb396892de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:01:03.608490 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b345f5-6fc7-416a-9718-8bbb396892de service nova] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:01:03.617898 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1378/2765] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 15:01:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 15:01:09.885629 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d35019-a6cc-40b3-95f5-dc2c54e04589 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:01:09.975351 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d35019-a6cc-40b3-95f5-dc2c54e04589 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:01:09.981247 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b64b0a-9c07-4465-8e10-17de8be8ced7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:01:09.982478 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b64b0a-9c07-4465-8e10-17de8be8ced7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:09.982789 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b64b0a-9c07-4465-8e10-17de8be8ced7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:09.987603 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b64b0a-9c07-4465-8e10-17de8be8ced7 admin admin] PATH_INFO: `/v3/users/05b686c5615b46e4bf3d198ea8ba2eee` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:09.987603 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b64b0a-9c07-4465-8e10-17de8be8ced7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05b686c5615b46e4bf3d198ea8ba2eee)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:01:09.987603 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b64b0a-9c07-4465-8e10-17de8be8ced7 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:01:10.009025 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:01:10.322467 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-30b64b0a-9c07-4465-8e10-17de8be8ced7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05b686c5615b46e4bf3d198ea8ba2eee'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:10.449200 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-30b64b0a-9c07-4465-8e10-17de8be8ced7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05b686c5615b46e4bf3d198ea8ba2eee'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:10.449885 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-30b64b0a-9c07-4465-8e10-17de8be8ced7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05b686c5615b46e4bf3d198ea8ba2eee'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:10.458322 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-30b64b0a-9c07-4465-8e10-17de8be8ced7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05b686c5615b46e4bf3d198ea8ba2eee'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:10.459014 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-30b64b0a-9c07-4465-8e10-17de8be8ced7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05b686c5615b46e4bf3d198ea8ba2eee'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:10.477167 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1388/2766] 10.222.0.15 () {58 vars in 1223 bytes} [Tue May 31 15:01:09 2022] DELETE /identity/v3/users/05b686c5615b46e4bf3d198ea8ba2eee => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 15:01:10.481860 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375edf27-ab0c-4c7a-8b2b-34ee128bc998 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:10.482391 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375edf27-ab0c-4c7a-8b2b-34ee128bc998 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:10.482526 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375edf27-ab0c-4c7a-8b2b-34ee128bc998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:10.515665 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-375edf27-ab0c-4c7a-8b2b-34ee128bc998 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 15:01:10.516928 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-375edf27-ab0c-4c7a-8b2b-34ee128bc998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 15:01:10.581933 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1379/2767] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 15:01:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 15:01:10.591431 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b64b0a-9c07-4465-8e10-17de8be8ced7 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:01:10.592908 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-30b64b0a-9c07-4465-8e10-17de8be8ced7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 15:01:10.687685 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b64b0a-9c07-4465-8e10-17de8be8ced7 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:01:10.690670 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb64032-c7c4-4c15-9823-76972f0933c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:01:10.691325 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb64032-c7c4-4c15-9823-76972f0933c8 service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:10.691609 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb64032-c7c4-4c15-9823-76972f0933c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:10.691884 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb64032-c7c4-4c15-9823-76972f0933c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:10.710191 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb64032-c7c4-4c15-9823-76972f0933c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:01:10.710191 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb64032-c7c4-4c15-9823-76972f0933c8 service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:01:10.714011 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1389/2768] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 15:01:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 15:01:11.184962 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375edf27-ab0c-4c7a-8b2b-34ee128bc998 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:01:11.191752 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-375edf27-ab0c-4c7a-8b2b-34ee128bc998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 15:01:11.200491 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375edf27-ab0c-4c7a-8b2b-34ee128bc998 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:01:11.213014 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c15ee61-06ce-442c-8a37-94a6c248e139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:01:11.213907 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c15ee61-06ce-442c-8a37-94a6c248e139 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:11.214190 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c15ee61-06ce-442c-8a37-94a6c248e139 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:11.214465 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c15ee61-06ce-442c-8a37-94a6c248e139 admin admin] PATH_INFO: `/v3/projects/f46b61f69be84b52ba14b823430d6e78` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:11.216253 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c15ee61-06ce-442c-8a37-94a6c248e139 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f46b61f69be84b52ba14b823430d6e78)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:01:11.218214 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c15ee61-06ce-442c-8a37-94a6c248e139 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:01:11.360127 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-8c15ee61-06ce-442c-8a37-94a6c248e139 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f46b61f69be84b52ba14b823430d6e78', 'request_id': 'req-8c15ee61-06ce-442c-8a37-94a6c248e139'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:11.367464 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-8c15ee61-06ce-442c-8a37-94a6c248e139 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f46b61f69be84b52ba14b823430d6e78', 'request_id': 'req-8c15ee61-06ce-442c-8a37-94a6c248e139'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:11.457674 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-8c15ee61-06ce-442c-8a37-94a6c248e139 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f46b61f69be84b52ba14b823430d6e78', 'request_id': 'req-8c15ee61-06ce-442c-8a37-94a6c248e139'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:11.474669 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-8c15ee61-06ce-442c-8a37-94a6c248e139 admin admin] The token cache is being invalidate because project f46b61f69be84b52ba14b823430d6e78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 15:01:11.475267 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-8c15ee61-06ce-442c-8a37-94a6c248e139 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:11.476424 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-8c15ee61-06ce-442c-8a37-94a6c248e139 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:11.478643 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1380/2769] 10.222.0.15 () {58 vars in 1232 bytes} [Tue May 31 15:01:11 2022] DELETE /identity/v3/projects/f46b61f69be84b52ba14b823430d6e78 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 15:01:11.483675 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb26b189-220f-4e38-af92-44afc630c557 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:11.484253 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb26b189-220f-4e38-af92-44afc630c557 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:11.484341 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb26b189-220f-4e38-af92-44afc630c557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:11.526422 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-fb26b189-220f-4e38-af92-44afc630c557 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 15:01:11.528138 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-fb26b189-220f-4e38-af92-44afc630c557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 15:01:11.599370 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1390/2770] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 15:01:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 15:01:11.607366 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1169dd60-8e55-4fbe-8136-e7493094644c None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:11.608339 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1169dd60-8e55-4fbe-8136-e7493094644c None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:11.608632 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1169dd60-8e55-4fbe-8136-e7493094644c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:11.628560 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-1169dd60-8e55-4fbe-8136-e7493094644c None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 15:01:11.629868 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-1169dd60-8e55-4fbe-8136-e7493094644c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 15:01:11.639002 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1381/2771] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 15:01:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 15:01:11.643066 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb26b189-220f-4e38-af92-44afc630c557 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:01:11.655726 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb26b189-220f-4e38-af92-44afc630c557 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:01:11.660952 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ac2ae0-79d5-4c99-a86f-9c74fde27aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:01:11.662060 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ac2ae0-79d5-4c99-a86f-9c74fde27aea admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:11.662060 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ac2ae0-79d5-4c99-a86f-9c74fde27aea admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:11.662277 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ac2ae0-79d5-4c99-a86f-9c74fde27aea admin admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:11.663007 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ac2ae0-79d5-4c99-a86f-9c74fde27aea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 15:01:11.663322 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ac2ae0-79d5-4c99-a86f-9c74fde27aea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:01:11.664933 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ac2ae0-79d5-4c99-a86f-9c74fde27aea admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:01:11.666774 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:01:11.681625 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1391/2772] 10.222.0.15 () {58 vars in 1152 bytes} [Tue May 31 15:01:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 15:01:11.687087 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1169dd60-8e55-4fbe-8136-e7493094644c None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:01:11.697656 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1169dd60-8e55-4fbe-8136-e7493094644c None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:01:11.703819 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46da4058-ffb8-40e1-a9bb-c2db84f84e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:01:11.704583 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46da4058-ffb8-40e1-a9bb-c2db84f84e4e admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:11.705118 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46da4058-ffb8-40e1-a9bb-c2db84f84e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:11.705727 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46da4058-ffb8-40e1-a9bb-c2db84f84e4e admin admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:11.706639 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46da4058-ffb8-40e1-a9bb-c2db84f84e4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:01:11.708741 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46da4058-ffb8-40e1-a9bb-c2db84f84e4e admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:01:11.820495 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1382/2773] 10.222.0.15 () {60 vars in 1152 bytes} [Tue May 31 15:01:11 2022] POST /identity/v3/projects => generated 385 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 15:01:11.824613 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ac2ae0-79d5-4c99-a86f-9c74fde27aea admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:01:11.835819 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ac2ae0-79d5-4c99-a86f-9c74fde27aea admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:01:11.895183 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de49c305-06ea-4edb-8ae1-4c542848567c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:01:11.895870 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de49c305-06ea-4edb-8ae1-4c542848567c admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:11.896167 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de49c305-06ea-4edb-8ae1-4c542848567c admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:11.896442 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de49c305-06ea-4edb-8ae1-4c542848567c admin admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:11.897133 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de49c305-06ea-4edb-8ae1-4c542848567c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:01:11.899108 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de49c305-06ea-4edb-8ae1-4c542848567c admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:01:12.018504 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1392/2774] 10.222.0.15 () {60 vars in 1143 bytes} [Tue May 31 15:01:11 2022] POST /identity/v3/users => generated 293 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 15:01:12.022978 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46da4058-ffb8-40e1-a9bb-c2db84f84e4e admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:01:12.035304 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46da4058-ffb8-40e1-a9bb-c2db84f84e4e admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:01:12.040660 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aa8f38-9ee0-4050-b0be-80bdd22b2349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:01:12.041333 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa8f38-9ee0-4050-b0be-80bdd22b2349 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:12.041623 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa8f38-9ee0-4050-b0be-80bdd22b2349 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:12.041903 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa8f38-9ee0-4050-b0be-80bdd22b2349 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:12.042734 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aa8f38-9ee0-4050-b0be-80bdd22b2349 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:01:12.044852 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aa8f38-9ee0-4050-b0be-80bdd22b2349 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:01:12.058528 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1383/2775] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 15:01:12 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 15:01:12.062744 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de49c305-06ea-4edb-8ae1-4c542848567c admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:01:12.074983 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de49c305-06ea-4edb-8ae1-4c542848567c admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:01:12.080217 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4758fca-64f4-4369-8f79-0787292bb0dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:01:12.081129 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4758fca-64f4-4369-8f79-0787292bb0dd admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:12.081452 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4758fca-64f4-4369-8f79-0787292bb0dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:12.081695 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4758fca-64f4-4369-8f79-0787292bb0dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:12.082423 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4758fca-64f4-4369-8f79-0787292bb0dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:01:12.084174 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4758fca-64f4-4369-8f79-0787292bb0dd admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:01:12.098812 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1393/2776] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 15:01:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 15:01:12.099998 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aa8f38-9ee0-4050-b0be-80bdd22b2349 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:01:12.111179 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aa8f38-9ee0-4050-b0be-80bdd22b2349 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:01:12.116627 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6290d4-95b9-489d-b546-43e5ea4fb749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:01:12.117689 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6290d4-95b9-489d-b546-43e5ea4fb749 admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:12.118037 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6290d4-95b9-489d-b546-43e5ea4fb749 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:12.118327 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6290d4-95b9-489d-b546-43e5ea4fb749 admin admin] PATH_INFO: `/v3/projects/80e55fb7a320409fbb8b81ac25508c9c/users/bf18d4704db646a891eda60fe227fbc9/roles/317f725e26bf43648d8235bb1f7c4cb3` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:12.135361 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6290d4-95b9-489d-b546-43e5ea4fb749 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80e55fb7a320409fbb8b81ac25508c9c, user_id=bf18d4704db646a891eda60fe227fbc9, role_id=317f725e26bf43648d8235bb1f7c4cb3)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:01:12.137950 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6290d4-95b9-489d-b546-43e5ea4fb749 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:01:12.253276 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:01:12.260077 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1384/2777] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 15:01:12 2022] PUT /identity/v3/projects/80e55fb7a320409fbb8b81ac25508c9c/users/bf18d4704db646a891eda60fe227fbc9/roles/317f725e26bf43648d8235bb1f7c4cb3 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 15:01:12.271525 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16ce6f7-1aa8-4f0a-8600-e7169a7858d5 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:12.271820 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16ce6f7-1aa8-4f0a-8600-e7169a7858d5 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:12.272104 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16ce6f7-1aa8-4f0a-8600-e7169a7858d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:12.301237 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-c16ce6f7-1aa8-4f0a-8600-e7169a7858d5 None None] MFA Rules not processed for user `bf18d4704db646a891eda60fe227fbc9`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 15:01:12.302446 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-c16ce6f7-1aa8-4f0a-8600-e7169a7858d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 15:01:12.379123 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1394/2778] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 15:01:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 15:01:12.383685 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6290d4-95b9-489d-b546-43e5ea4fb749 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:01:12.449377 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6290d4-95b9-489d-b546-43e5ea4fb749 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:01:12.455005 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921d66cb-ad43-4dcd-95d8-1208cd756190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:01:12.456120 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d66cb-ad43-4dcd-95d8-1208cd756190 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:12.456396 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d66cb-ad43-4dcd-95d8-1208cd756190 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:12.456683 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d66cb-ad43-4dcd-95d8-1208cd756190 admin admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:12.457387 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921d66cb-ad43-4dcd-95d8-1208cd756190 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:01:12.459359 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921d66cb-ad43-4dcd-95d8-1208cd756190 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:01:12.573431 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1385/2779] 10.222.0.15 () {60 vars in 1152 bytes} [Tue May 31 15:01:12 2022] POST /identity/v3/projects => generated 387 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 15:01:12.580271 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16ce6f7-1aa8-4f0a-8600-e7169a7858d5 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:01:12.589686 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16ce6f7-1aa8-4f0a-8600-e7169a7858d5 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:01:12.657808 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55372e9e-6e55-4a5f-ad1e-dbd0948391a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:01:12.657808 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55372e9e-6e55-4a5f-ad1e-dbd0948391a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:12.657808 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55372e9e-6e55-4a5f-ad1e-dbd0948391a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:12.657808 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55372e9e-6e55-4a5f-ad1e-dbd0948391a7 admin admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:12.658199 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55372e9e-6e55-4a5f-ad1e-dbd0948391a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:01:12.659907 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55372e9e-6e55-4a5f-ad1e-dbd0948391a7 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:01:12.668050 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:01:12.860690 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1395/2780] 10.222.0.15 () {60 vars in 1143 bytes} [Tue May 31 15:01:12 2022] POST /identity/v3/users => generated 300 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 15:01:12.862081 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921d66cb-ad43-4dcd-95d8-1208cd756190 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:01:12.872740 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921d66cb-ad43-4dcd-95d8-1208cd756190 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:01:12.877406 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f80b20a-c38e-4659-bdda-7bae474ed187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:01:12.878138 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f80b20a-c38e-4659-bdda-7bae474ed187 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:12.878685 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f80b20a-c38e-4659-bdda-7bae474ed187 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:12.878939 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f80b20a-c38e-4659-bdda-7bae474ed187 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:12.879733 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f80b20a-c38e-4659-bdda-7bae474ed187 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:01:12.881333 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f80b20a-c38e-4659-bdda-7bae474ed187 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:01:12.892606 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1386/2781] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 15:01:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 15:01:12.896761 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55372e9e-6e55-4a5f-ad1e-dbd0948391a7 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:01:12.907615 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55372e9e-6e55-4a5f-ad1e-dbd0948391a7 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:01:12.912243 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7774a7-7e40-48ea-a31d-d97d4272c2d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:01:12.913122 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7774a7-7e40-48ea-a31d-d97d4272c2d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:12.913403 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7774a7-7e40-48ea-a31d-d97d4272c2d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:12.913680 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7774a7-7e40-48ea-a31d-d97d4272c2d7 admin admin] PATH_INFO: `/v3/projects/294b1e63de7a4ac1a2d683d38cd8e70e/users/120bfc671499444786026a232cb73fee/roles/76c53e2c353644f885028a0226c06146` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:12.928595 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7774a7-7e40-48ea-a31d-d97d4272c2d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=294b1e63de7a4ac1a2d683d38cd8e70e, user_id=120bfc671499444786026a232cb73fee, role_id=76c53e2c353644f885028a0226c06146)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:01:12.932800 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7774a7-7e40-48ea-a31d-d97d4272c2d7 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:01:13.047145 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1396/2782] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 15:01:12 2022] PUT /identity/v3/projects/294b1e63de7a4ac1a2d683d38cd8e70e/users/120bfc671499444786026a232cb73fee/roles/76c53e2c353644f885028a0226c06146 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 15:01:13.051282 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f80b20a-c38e-4659-bdda-7bae474ed187 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:01:13.063395 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f80b20a-c38e-4659-bdda-7bae474ed187 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:01:13.157896 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce20554-a0ce-46f3-a631-1e83ebc3cb2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:01:13.158739 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce20554-a0ce-46f3-a631-1e83ebc3cb2f admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:13.159099 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce20554-a0ce-46f3-a631-1e83ebc3cb2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:13.159447 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce20554-a0ce-46f3-a631-1e83ebc3cb2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:13.160275 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce20554-a0ce-46f3-a631-1e83ebc3cb2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:01:13.162108 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce20554-a0ce-46f3-a631-1e83ebc3cb2f admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:01:13.174127 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1387/2783] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 15:01:13 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 15:01:13.178008 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7774a7-7e40-48ea-a31d-d97d4272c2d7 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:01:13.189398 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7774a7-7e40-48ea-a31d-d97d4272c2d7 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:01:13.194989 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd0a7af-cb76-45db-9012-1551fdfa9f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:01:13.196270 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd0a7af-cb76-45db-9012-1551fdfa9f43 admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:13.196736 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd0a7af-cb76-45db-9012-1551fdfa9f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:13.197310 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd0a7af-cb76-45db-9012-1551fdfa9f43 admin admin] PATH_INFO: `/v3/projects/294b1e63de7a4ac1a2d683d38cd8e70e/users/120bfc671499444786026a232cb73fee/roles/76c53e2c353644f885028a0226c06146` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:13.200818 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd0a7af-cb76-45db-9012-1551fdfa9f43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=294b1e63de7a4ac1a2d683d38cd8e70e, user_id=120bfc671499444786026a232cb73fee, role_id=76c53e2c353644f885028a0226c06146)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:01:13.205191 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd0a7af-cb76-45db-9012-1551fdfa9f43 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:01:13.224969 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1397/2784] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 15:01:13 2022] PUT /identity/v3/projects/294b1e63de7a4ac1a2d683d38cd8e70e/users/120bfc671499444786026a232cb73fee/roles/76c53e2c353644f885028a0226c06146 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 15:01:13.235395 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91464fc-2cdd-4557-afd7-4518ce152d3e None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:13.235686 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91464fc-2cdd-4557-afd7-4518ce152d3e None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:13.235977 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91464fc-2cdd-4557-afd7-4518ce152d3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:13.273006 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-b91464fc-2cdd-4557-afd7-4518ce152d3e None None] MFA Rules not processed for user `120bfc671499444786026a232cb73fee`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 15:01:13.274006 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-b91464fc-2cdd-4557-afd7-4518ce152d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 15:01:13.392080 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:01:13.433009 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1388/2785] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 15:01:13 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 15:01:13.444426 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd0a7af-cb76-45db-9012-1551fdfa9f43 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:01:13.446355 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-bfd0a7af-cb76-45db-9012-1551fdfa9f43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 15:01:13.545995 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd0a7af-cb76-45db-9012-1551fdfa9f43 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:01:13.551070 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f570dfb-d2f4-43b2-96c3-c1a6084e4591 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afbf718dcd9b4741a926b0a2321bd53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:01:13.551852 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f570dfb-d2f4-43b2-96c3-c1a6084e4591 service cinder] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:13.552234 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f570dfb-d2f4-43b2-96c3-c1a6084e4591 service cinder] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:13.552807 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f570dfb-d2f4-43b2-96c3-c1a6084e4591 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:13.564296 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f570dfb-d2f4-43b2-96c3-c1a6084e4591 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:01:13.565957 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f570dfb-d2f4-43b2-96c3-c1a6084e4591 service cinder] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:01:13.586807 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1398/2786] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 15:01:13 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 15:01:13.610830 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91464fc-2cdd-4557-afd7-4518ce152d3e None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:01:13.642469 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f570dfb-d2f4-43b2-96c3-c1a6084e4591 service cinder] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:01:13.642469 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-5f570dfb-d2f4-43b2-96c3-c1a6084e4591 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 15:01:13.682195 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91464fc-2cdd-4557-afd7-4518ce152d3e None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:01:13.687736 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f945e68-3201-4bcc-b824-98ce0a368a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:01:13.688701 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f945e68-3201-4bcc-b824-98ce0a368a70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:13.688990 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f945e68-3201-4bcc-b824-98ce0a368a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:13.689269 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f945e68-3201-4bcc-b824-98ce0a368a70 admin admin] PATH_INFO: `/v3/users/bf18d4704db646a891eda60fe227fbc9` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:13.690589 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f945e68-3201-4bcc-b824-98ce0a368a70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf18d4704db646a891eda60fe227fbc9)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:01:13.692658 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f945e68-3201-4bcc-b824-98ce0a368a70 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:01:13.710806 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f570dfb-d2f4-43b2-96c3-c1a6084e4591 service cinder] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:01:13.716070 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1d6a5a-f81e-468e-864a-41284d9cfdca service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc959ca520c4816b5ff7f95655e53e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:01:13.716797 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d6a5a-f81e-468e-864a-41284d9cfdca service placement] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:13.717128 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d6a5a-f81e-468e-864a-41284d9cfdca service placement] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:13.717382 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d6a5a-f81e-468e-864a-41284d9cfdca service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:13.719422 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-6a1d6a5a-f81e-468e-864a-41284d9cfdca service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 15:01:13.732316 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1d6a5a-f81e-468e-864a-41284d9cfdca service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:01:13.733907 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1d6a5a-f81e-468e-864a-41284d9cfdca service placement] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:01:13.745064 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1399/2787] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 15:01:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 15:01:13.751841 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1d6a5a-f81e-468e-864a-41284d9cfdca service placement] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:01:13.753382 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-6a1d6a5a-f81e-468e-864a-41284d9cfdca service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 15:01:13.767231 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1d6a5a-f81e-468e-864a-41284d9cfdca service placement] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:01:13.786064 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612a44d8-b948-4844-8e76-c99656c6ad1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:01:13.786064 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612a44d8-b948-4844-8e76-c99656c6ad1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:13.786064 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612a44d8-b948-4844-8e76-c99656c6ad1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:13.786064 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612a44d8-b948-4844-8e76-c99656c6ad1b admin admin] PATH_INFO: `/v3/users/93ba1a1e765740c297d67014348022c8` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:13.786966 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612a44d8-b948-4844-8e76-c99656c6ad1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=93ba1a1e765740c297d67014348022c8)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:01:13.786966 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612a44d8-b948-4844-8e76-c99656c6ad1b admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:01:13.929706 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-0f945e68-3201-4bcc-b824-98ce0a368a70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf18d4704db646a891eda60fe227fbc9'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:13.937268 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-0f945e68-3201-4bcc-b824-98ce0a368a70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf18d4704db646a891eda60fe227fbc9'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:13.937943 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-0f945e68-3201-4bcc-b824-98ce0a368a70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf18d4704db646a891eda60fe227fbc9'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:13.938590 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-0f945e68-3201-4bcc-b824-98ce0a368a70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf18d4704db646a891eda60fe227fbc9'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:13.952545 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-0f945e68-3201-4bcc-b824-98ce0a368a70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf18d4704db646a891eda60fe227fbc9'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:13.959642 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:INSERT=4,keystone:SELECT=90,keystone:DELETE=6 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:01:13.964732 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-612a44d8-b948-4844-8e76-c99656c6ad1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93ba1a1e765740c297d67014348022c8'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:14.051717 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1389/2788] 10.222.0.15 () {58 vars in 1223 bytes} [Tue May 31 15:01:13 2022] DELETE /identity/v3/users/bf18d4704db646a891eda60fe227fbc9 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 15:01:14.056039 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c03d66-2438-4736-b9cc-a420381de96a None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:14.056334 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c03d66-2438-4736-b9cc-a420381de96a None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:14.056618 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c03d66-2438-4736-b9cc-a420381de96a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:14.073021 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-52c03d66-2438-4736-b9cc-a420381de96a None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 15:01:14.074221 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-52c03d66-2438-4736-b9cc-a420381de96a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 15:01:14.135012 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1390/2789] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 15:01:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 15:01:14.140721 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-612a44d8-b948-4844-8e76-c99656c6ad1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93ba1a1e765740c297d67014348022c8'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:14.141366 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-612a44d8-b948-4844-8e76-c99656c6ad1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93ba1a1e765740c297d67014348022c8'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:14.144970 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c03d66-2438-4736-b9cc-a420381de96a None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:01:14.146356 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-52c03d66-2438-4736-b9cc-a420381de96a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 15:01:14.155006 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-612a44d8-b948-4844-8e76-c99656c6ad1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93ba1a1e765740c297d67014348022c8'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:14.156018 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-612a44d8-b948-4844-8e76-c99656c6ad1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93ba1a1e765740c297d67014348022c8'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:14.165812 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:01:14.176177 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1400/2790] 10.222.0.15 () {58 vars in 1223 bytes} [Tue May 31 15:01:13 2022] DELETE /identity/v3/users/93ba1a1e765740c297d67014348022c8 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 15:01:14.206898 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c03d66-2438-4736-b9cc-a420381de96a None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:01:14.268228 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9593c2f2-ca8b-4fe9-86c7-bb867a75435b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:01:14.269255 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9593c2f2-ca8b-4fe9-86c7-bb867a75435b service neutron] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:14.270625 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9593c2f2-ca8b-4fe9-86c7-bb867a75435b service neutron] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:14.270625 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9593c2f2-ca8b-4fe9-86c7-bb867a75435b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:14.272982 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-9593c2f2-ca8b-4fe9-86c7-bb867a75435b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 15:01:14.348792 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9593c2f2-ca8b-4fe9-86c7-bb867a75435b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:01:14.350324 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9593c2f2-ca8b-4fe9-86c7-bb867a75435b service neutron] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:01:14.362841 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1391/2791] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 15:01:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 15:01:14.534781 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612a44d8-b948-4844-8e76-c99656c6ad1b admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:01:14.534781 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-612a44d8-b948-4844-8e76-c99656c6ad1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 15:01:14.548490 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612a44d8-b948-4844-8e76-c99656c6ad1b admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:01:14.553288 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500163e5-8a9a-4ef4-b78e-0bc4c1a3a611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:01:14.554183 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500163e5-8a9a-4ef4-b78e-0bc4c1a3a611 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:14.554476 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500163e5-8a9a-4ef4-b78e-0bc4c1a3a611 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:14.554794 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500163e5-8a9a-4ef4-b78e-0bc4c1a3a611 admin admin] PATH_INFO: `/v3/projects/5c2db01ac9ce43359c8857bb3aab5df5` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:14.555999 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500163e5-8a9a-4ef4-b78e-0bc4c1a3a611 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c2db01ac9ce43359c8857bb3aab5df5)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:01:14.557958 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500163e5-8a9a-4ef4-b78e-0bc4c1a3a611 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:01:14.674184 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-500163e5-8a9a-4ef4-b78e-0bc4c1a3a611 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c2db01ac9ce43359c8857bb3aab5df5', 'request_id': 'req-500163e5-8a9a-4ef4-b78e-0bc4c1a3a611'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:14.785894 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-500163e5-8a9a-4ef4-b78e-0bc4c1a3a611 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c2db01ac9ce43359c8857bb3aab5df5', 'request_id': 'req-500163e5-8a9a-4ef4-b78e-0bc4c1a3a611'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:14.792384 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-500163e5-8a9a-4ef4-b78e-0bc4c1a3a611 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c2db01ac9ce43359c8857bb3aab5df5', 'request_id': 'req-500163e5-8a9a-4ef4-b78e-0bc4c1a3a611'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:14.803953 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-500163e5-8a9a-4ef4-b78e-0bc4c1a3a611 admin admin] The token cache is being invalidate because project 5c2db01ac9ce43359c8857bb3aab5df5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80503) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 15:01:14.804246 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-500163e5-8a9a-4ef4-b78e-0bc4c1a3a611 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:14.804893 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-500163e5-8a9a-4ef4-b78e-0bc4c1a3a611 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:14.806429 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1401/2792] 10.222.0.15 () {58 vars in 1232 bytes} [Tue May 31 15:01:14 2022] DELETE /identity/v3/projects/5c2db01ac9ce43359c8857bb3aab5df5 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 15:01:14.811013 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9593c2f2-ca8b-4fe9-86c7-bb867a75435b service neutron] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:01:14.820728 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9593c2f2-ca8b-4fe9-86c7-bb867a75435b service neutron] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:01:14.842091 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500163e5-8a9a-4ef4-b78e-0bc4c1a3a611 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:01:14.843572 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-500163e5-8a9a-4ef4-b78e-0bc4c1a3a611 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 15:01:14.883978 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bf3642-d7f9-4616-bfb2-7ce71e05063c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:01:14.884987 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf3642-d7f9-4616-bfb2-7ce71e05063c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:14.885335 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf3642-d7f9-4616-bfb2-7ce71e05063c admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:14.885676 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf3642-d7f9-4616-bfb2-7ce71e05063c admin admin] PATH_INFO: `/v3/users/2cdcca27d0df4627a5512132dffebf58` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:14.887144 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bf3642-d7f9-4616-bfb2-7ce71e05063c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cdcca27d0df4627a5512132dffebf58)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:01:14.889848 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bf3642-d7f9-4616-bfb2-7ce71e05063c admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:01:14.913891 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:01:14.914906 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500163e5-8a9a-4ef4-b78e-0bc4c1a3a611 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:01:14.920055 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184cce95-ce48-40bd-baba-d9fbbf2c0cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:01:14.920914 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184cce95-ce48-40bd-baba-d9fbbf2c0cf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:14.921200 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184cce95-ce48-40bd-baba-d9fbbf2c0cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:14.921484 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184cce95-ce48-40bd-baba-d9fbbf2c0cf4 admin admin] PATH_INFO: `/v3/projects/80e55fb7a320409fbb8b81ac25508c9c` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:14.923692 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184cce95-ce48-40bd-baba-d9fbbf2c0cf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80e55fb7a320409fbb8b81ac25508c9c)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:01:14.925615 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184cce95-ce48-40bd-baba-d9fbbf2c0cf4 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:01:15.115012 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:01:15.117654 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-12bf3642-d7f9-4616-bfb2-7ce71e05063c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cdcca27d0df4627a5512132dffebf58'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:15.119475 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-184cce95-ce48-40bd-baba-d9fbbf2c0cf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80e55fb7a320409fbb8b81ac25508c9c', 'request_id': 'req-184cce95-ce48-40bd-baba-d9fbbf2c0cf4'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:15.125945 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-12bf3642-d7f9-4616-bfb2-7ce71e05063c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cdcca27d0df4627a5512132dffebf58'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:15.126757 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-12bf3642-d7f9-4616-bfb2-7ce71e05063c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cdcca27d0df4627a5512132dffebf58'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:15.127407 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-12bf3642-d7f9-4616-bfb2-7ce71e05063c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cdcca27d0df4627a5512132dffebf58'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:15.143737 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-12bf3642-d7f9-4616-bfb2-7ce71e05063c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cdcca27d0df4627a5512132dffebf58'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:15.188233 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-184cce95-ce48-40bd-baba-d9fbbf2c0cf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80e55fb7a320409fbb8b81ac25508c9c', 'request_id': 'req-184cce95-ce48-40bd-baba-d9fbbf2c0cf4'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:15.194355 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-184cce95-ce48-40bd-baba-d9fbbf2c0cf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80e55fb7a320409fbb8b81ac25508c9c', 'request_id': 'req-184cce95-ce48-40bd-baba-d9fbbf2c0cf4'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:15.205645 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-184cce95-ce48-40bd-baba-d9fbbf2c0cf4 admin admin] The token cache is being invalidate because project 80e55fb7a320409fbb8b81ac25508c9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80503) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 15:01:15.205926 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-184cce95-ce48-40bd-baba-d9fbbf2c0cf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:15.206625 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-184cce95-ce48-40bd-baba-d9fbbf2c0cf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:15.208198 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1402/2793] 10.222.0.15 () {58 vars in 1232 bytes} [Tue May 31 15:01:14 2022] DELETE /identity/v3/projects/80e55fb7a320409fbb8b81ac25508c9c => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 15:01:15.212019 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184cce95-ce48-40bd-baba-d9fbbf2c0cf4 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:01:15.213304 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-184cce95-ce48-40bd-baba-d9fbbf2c0cf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 15:01:15.251791 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1392/2794] 10.222.0.15 () {58 vars in 1223 bytes} [Tue May 31 15:01:14 2022] DELETE /identity/v3/users/2cdcca27d0df4627a5512132dffebf58 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 15:01:15.278003 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184cce95-ce48-40bd-baba-d9fbbf2c0cf4 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:01:15.339979 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b282d28e-57cb-4386-bf9d-f56e5356f12f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:01:15.340885 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b282d28e-57cb-4386-bf9d-f56e5356f12f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:15.341167 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b282d28e-57cb-4386-bf9d-f56e5356f12f admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:15.341444 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b282d28e-57cb-4386-bf9d-f56e5356f12f admin admin] PATH_INFO: `/v3/users/120bfc671499444786026a232cb73fee` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:15.342692 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b282d28e-57cb-4386-bf9d-f56e5356f12f admin admin] RBAC: Authorizing `identity:delete_user(user_id=120bfc671499444786026a232cb73fee)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:01:15.344671 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b282d28e-57cb-4386-bf9d-f56e5356f12f admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:01:15.485618 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bf3642-d7f9-4616-bfb2-7ce71e05063c admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:01:15.487076 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-12bf3642-d7f9-4616-bfb2-7ce71e05063c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 15:01:15.500696 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bf3642-d7f9-4616-bfb2-7ce71e05063c admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:01:15.506668 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8218fc-30f0-4ea5-b4cc-44b955def53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:01:15.507717 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8218fc-30f0-4ea5-b4cc-44b955def53e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:15.508011 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8218fc-30f0-4ea5-b4cc-44b955def53e admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:15.508294 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8218fc-30f0-4ea5-b4cc-44b955def53e admin admin] PATH_INFO: `/v3/projects/5881a99420f0412fb326131d597c97fe` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:15.509527 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8218fc-30f0-4ea5-b4cc-44b955def53e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5881a99420f0412fb326131d597c97fe)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:01:15.511527 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8218fc-30f0-4ea5-b4cc-44b955def53e admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:01:15.557053 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-b282d28e-57cb-4386-bf9d-f56e5356f12f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '120bfc671499444786026a232cb73fee'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:15.628321 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-b282d28e-57cb-4386-bf9d-f56e5356f12f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '120bfc671499444786026a232cb73fee'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:15.629010 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-b282d28e-57cb-4386-bf9d-f56e5356f12f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '120bfc671499444786026a232cb73fee'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:15.632456 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-2a8218fc-30f0-4ea5-b4cc-44b955def53e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5881a99420f0412fb326131d597c97fe', 'request_id': 'req-2a8218fc-30f0-4ea5-b4cc-44b955def53e'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:15.637090 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-b282d28e-57cb-4386-bf9d-f56e5356f12f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '120bfc671499444786026a232cb73fee'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:15.637775 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-b282d28e-57cb-4386-bf9d-f56e5356f12f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '120bfc671499444786026a232cb73fee'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:15.639819 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-2a8218fc-30f0-4ea5-b4cc-44b955def53e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5881a99420f0412fb326131d597c97fe', 'request_id': 'req-2a8218fc-30f0-4ea5-b4cc-44b955def53e'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:15.651776 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:01:15.657552 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1403/2795] 10.222.0.15 () {58 vars in 1223 bytes} [Tue May 31 15:01:15 2022] DELETE /identity/v3/users/120bfc671499444786026a232cb73fee => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 15:01:15.719803 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-2a8218fc-30f0-4ea5-b4cc-44b955def53e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5881a99420f0412fb326131d597c97fe', 'request_id': 'req-2a8218fc-30f0-4ea5-b4cc-44b955def53e'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:15.733097 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-2a8218fc-30f0-4ea5-b4cc-44b955def53e admin admin] The token cache is being invalidate because project 5881a99420f0412fb326131d597c97fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 15:01:15.733498 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-2a8218fc-30f0-4ea5-b4cc-44b955def53e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:15.734218 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-2a8218fc-30f0-4ea5-b4cc-44b955def53e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:15.736193 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1393/2796] 10.222.0.15 () {58 vars in 1232 bytes} [Tue May 31 15:01:15 2022] DELETE /identity/v3/projects/5881a99420f0412fb326131d597c97fe => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 15:01:16.100677 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b282d28e-57cb-4386-bf9d-f56e5356f12f admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:01:16.104085 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-b282d28e-57cb-4386-bf9d-f56e5356f12f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 15:01:16.172380 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b282d28e-57cb-4386-bf9d-f56e5356f12f admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:01:16.177309 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf4118c-5964-4120-b543-c78bff160c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:01:16.178174 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf4118c-5964-4120-b543-c78bff160c31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:16.178454 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf4118c-5964-4120-b543-c78bff160c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:16.178761 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf4118c-5964-4120-b543-c78bff160c31 admin admin] PATH_INFO: `/v3/projects/294b1e63de7a4ac1a2d683d38cd8e70e` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:16.180088 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf4118c-5964-4120-b543-c78bff160c31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=294b1e63de7a4ac1a2d683d38cd8e70e)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:01:16.182072 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf4118c-5964-4120-b543-c78bff160c31 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:01:16.322517 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-dcf4118c-5964-4120-b543-c78bff160c31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '294b1e63de7a4ac1a2d683d38cd8e70e', 'request_id': 'req-dcf4118c-5964-4120-b543-c78bff160c31'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:16.422762 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-dcf4118c-5964-4120-b543-c78bff160c31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '294b1e63de7a4ac1a2d683d38cd8e70e', 'request_id': 'req-dcf4118c-5964-4120-b543-c78bff160c31'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:16.429632 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-dcf4118c-5964-4120-b543-c78bff160c31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '294b1e63de7a4ac1a2d683d38cd8e70e', 'request_id': 'req-dcf4118c-5964-4120-b543-c78bff160c31'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:16.442531 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-dcf4118c-5964-4120-b543-c78bff160c31 admin admin] The token cache is being invalidate because project 294b1e63de7a4ac1a2d683d38cd8e70e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80503) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 15:01:16.442842 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-dcf4118c-5964-4120-b543-c78bff160c31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:16.443504 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-dcf4118c-5964-4120-b543-c78bff160c31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:16.445102 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1404/2797] 10.222.0.15 () {58 vars in 1232 bytes} [Tue May 31 15:01:16 2022] DELETE /identity/v3/projects/294b1e63de7a4ac1a2d683d38cd8e70e => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 15:01:16.452442 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a04bd6-2298-44e0-9b47-3469288067bf None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:16.452956 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a04bd6-2298-44e0-9b47-3469288067bf None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:16.453077 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a04bd6-2298-44e0-9b47-3469288067bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:16.473715 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-c9a04bd6-2298-44e0-9b47-3469288067bf None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 15:01:16.474989 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-c9a04bd6-2298-44e0-9b47-3469288067bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 15:01:16.536004 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1394/2798] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 15:01:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 15:01:16.543821 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b332f81-a142-4399-9369-601c9098895e None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:16.544111 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b332f81-a142-4399-9369-601c9098895e None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:16.544387 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b332f81-a142-4399-9369-601c9098895e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:16.564047 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-1b332f81-a142-4399-9369-601c9098895e None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 15:01:16.565261 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-1b332f81-a142-4399-9369-601c9098895e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 15:01:16.573343 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1405/2799] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 15:01:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 15:01:16.577628 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a04bd6-2298-44e0-9b47-3469288067bf None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:01:16.587780 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a04bd6-2298-44e0-9b47-3469288067bf None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:01:16.592395 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246d3ec5-1832-4baf-ae07-c8840694a2dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:01:16.593059 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246d3ec5-1832-4baf-ae07-c8840694a2dc admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:16.593369 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246d3ec5-1832-4baf-ae07-c8840694a2dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:16.593649 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246d3ec5-1832-4baf-ae07-c8840694a2dc admin admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:16.594384 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246d3ec5-1832-4baf-ae07-c8840694a2dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 15:01:16.594730 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246d3ec5-1832-4baf-ae07-c8840694a2dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:01:16.596333 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246d3ec5-1832-4baf-ae07-c8840694a2dc admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:01:16.608803 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1395/2800] 10.222.0.15 () {58 vars in 1152 bytes} [Tue May 31 15:01:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 15:01:16.613189 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b332f81-a142-4399-9369-601c9098895e None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:01:16.622497 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b332f81-a142-4399-9369-601c9098895e None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:01:16.630890 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e022bfb7-9118-4264-ad94-903af423b06a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:01:16.630890 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e022bfb7-9118-4264-ad94-903af423b06a admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:16.630890 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e022bfb7-9118-4264-ad94-903af423b06a admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:16.630890 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e022bfb7-9118-4264-ad94-903af423b06a admin admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:16.631416 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e022bfb7-9118-4264-ad94-903af423b06a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:01:16.631635 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e022bfb7-9118-4264-ad94-903af423b06a admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:01:16.754756 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1406/2801] 10.222.0.15 () {60 vars in 1152 bytes} [Tue May 31 15:01:16 2022] POST /identity/v3/projects => generated 379 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 15:01:16.758312 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246d3ec5-1832-4baf-ae07-c8840694a2dc admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:01:16.768329 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246d3ec5-1832-4baf-ae07-c8840694a2dc admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:01:16.776233 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:01:16.824326 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b9820b-4446-40f0-9cf7-7b94bce89903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:01:16.824998 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b9820b-4446-40f0-9cf7-7b94bce89903 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:16.825279 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b9820b-4446-40f0-9cf7-7b94bce89903 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:16.825557 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b9820b-4446-40f0-9cf7-7b94bce89903 admin admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:16.826263 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b9820b-4446-40f0-9cf7-7b94bce89903 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:01:16.828277 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b9820b-4446-40f0-9cf7-7b94bce89903 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:01:16.913780 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1396/2802] 10.222.0.15 () {60 vars in 1143 bytes} [Tue May 31 15:01:16 2022] POST /identity/v3/users => generated 290 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 15:01:16.917947 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e022bfb7-9118-4264-ad94-903af423b06a admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:01:16.929162 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e022bfb7-9118-4264-ad94-903af423b06a admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:01:16.934173 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e5304d-b03f-4320-ae23-43286bfcfa99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:01:16.934961 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e5304d-b03f-4320-ae23-43286bfcfa99 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:16.935237 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e5304d-b03f-4320-ae23-43286bfcfa99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:16.935517 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e5304d-b03f-4320-ae23-43286bfcfa99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:16.936241 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e5304d-b03f-4320-ae23-43286bfcfa99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:01:16.937825 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e5304d-b03f-4320-ae23-43286bfcfa99 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:01:16.948676 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1407/2803] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 15:01:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 15:01:16.952712 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b9820b-4446-40f0-9cf7-7b94bce89903 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:01:16.962905 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b9820b-4446-40f0-9cf7-7b94bce89903 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:01:16.968632 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1433ab-cba4-48ab-ac5d-0a96ae8344c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:01:16.969383 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1433ab-cba4-48ab-ac5d-0a96ae8344c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:16.969587 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1433ab-cba4-48ab-ac5d-0a96ae8344c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:16.969866 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1433ab-cba4-48ab-ac5d-0a96ae8344c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:16.970615 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1433ab-cba4-48ab-ac5d-0a96ae8344c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:01:16.972235 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1433ab-cba4-48ab-ac5d-0a96ae8344c8 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:01:16.983040 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1397/2804] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 15:01:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 15:01:16.987145 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e5304d-b03f-4320-ae23-43286bfcfa99 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:01:16.997655 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e5304d-b03f-4320-ae23-43286bfcfa99 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:01:17.002409 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0124e793-0934-4ee8-8b17-c974ba45e864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:01:17.003361 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0124e793-0934-4ee8-8b17-c974ba45e864 admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:17.003649 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0124e793-0934-4ee8-8b17-c974ba45e864 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:17.003920 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0124e793-0934-4ee8-8b17-c974ba45e864 admin admin] PATH_INFO: `/v3/projects/042100c5e79d452686fb394c2c32539f/users/ef34cae48c74437ea8260a613423b5bc/roles/317f725e26bf43648d8235bb1f7c4cb3` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:17.018462 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0124e793-0934-4ee8-8b17-c974ba45e864 admin admin] RBAC: Authorizing `identity:create_grant(project_id=042100c5e79d452686fb394c2c32539f, user_id=ef34cae48c74437ea8260a613423b5bc, role_id=317f725e26bf43648d8235bb1f7c4cb3)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:01:17.021082 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0124e793-0934-4ee8-8b17-c974ba45e864 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:01:17.085939 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1408/2805] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 15:01:16 2022] PUT /identity/v3/projects/042100c5e79d452686fb394c2c32539f/users/ef34cae48c74437ea8260a613423b5bc/roles/317f725e26bf43648d8235bb1f7c4cb3 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 15:01:17.109422 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d4b90-c266-4860-ab29-e1975947bc12 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:17.109729 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d4b90-c266-4860-ab29-e1975947bc12 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:17.110011 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d4b90-c266-4860-ab29-e1975947bc12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:17.136901 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-5a4d4b90-c266-4860-ab29-e1975947bc12 None None] MFA Rules not processed for user `ef34cae48c74437ea8260a613423b5bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 15:01:17.138141 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-5a4d4b90-c266-4860-ab29-e1975947bc12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 15:01:17.203195 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1398/2806] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 15:01:17 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 15:01:17.214350 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0124e793-0934-4ee8-8b17-c974ba45e864 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:01:17.241788 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:01:17.279813 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0124e793-0934-4ee8-8b17-c974ba45e864 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:01:17.285192 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adf50ed-3cbe-4f46-b736-a0ad85d78acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:01:17.285927 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adf50ed-3cbe-4f46-b736-a0ad85d78acb admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:17.286234 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adf50ed-3cbe-4f46-b736-a0ad85d78acb admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:17.286676 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adf50ed-3cbe-4f46-b736-a0ad85d78acb admin admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:17.287408 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adf50ed-3cbe-4f46-b736-a0ad85d78acb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:01:17.289916 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adf50ed-3cbe-4f46-b736-a0ad85d78acb admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:01:17.515350 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1409/2807] 10.222.0.15 () {60 vars in 1152 bytes} [Tue May 31 15:01:17 2022] POST /identity/v3/projects => generated 383 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 15:01:17.519391 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4d4b90-c266-4860-ab29-e1975947bc12 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:01:17.531014 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4d4b90-c266-4860-ab29-e1975947bc12 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:01:17.587511 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3bc23b-d139-4a6d-bc60-57714a870ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:01:17.588190 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3bc23b-d139-4a6d-bc60-57714a870ee9 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:17.588473 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3bc23b-d139-4a6d-bc60-57714a870ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:17.588751 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3bc23b-d139-4a6d-bc60-57714a870ee9 admin admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:17.589424 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3bc23b-d139-4a6d-bc60-57714a870ee9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:01:17.591378 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3bc23b-d139-4a6d-bc60-57714a870ee9 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:01:17.701655 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1399/2808] 10.222.0.15 () {60 vars in 1143 bytes} [Tue May 31 15:01:17 2022] POST /identity/v3/users => generated 298 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 15:01:17.705981 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adf50ed-3cbe-4f46-b736-a0ad85d78acb admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:01:17.716292 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adf50ed-3cbe-4f46-b736-a0ad85d78acb admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:01:17.720911 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5464dd25-7d77-4b9a-a15a-33d3bc6bdce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:01:17.721556 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5464dd25-7d77-4b9a-a15a-33d3bc6bdce4 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:17.721838 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5464dd25-7d77-4b9a-a15a-33d3bc6bdce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:17.722110 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5464dd25-7d77-4b9a-a15a-33d3bc6bdce4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:17.722854 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5464dd25-7d77-4b9a-a15a-33d3bc6bdce4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:01:17.724533 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5464dd25-7d77-4b9a-a15a-33d3bc6bdce4 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:01:17.735575 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1410/2809] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 15:01:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 15:01:17.739617 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3bc23b-d139-4a6d-bc60-57714a870ee9 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:01:17.750280 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3bc23b-d139-4a6d-bc60-57714a870ee9 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:01:17.755351 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e1de3b-2d76-4212-b17e-2e3d9a83e7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:01:17.756224 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e1de3b-2d76-4212-b17e-2e3d9a83e7b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:17.756503 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e1de3b-2d76-4212-b17e-2e3d9a83e7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:17.756779 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e1de3b-2d76-4212-b17e-2e3d9a83e7b1 admin admin] PATH_INFO: `/v3/projects/02e18855406a41f49b4a67851346e3b1/users/f364a3cddfb040a0b3b6dbbc1ace1a32/roles/76c53e2c353644f885028a0226c06146` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:17.760097 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:01:17.772474 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e1de3b-2d76-4212-b17e-2e3d9a83e7b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02e18855406a41f49b4a67851346e3b1, user_id=f364a3cddfb040a0b3b6dbbc1ace1a32, role_id=76c53e2c353644f885028a0226c06146)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:01:17.775254 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e1de3b-2d76-4212-b17e-2e3d9a83e7b1 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:01:17.855172 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1400/2810] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 15:01:17 2022] PUT /identity/v3/projects/02e18855406a41f49b4a67851346e3b1/users/f364a3cddfb040a0b3b6dbbc1ace1a32/roles/76c53e2c353644f885028a0226c06146 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 15:01:17.859337 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5464dd25-7d77-4b9a-a15a-33d3bc6bdce4 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:01:17.869402 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5464dd25-7d77-4b9a-a15a-33d3bc6bdce4 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:01:17.925990 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f974f9-cc4f-4bda-a9c2-7a6059cbb7cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:01:17.926672 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f974f9-cc4f-4bda-a9c2-7a6059cbb7cd admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:17.926956 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f974f9-cc4f-4bda-a9c2-7a6059cbb7cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:17.927232 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f974f9-cc4f-4bda-a9c2-7a6059cbb7cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:17.927939 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f974f9-cc4f-4bda-a9c2-7a6059cbb7cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:01:17.929516 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f974f9-cc4f-4bda-a9c2-7a6059cbb7cd admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:01:17.939743 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1411/2811] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 15:01:17 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 15:01:17.944136 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e1de3b-2d76-4212-b17e-2e3d9a83e7b1 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:01:17.955569 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e1de3b-2d76-4212-b17e-2e3d9a83e7b1 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:01:17.960613 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab57093e-4e04-438d-aec0-a5208e886116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:01:17.961519 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab57093e-4e04-438d-aec0-a5208e886116 admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:17.961806 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab57093e-4e04-438d-aec0-a5208e886116 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:17.962248 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab57093e-4e04-438d-aec0-a5208e886116 admin admin] PATH_INFO: `/v3/projects/02e18855406a41f49b4a67851346e3b1/users/f364a3cddfb040a0b3b6dbbc1ace1a32/roles/76c53e2c353644f885028a0226c06146` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:17.964302 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab57093e-4e04-438d-aec0-a5208e886116 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02e18855406a41f49b4a67851346e3b1, user_id=f364a3cddfb040a0b3b6dbbc1ace1a32, role_id=76c53e2c353644f885028a0226c06146)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:01:17.967020 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab57093e-4e04-438d-aec0-a5208e886116 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:01:17.977347 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1401/2812] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 15:01:17 2022] PUT /identity/v3/projects/02e18855406a41f49b4a67851346e3b1/users/f364a3cddfb040a0b3b6dbbc1ace1a32/roles/76c53e2c353644f885028a0226c06146 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 15:01:17.989514 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a323d4e5-5a65-48ac-917a-a957a569f4ee None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:17.989810 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a323d4e5-5a65-48ac-917a-a957a569f4ee None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:17.990095 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a323d4e5-5a65-48ac-917a-a957a569f4ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:18.018004 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-a323d4e5-5a65-48ac-917a-a957a569f4ee None None] MFA Rules not processed for user `f364a3cddfb040a0b3b6dbbc1ace1a32`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 15:01:18.019259 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-a323d4e5-5a65-48ac-917a-a957a569f4ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 15:01:18.088402 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1412/2813] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 15:01:17 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 15:01:18.099283 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab57093e-4e04-438d-aec0-a5208e886116 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:01:18.101001 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-ab57093e-4e04-438d-aec0-a5208e886116 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 15:01:18.159146 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab57093e-4e04-438d-aec0-a5208e886116 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:01:18.162668 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353ea8bb-3435-4493-bfa3-44d22b3af8f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afbf718dcd9b4741a926b0a2321bd53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:01:18.163314 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ea8bb-3435-4493-bfa3-44d22b3af8f7 service cinder] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:18.163592 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ea8bb-3435-4493-bfa3-44d22b3af8f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:18.163872 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ea8bb-3435-4493-bfa3-44d22b3af8f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:18.173473 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353ea8bb-3435-4493-bfa3-44d22b3af8f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:01:18.174952 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353ea8bb-3435-4493-bfa3-44d22b3af8f7 service cinder] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:01:18.184374 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1402/2814] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 15:01:18 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 15:01:18.285718 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a323d4e5-5a65-48ac-917a-a957a569f4ee None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:01:18.301170 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a323d4e5-5a65-48ac-917a-a957a569f4ee None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:01:18.305746 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e81899b-6409-4c08-8b67-6a1ff9b0a40f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afbf718dcd9b4741a926b0a2321bd53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:01:18.306401 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e81899b-6409-4c08-8b67-6a1ff9b0a40f service cinder] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:18.306730 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e81899b-6409-4c08-8b67-6a1ff9b0a40f service cinder] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:18.307005 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e81899b-6409-4c08-8b67-6a1ff9b0a40f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:18.325035 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:01:18.364273 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e81899b-6409-4c08-8b67-6a1ff9b0a40f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:01:18.365766 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e81899b-6409-4c08-8b67-6a1ff9b0a40f service cinder] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:01:18.376036 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1413/2815] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 15:01:18 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 15:01:21.480398 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353ea8bb-3435-4493-bfa3-44d22b3af8f7 service cinder] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:01:21.550028 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353ea8bb-3435-4493-bfa3-44d22b3af8f7 service cinder] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:01:21.555612 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457e6d88-fee5-44f7-8014-b8e3f9419791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:01:21.556516 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e6d88-fee5-44f7-8014-b8e3f9419791 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:21.556803 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e6d88-fee5-44f7-8014-b8e3f9419791 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:21.557086 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e6d88-fee5-44f7-8014-b8e3f9419791 admin admin] PATH_INFO: `/v3/users/ef34cae48c74437ea8260a613423b5bc` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:21.558390 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457e6d88-fee5-44f7-8014-b8e3f9419791 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef34cae48c74437ea8260a613423b5bc)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:01:21.560394 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457e6d88-fee5-44f7-8014-b8e3f9419791 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:01:21.732347 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-457e6d88-fee5-44f7-8014-b8e3f9419791 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef34cae48c74437ea8260a613423b5bc'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:21.740136 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-457e6d88-fee5-44f7-8014-b8e3f9419791 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef34cae48c74437ea8260a613423b5bc'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:21.745481 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-457e6d88-fee5-44f7-8014-b8e3f9419791 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef34cae48c74437ea8260a613423b5bc'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:21.745481 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-457e6d88-fee5-44f7-8014-b8e3f9419791 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef34cae48c74437ea8260a613423b5bc'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:21.755086 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-457e6d88-fee5-44f7-8014-b8e3f9419791 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef34cae48c74437ea8260a613423b5bc'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:21.757685 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:01:21.857672 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1403/2816] 10.222.0.15 () {58 vars in 1223 bytes} [Tue May 31 15:01:21 2022] DELETE /identity/v3/users/ef34cae48c74437ea8260a613423b5bc => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 15:01:21.862479 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d40f95-9688-41ea-b16d-2619a9794fe5 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:21.864048 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d40f95-9688-41ea-b16d-2619a9794fe5 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:21.864048 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d40f95-9688-41ea-b16d-2619a9794fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:21.883391 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-29d40f95-9688-41ea-b16d-2619a9794fe5 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 15:01:21.884636 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-29d40f95-9688-41ea-b16d-2619a9794fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 15:01:21.953430 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1414/2817] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 15:01:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 15:01:21.964152 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457e6d88-fee5-44f7-8014-b8e3f9419791 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:01:21.966034 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-457e6d88-fee5-44f7-8014-b8e3f9419791 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 15:01:22.027768 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457e6d88-fee5-44f7-8014-b8e3f9419791 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:01:22.031994 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0b4f98-ffe3-4b4c-88ae-41ead076762a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:01:22.032610 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b4f98-ffe3-4b4c-88ae-41ead076762a service neutron] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:22.033078 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b4f98-ffe3-4b4c-88ae-41ead076762a service neutron] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:22.033301 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b4f98-ffe3-4b4c-88ae-41ead076762a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:22.042810 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0b4f98-ffe3-4b4c-88ae-41ead076762a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:01:22.044311 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0b4f98-ffe3-4b4c-88ae-41ead076762a service neutron] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:01:22.055767 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1404/2818] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 15:01:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 15:01:22.487956 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d40f95-9688-41ea-b16d-2619a9794fe5 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:01:22.489389 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-29d40f95-9688-41ea-b16d-2619a9794fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 15:01:22.502954 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d40f95-9688-41ea-b16d-2619a9794fe5 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:01:22.508004 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6408405f-203e-4726-af56-6cee92d20446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:01:22.508907 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6408405f-203e-4726-af56-6cee92d20446 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:22.509194 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6408405f-203e-4726-af56-6cee92d20446 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:22.509495 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6408405f-203e-4726-af56-6cee92d20446 admin admin] PATH_INFO: `/v3/projects/042100c5e79d452686fb394c2c32539f` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:22.510717 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6408405f-203e-4726-af56-6cee92d20446 admin admin] RBAC: Authorizing `identity:delete_project(project_id=042100c5e79d452686fb394c2c32539f)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:01:22.512779 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6408405f-203e-4726-af56-6cee92d20446 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:01:22.624280 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-6408405f-203e-4726-af56-6cee92d20446 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '042100c5e79d452686fb394c2c32539f', 'request_id': 'req-6408405f-203e-4726-af56-6cee92d20446'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:22.719927 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-6408405f-203e-4726-af56-6cee92d20446 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '042100c5e79d452686fb394c2c32539f', 'request_id': 'req-6408405f-203e-4726-af56-6cee92d20446'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:22.725971 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-6408405f-203e-4726-af56-6cee92d20446 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '042100c5e79d452686fb394c2c32539f', 'request_id': 'req-6408405f-203e-4726-af56-6cee92d20446'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:22.742204 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-6408405f-203e-4726-af56-6cee92d20446 admin admin] The token cache is being invalidate because project 042100c5e79d452686fb394c2c32539f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80503) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 15:01:22.742204 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-6408405f-203e-4726-af56-6cee92d20446 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:22.742204 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-6408405f-203e-4726-af56-6cee92d20446 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:22.742204 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1415/2819] 10.222.0.15 () {58 vars in 1232 bytes} [Tue May 31 15:01:22 2022] DELETE /identity/v3/projects/042100c5e79d452686fb394c2c32539f => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 15:01:22.743633 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0b4f98-ffe3-4b4c-88ae-41ead076762a service neutron] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:01:22.753171 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0b4f98-ffe3-4b4c-88ae-41ead076762a service neutron] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:01:22.809514 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e375bc55-70ac-4152-89b4-566e5eee1e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:01:22.810652 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e375bc55-70ac-4152-89b4-566e5eee1e6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:22.810947 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e375bc55-70ac-4152-89b4-566e5eee1e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:22.811242 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e375bc55-70ac-4152-89b4-566e5eee1e6a admin admin] PATH_INFO: `/v3/users/f364a3cddfb040a0b3b6dbbc1ace1a32` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:22.812437 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e375bc55-70ac-4152-89b4-566e5eee1e6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f364a3cddfb040a0b3b6dbbc1ace1a32)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:01:22.814400 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e375bc55-70ac-4152-89b4-566e5eee1e6a admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:01:23.026210 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-e375bc55-70ac-4152-89b4-566e5eee1e6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f364a3cddfb040a0b3b6dbbc1ace1a32'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:23.033448 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-e375bc55-70ac-4152-89b4-566e5eee1e6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f364a3cddfb040a0b3b6dbbc1ace1a32'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:23.034128 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-e375bc55-70ac-4152-89b4-566e5eee1e6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f364a3cddfb040a0b3b6dbbc1ace1a32'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:23.034769 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-e375bc55-70ac-4152-89b4-566e5eee1e6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f364a3cddfb040a0b3b6dbbc1ace1a32'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:23.046534 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-e375bc55-70ac-4152-89b4-566e5eee1e6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f364a3cddfb040a0b3b6dbbc1ace1a32'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:23.194620 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1405/2820] 10.222.0.15 () {58 vars in 1223 bytes} [Tue May 31 15:01:22 2022] DELETE /identity/v3/users/f364a3cddfb040a0b3b6dbbc1ace1a32 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 15:01:23.620154 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6408405f-203e-4726-af56-6cee92d20446 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:01:23.626466 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-6408405f-203e-4726-af56-6cee92d20446 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 15:01:23.638231 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6408405f-203e-4726-af56-6cee92d20446 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:01:23.681872 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:01:23.697981 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d411bc96-73c9-4c67-a6c7-3a17f6d8612b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:01:23.698874 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d411bc96-73c9-4c67-a6c7-3a17f6d8612b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:23.699162 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d411bc96-73c9-4c67-a6c7-3a17f6d8612b admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:23.699440 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d411bc96-73c9-4c67-a6c7-3a17f6d8612b admin admin] PATH_INFO: `/v3/projects/02e18855406a41f49b4a67851346e3b1` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:23.700631 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d411bc96-73c9-4c67-a6c7-3a17f6d8612b admin admin] RBAC: Authorizing `identity:delete_project(project_id=02e18855406a41f49b4a67851346e3b1)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:01:23.702537 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d411bc96-73c9-4c67-a6c7-3a17f6d8612b admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:01:23.818335 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-d411bc96-73c9-4c67-a6c7-3a17f6d8612b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02e18855406a41f49b4a67851346e3b1', 'request_id': 'req-d411bc96-73c9-4c67-a6c7-3a17f6d8612b'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:23.891312 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-d411bc96-73c9-4c67-a6c7-3a17f6d8612b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02e18855406a41f49b4a67851346e3b1', 'request_id': 'req-d411bc96-73c9-4c67-a6c7-3a17f6d8612b'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:23.897370 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-d411bc96-73c9-4c67-a6c7-3a17f6d8612b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02e18855406a41f49b4a67851346e3b1', 'request_id': 'req-d411bc96-73c9-4c67-a6c7-3a17f6d8612b'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:23.908970 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-d411bc96-73c9-4c67-a6c7-3a17f6d8612b admin admin] The token cache is being invalidate because project 02e18855406a41f49b4a67851346e3b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80503) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 15:01:23.909255 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-d411bc96-73c9-4c67-a6c7-3a17f6d8612b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:23.909952 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-d411bc96-73c9-4c67-a6c7-3a17f6d8612b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:23.911658 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1416/2821] 10.222.0.15 () {58 vars in 1232 bytes} [Tue May 31 15:01:23 2022] DELETE /identity/v3/projects/02e18855406a41f49b4a67851346e3b1 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 15:01:23.916967 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec7a38d-9128-4750-a2e1-037289b681e9 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:23.917460 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec7a38d-9128-4750-a2e1-037289b681e9 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:23.917576 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec7a38d-9128-4750-a2e1-037289b681e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:23.940416 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:01:23.948667 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-eec7a38d-9128-4750-a2e1-037289b681e9 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 15:01:23.949861 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-eec7a38d-9128-4750-a2e1-037289b681e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 15:01:24.010041 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1406/2822] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 15:01:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 15:01:24.020927 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730871bc-bce1-41b4-b3da-260e93336aa4 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:24.021215 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730871bc-bce1-41b4-b3da-260e93336aa4 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:24.021504 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730871bc-bce1-41b4-b3da-260e93336aa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:24.040431 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-730871bc-bce1-41b4-b3da-260e93336aa4 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 15:01:24.041642 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-730871bc-bce1-41b4-b3da-260e93336aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 15:01:24.049626 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1417/2823] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 15:01:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 15:01:24.054194 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec7a38d-9128-4750-a2e1-037289b681e9 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:01:24.064514 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec7a38d-9128-4750-a2e1-037289b681e9 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:01:24.070214 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8324fe46-d3b4-40f0-9561-ceede75547b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:01:24.075246 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8324fe46-d3b4-40f0-9561-ceede75547b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:24.075246 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8324fe46-d3b4-40f0-9561-ceede75547b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:24.075246 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8324fe46-d3b4-40f0-9561-ceede75547b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:24.075246 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8324fe46-d3b4-40f0-9561-ceede75547b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 15:01:24.075246 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8324fe46-d3b4-40f0-9561-ceede75547b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:01:24.075246 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8324fe46-d3b4-40f0-9561-ceede75547b2 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:01:24.086321 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1407/2824] 10.222.0.15 () {58 vars in 1152 bytes} [Tue May 31 15:01:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 15:01:24.142936 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730871bc-bce1-41b4-b3da-260e93336aa4 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:01:24.152480 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730871bc-bce1-41b4-b3da-260e93336aa4 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:01:24.157743 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07e38f8-e86d-41c9-969e-6c04c02ccaba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:01:24.158388 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07e38f8-e86d-41c9-969e-6c04c02ccaba admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:24.158715 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07e38f8-e86d-41c9-969e-6c04c02ccaba admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:24.158998 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07e38f8-e86d-41c9-969e-6c04c02ccaba admin admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:24.159694 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07e38f8-e86d-41c9-969e-6c04c02ccaba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:01:24.161622 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07e38f8-e86d-41c9-969e-6c04c02ccaba admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:01:24.250657 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1418/2825] 10.222.0.15 () {60 vars in 1152 bytes} [Tue May 31 15:01:24 2022] POST /identity/v3/projects => generated 387 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 15:01:24.254920 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8324fe46-d3b4-40f0-9561-ceede75547b2 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:01:24.266750 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8324fe46-d3b4-40f0-9561-ceede75547b2 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:01:24.331285 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc393934-48b7-4e88-8ba0-bf8cdb280db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:01:24.331967 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc393934-48b7-4e88-8ba0-bf8cdb280db4 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:24.332257 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc393934-48b7-4e88-8ba0-bf8cdb280db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:24.332597 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc393934-48b7-4e88-8ba0-bf8cdb280db4 admin admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:24.333286 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc393934-48b7-4e88-8ba0-bf8cdb280db4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:01:24.335254 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc393934-48b7-4e88-8ba0-bf8cdb280db4 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:01:24.433049 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1408/2826] 10.222.0.15 () {60 vars in 1143 bytes} [Tue May 31 15:01:24 2022] POST /identity/v3/users => generated 294 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 15:01:24.438363 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07e38f8-e86d-41c9-969e-6c04c02ccaba admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:01:24.448866 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07e38f8-e86d-41c9-969e-6c04c02ccaba admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:01:24.454181 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3134835c-b3b2-4a6f-aac3-3878422375d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:01:24.454875 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134835c-b3b2-4a6f-aac3-3878422375d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:24.455161 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134835c-b3b2-4a6f-aac3-3878422375d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:24.455710 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134835c-b3b2-4a6f-aac3-3878422375d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:24.456424 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3134835c-b3b2-4a6f-aac3-3878422375d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:01:24.458098 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3134835c-b3b2-4a6f-aac3-3878422375d1 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:01:24.469320 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1419/2827] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 15:01:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 15:01:24.473255 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc393934-48b7-4e88-8ba0-bf8cdb280db4 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:01:24.484343 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc393934-48b7-4e88-8ba0-bf8cdb280db4 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:01:24.490236 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c535b83-2311-4288-9f5d-e04128ff2890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:01:24.490991 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c535b83-2311-4288-9f5d-e04128ff2890 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:24.491282 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c535b83-2311-4288-9f5d-e04128ff2890 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:24.491542 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c535b83-2311-4288-9f5d-e04128ff2890 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:24.492183 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c535b83-2311-4288-9f5d-e04128ff2890 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:01:24.493782 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c535b83-2311-4288-9f5d-e04128ff2890 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:01:24.504631 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1409/2828] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 15:01:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 15:01:24.515082 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3134835c-b3b2-4a6f-aac3-3878422375d1 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:01:24.525991 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3134835c-b3b2-4a6f-aac3-3878422375d1 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:01:24.531089 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8530f4a5-a0c4-47db-af4a-8da1e4083414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:01:24.531975 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8530f4a5-a0c4-47db-af4a-8da1e4083414 admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:24.532288 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8530f4a5-a0c4-47db-af4a-8da1e4083414 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:24.532625 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8530f4a5-a0c4-47db-af4a-8da1e4083414 admin admin] PATH_INFO: `/v3/projects/cf2cab51b5a74b68882117dd01c2936c/users/0050a0b07f6847c59d9180159e594ecf/roles/317f725e26bf43648d8235bb1f7c4cb3` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:24.547420 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8530f4a5-a0c4-47db-af4a-8da1e4083414 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf2cab51b5a74b68882117dd01c2936c, user_id=0050a0b07f6847c59d9180159e594ecf, role_id=317f725e26bf43648d8235bb1f7c4cb3)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:01:24.550272 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8530f4a5-a0c4-47db-af4a-8da1e4083414 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:01:24.657851 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1420/2829] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 15:01:24 2022] PUT /identity/v3/projects/cf2cab51b5a74b68882117dd01c2936c/users/0050a0b07f6847c59d9180159e594ecf/roles/317f725e26bf43648d8235bb1f7c4cb3 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 15:01:24.667940 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeca6d4-2052-458a-a757-08ce3737ecd2 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:24.668232 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeca6d4-2052-458a-a757-08ce3737ecd2 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:24.668515 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeca6d4-2052-458a-a757-08ce3737ecd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:24.696583 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-0eeca6d4-2052-458a-a757-08ce3737ecd2 None None] MFA Rules not processed for user `0050a0b07f6847c59d9180159e594ecf`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 15:01:24.697799 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-0eeca6d4-2052-458a-a757-08ce3737ecd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 15:01:24.767764 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1410/2830] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 15:01:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 15:01:24.772402 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8530f4a5-a0c4-47db-af4a-8da1e4083414 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:01:24.834759 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8530f4a5-a0c4-47db-af4a-8da1e4083414 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:01:24.839458 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7febff8d-e6e6-4283-80cb-b128a849824a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:01:24.840107 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7febff8d-e6e6-4283-80cb-b128a849824a admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:24.840390 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7febff8d-e6e6-4283-80cb-b128a849824a admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:24.840667 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7febff8d-e6e6-4283-80cb-b128a849824a admin admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:24.841350 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7febff8d-e6e6-4283-80cb-b128a849824a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:01:24.843306 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7febff8d-e6e6-4283-80cb-b128a849824a admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:01:24.856471 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:01:24.932721 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1421/2831] 10.222.0.15 () {60 vars in 1152 bytes} [Tue May 31 15:01:24 2022] POST /identity/v3/projects => generated 389 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 15:01:24.937307 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeca6d4-2052-458a-a757-08ce3737ecd2 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:01:24.949863 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:01:24.958773 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeca6d4-2052-458a-a757-08ce3737ecd2 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:01:25.016647 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc16cacd-9e79-4f53-8c21-54d2af330313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:01:25.017358 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc16cacd-9e79-4f53-8c21-54d2af330313 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:25.017637 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc16cacd-9e79-4f53-8c21-54d2af330313 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:25.017915 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc16cacd-9e79-4f53-8c21-54d2af330313 admin admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:25.018639 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc16cacd-9e79-4f53-8c21-54d2af330313 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:01:25.020555 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc16cacd-9e79-4f53-8c21-54d2af330313 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:01:25.125230 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1411/2832] 10.222.0.15 () {60 vars in 1143 bytes} [Tue May 31 15:01:24 2022] POST /identity/v3/users => generated 301 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 15:01:25.129992 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7febff8d-e6e6-4283-80cb-b128a849824a admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:01:25.140881 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7febff8d-e6e6-4283-80cb-b128a849824a admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:01:25.145798 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6a307b-9233-4ca9-949c-5a0f8356db12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:01:25.146454 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6a307b-9233-4ca9-949c-5a0f8356db12 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:25.146766 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6a307b-9233-4ca9-949c-5a0f8356db12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:25.147042 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6a307b-9233-4ca9-949c-5a0f8356db12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:25.147760 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6a307b-9233-4ca9-949c-5a0f8356db12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:01:25.149360 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6a307b-9233-4ca9-949c-5a0f8356db12 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:01:25.160735 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1422/2833] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 15:01:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 15:01:25.165131 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc16cacd-9e79-4f53-8c21-54d2af330313 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:01:25.176134 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc16cacd-9e79-4f53-8c21-54d2af330313 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:01:25.180782 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3d431f-971a-456b-be6d-d98a2f9e0eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:01:25.181661 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3d431f-971a-456b-be6d-d98a2f9e0eea admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:25.181942 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3d431f-971a-456b-be6d-d98a2f9e0eea admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:25.182219 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3d431f-971a-456b-be6d-d98a2f9e0eea admin admin] PATH_INFO: `/v3/projects/71d6e6f997164a0193ab2ffbe3263f9c/users/c67a83f5ee3c45529deca86f6a8e9a62/roles/76c53e2c353644f885028a0226c06146` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:25.197157 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3d431f-971a-456b-be6d-d98a2f9e0eea admin admin] RBAC: Authorizing `identity:create_grant(project_id=71d6e6f997164a0193ab2ffbe3263f9c, user_id=c67a83f5ee3c45529deca86f6a8e9a62, role_id=76c53e2c353644f885028a0226c06146)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:01:25.199762 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3d431f-971a-456b-be6d-d98a2f9e0eea admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:01:25.278612 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1412/2834] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 15:01:25 2022] PUT /identity/v3/projects/71d6e6f997164a0193ab2ffbe3263f9c/users/c67a83f5ee3c45529deca86f6a8e9a62/roles/76c53e2c353644f885028a0226c06146 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 15:01:25.283493 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6a307b-9233-4ca9-949c-5a0f8356db12 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:01:25.294587 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6a307b-9233-4ca9-949c-5a0f8356db12 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:01:25.357050 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e644296f-220a-4e6c-be00-aa58486581e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:01:25.357721 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e644296f-220a-4e6c-be00-aa58486581e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:25.358573 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e644296f-220a-4e6c-be00-aa58486581e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:25.358869 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e644296f-220a-4e6c-be00-aa58486581e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:25.359590 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e644296f-220a-4e6c-be00-aa58486581e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:01:25.361188 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e644296f-220a-4e6c-be00-aa58486581e1 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:01:25.371290 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1423/2835] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 15:01:25 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 31 15:01:25.377084 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3d431f-971a-456b-be6d-d98a2f9e0eea admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:01:25.393227 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3d431f-971a-456b-be6d-d98a2f9e0eea admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:01:25.399862 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea229d35-1696-4af6-b7ce-4e7b035d79f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:01:25.401350 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea229d35-1696-4af6-b7ce-4e7b035d79f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:25.401855 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea229d35-1696-4af6-b7ce-4e7b035d79f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:25.402354 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea229d35-1696-4af6-b7ce-4e7b035d79f1 admin admin] PATH_INFO: `/v3/projects/71d6e6f997164a0193ab2ffbe3263f9c/users/c67a83f5ee3c45529deca86f6a8e9a62/roles/76c53e2c353644f885028a0226c06146` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:25.406219 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea229d35-1696-4af6-b7ce-4e7b035d79f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71d6e6f997164a0193ab2ffbe3263f9c, user_id=c67a83f5ee3c45529deca86f6a8e9a62, role_id=76c53e2c353644f885028a0226c06146)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:01:25.411378 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea229d35-1696-4af6-b7ce-4e7b035d79f1 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:01:25.423057 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1413/2836] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 15:01:25 2022] PUT /identity/v3/projects/71d6e6f997164a0193ab2ffbe3263f9c/users/c67a83f5ee3c45529deca86f6a8e9a62/roles/76c53e2c353644f885028a0226c06146 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 15:01:25.433368 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5f5a19-d52c-4462-af16-e520c3ad32a8 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:25.433662 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5f5a19-d52c-4462-af16-e520c3ad32a8 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:25.433946 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5f5a19-d52c-4462-af16-e520c3ad32a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:25.460574 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-7d5f5a19-d52c-4462-af16-e520c3ad32a8 None None] MFA Rules not processed for user `c67a83f5ee3c45529deca86f6a8e9a62`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 15:01:25.461780 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-7d5f5a19-d52c-4462-af16-e520c3ad32a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 15:01:25.536093 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1424/2837] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 15:01:25 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 31 15:01:25.546875 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea229d35-1696-4af6-b7ce-4e7b035d79f1 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:01:25.548683 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-ea229d35-1696-4af6-b7ce-4e7b035d79f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 15:01:25.615996 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea229d35-1696-4af6-b7ce-4e7b035d79f1 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:01:25.619721 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d2c75e-2828-4ec0-bd32-99101114defc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afbf718dcd9b4741a926b0a2321bd53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:01:25.620369 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d2c75e-2828-4ec0-bd32-99101114defc service cinder] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:25.620653 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d2c75e-2828-4ec0-bd32-99101114defc service cinder] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:25.620935 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d2c75e-2828-4ec0-bd32-99101114defc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:25.630321 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d2c75e-2828-4ec0-bd32-99101114defc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:01:25.631794 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d2c75e-2828-4ec0-bd32-99101114defc service cinder] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:01:25.641794 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1414/2838] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 15:01:25 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 15:01:25.785834 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5f5a19-d52c-4462-af16-e520c3ad32a8 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:01:25.856480 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5f5a19-d52c-4462-af16-e520c3ad32a8 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:01:25.862597 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49389a7-dda0-4e42-852b-895f07077b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:01:25.863875 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49389a7-dda0-4e42-852b-895f07077b7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:25.864311 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49389a7-dda0-4e42-852b-895f07077b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:25.864714 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49389a7-dda0-4e42-852b-895f07077b7c admin admin] PATH_INFO: `/v3/users/0050a0b07f6847c59d9180159e594ecf` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:25.866692 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49389a7-dda0-4e42-852b-895f07077b7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0050a0b07f6847c59d9180159e594ecf)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:01:25.870169 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49389a7-dda0-4e42-852b-895f07077b7c admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:01:25.877995 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:01:26.049910 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-a49389a7-dda0-4e42-852b-895f07077b7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0050a0b07f6847c59d9180159e594ecf'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:26.137331 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-a49389a7-dda0-4e42-852b-895f07077b7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0050a0b07f6847c59d9180159e594ecf'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:26.137956 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-a49389a7-dda0-4e42-852b-895f07077b7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0050a0b07f6847c59d9180159e594ecf'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:26.146133 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-a49389a7-dda0-4e42-852b-895f07077b7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0050a0b07f6847c59d9180159e594ecf'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:26.146795 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-a49389a7-dda0-4e42-852b-895f07077b7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0050a0b07f6847c59d9180159e594ecf'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:26.164902 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1425/2839] 10.222.0.15 () {58 vars in 1223 bytes} [Tue May 31 15:01:25 2022] DELETE /identity/v3/users/0050a0b07f6847c59d9180159e594ecf => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 15:01:26.170913 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76ce5e9-e46e-4faa-bbc1-b4d1224d355c None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:26.171462 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76ce5e9-e46e-4faa-bbc1-b4d1224d355c None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:26.171635 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76ce5e9-e46e-4faa-bbc1-b4d1224d355c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:26.189438 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-e76ce5e9-e46e-4faa-bbc1-b4d1224d355c None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 15:01:26.190688 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-e76ce5e9-e46e-4faa-bbc1-b4d1224d355c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 15:01:26.239227 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:01:26.248217 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1415/2840] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 15:01:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 15:01:26.262308 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49389a7-dda0-4e42-852b-895f07077b7c admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:01:26.263772 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-a49389a7-dda0-4e42-852b-895f07077b7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 15:01:26.335492 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49389a7-dda0-4e42-852b-895f07077b7c admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:01:26.338998 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd0e785-0b62-47e8-abba-89760f7009af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:01:26.339635 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd0e785-0b62-47e8-abba-89760f7009af service neutron] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:26.339918 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd0e785-0b62-47e8-abba-89760f7009af service neutron] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:26.340191 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd0e785-0b62-47e8-abba-89760f7009af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:26.349102 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd0e785-0b62-47e8-abba-89760f7009af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:01:26.350525 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd0e785-0b62-47e8-abba-89760f7009af service neutron] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:01:26.360359 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1426/2841] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 15:01:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 15:01:26.768319 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76ce5e9-e46e-4faa-bbc1-b4d1224d355c None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:01:26.770005 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-e76ce5e9-e46e-4faa-bbc1-b4d1224d355c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 15:01:26.782653 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76ce5e9-e46e-4faa-bbc1-b4d1224d355c None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:01:26.787943 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b9565-0e32-4afd-af58-d698db768daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:01:26.789173 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b9565-0e32-4afd-af58-d698db768daf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:26.789455 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b9565-0e32-4afd-af58-d698db768daf admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:26.789855 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b9565-0e32-4afd-af58-d698db768daf admin admin] PATH_INFO: `/v3/projects/cf2cab51b5a74b68882117dd01c2936c` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:26.791013 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16b9565-0e32-4afd-af58-d698db768daf admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf2cab51b5a74b68882117dd01c2936c)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:01:26.792976 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16b9565-0e32-4afd-af58-d698db768daf admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:01:26.907085 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-d16b9565-0e32-4afd-af58-d698db768daf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf2cab51b5a74b68882117dd01c2936c', 'request_id': 'req-d16b9565-0e32-4afd-af58-d698db768daf'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:26.913542 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-d16b9565-0e32-4afd-af58-d698db768daf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf2cab51b5a74b68882117dd01c2936c', 'request_id': 'req-d16b9565-0e32-4afd-af58-d698db768daf'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:26.977221 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-d16b9565-0e32-4afd-af58-d698db768daf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf2cab51b5a74b68882117dd01c2936c', 'request_id': 'req-d16b9565-0e32-4afd-af58-d698db768daf'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:26.988348 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-d16b9565-0e32-4afd-af58-d698db768daf admin admin] The token cache is being invalidate because project cf2cab51b5a74b68882117dd01c2936c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 15:01:26.988652 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-d16b9565-0e32-4afd-af58-d698db768daf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:26.989378 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-d16b9565-0e32-4afd-af58-d698db768daf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:26.991004 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1416/2842] 10.222.0.15 () {58 vars in 1232 bytes} [Tue May 31 15:01:26 2022] DELETE /identity/v3/projects/cf2cab51b5a74b68882117dd01c2936c => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 15:01:26.995224 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd0e785-0b62-47e8-abba-89760f7009af service neutron] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:01:27.005585 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd0e785-0b62-47e8-abba-89760f7009af service neutron] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:01:27.063543 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dec46c6-fb7d-4b92-b38b-3ec9f8f8bb6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:01:27.067734 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dec46c6-fb7d-4b92-b38b-3ec9f8f8bb6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:27.067734 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dec46c6-fb7d-4b92-b38b-3ec9f8f8bb6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:27.067734 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dec46c6-fb7d-4b92-b38b-3ec9f8f8bb6d admin admin] PATH_INFO: `/v3/users/c67a83f5ee3c45529deca86f6a8e9a62` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:27.067734 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dec46c6-fb7d-4b92-b38b-3ec9f8f8bb6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c67a83f5ee3c45529deca86f6a8e9a62)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:01:27.068223 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dec46c6-fb7d-4b92-b38b-3ec9f8f8bb6d admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:01:27.156921 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:01:27.298178 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-6dec46c6-fb7d-4b92-b38b-3ec9f8f8bb6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c67a83f5ee3c45529deca86f6a8e9a62'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:27.371821 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-6dec46c6-fb7d-4b92-b38b-3ec9f8f8bb6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c67a83f5ee3c45529deca86f6a8e9a62'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:27.372541 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-6dec46c6-fb7d-4b92-b38b-3ec9f8f8bb6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c67a83f5ee3c45529deca86f6a8e9a62'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:27.381354 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-6dec46c6-fb7d-4b92-b38b-3ec9f8f8bb6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c67a83f5ee3c45529deca86f6a8e9a62'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:27.382033 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-6dec46c6-fb7d-4b92-b38b-3ec9f8f8bb6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c67a83f5ee3c45529deca86f6a8e9a62'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:27.401725 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1427/2843] 10.222.0.15 () {58 vars in 1223 bytes} [Tue May 31 15:01:26 2022] DELETE /identity/v3/users/c67a83f5ee3c45529deca86f6a8e9a62 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 15:01:27.839757 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b9565-0e32-4afd-af58-d698db768daf admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:01:27.841328 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-d16b9565-0e32-4afd-af58-d698db768daf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 15:01:27.855143 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b9565-0e32-4afd-af58-d698db768daf admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:01:27.912270 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d9c8b0-53dd-40b2-8c94-3078f231b497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:01:27.913150 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d9c8b0-53dd-40b2-8c94-3078f231b497 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:27.913431 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d9c8b0-53dd-40b2-8c94-3078f231b497 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:27.913707 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d9c8b0-53dd-40b2-8c94-3078f231b497 admin admin] PATH_INFO: `/v3/projects/71d6e6f997164a0193ab2ffbe3263f9c` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:27.914922 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d9c8b0-53dd-40b2-8c94-3078f231b497 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71d6e6f997164a0193ab2ffbe3263f9c)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:01:27.916870 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d9c8b0-53dd-40b2-8c94-3078f231b497 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:01:28.041723 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-b5d9c8b0-53dd-40b2-8c94-3078f231b497 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71d6e6f997164a0193ab2ffbe3263f9c', 'request_id': 'req-b5d9c8b0-53dd-40b2-8c94-3078f231b497'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:28.048046 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-b5d9c8b0-53dd-40b2-8c94-3078f231b497 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71d6e6f997164a0193ab2ffbe3263f9c', 'request_id': 'req-b5d9c8b0-53dd-40b2-8c94-3078f231b497'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:28.106305 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-b5d9c8b0-53dd-40b2-8c94-3078f231b497 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71d6e6f997164a0193ab2ffbe3263f9c', 'request_id': 'req-b5d9c8b0-53dd-40b2-8c94-3078f231b497'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:28.117020 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-b5d9c8b0-53dd-40b2-8c94-3078f231b497 admin admin] The token cache is being invalidate because project 71d6e6f997164a0193ab2ffbe3263f9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80502) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 15:01:28.117305 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-b5d9c8b0-53dd-40b2-8c94-3078f231b497 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:28.117920 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-b5d9c8b0-53dd-40b2-8c94-3078f231b497 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:28.119523 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1417/2844] 10.222.0.15 () {58 vars in 1232 bytes} [Tue May 31 15:01:27 2022] DELETE /identity/v3/projects/71d6e6f997164a0193ab2ffbe3263f9c => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 31 15:01:28.125031 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6591a880-31a7-4825-b22e-0f6ec160add5 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:28.125506 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6591a880-31a7-4825-b22e-0f6ec160add5 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:28.125628 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6591a880-31a7-4825-b22e-0f6ec160add5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:28.144901 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-6591a880-31a7-4825-b22e-0f6ec160add5 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 15:01:28.146123 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-6591a880-31a7-4825-b22e-0f6ec160add5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 15:01:28.207282 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1428/2845] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 15:01:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 15:01:28.216632 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d954af-795f-42b2-92cb-5bbbf9ad1abe None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:28.216922 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d954af-795f-42b2-92cb-5bbbf9ad1abe None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:28.217206 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d954af-795f-42b2-92cb-5bbbf9ad1abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:28.235203 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-28d954af-795f-42b2-92cb-5bbbf9ad1abe None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 15:01:28.236408 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-28d954af-795f-42b2-92cb-5bbbf9ad1abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 15:01:28.244325 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1418/2846] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 15:01:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 15:01:28.249117 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6591a880-31a7-4825-b22e-0f6ec160add5 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:01:28.258850 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6591a880-31a7-4825-b22e-0f6ec160add5 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:01:28.263872 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57946478-0272-4c0d-af41-dd53cd7e21a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:01:28.265126 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57946478-0272-4c0d-af41-dd53cd7e21a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:28.265407 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57946478-0272-4c0d-af41-dd53cd7e21a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:28.265682 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57946478-0272-4c0d-af41-dd53cd7e21a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:28.266402 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57946478-0272-4c0d-af41-dd53cd7e21a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80503) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 15:01:28.266756 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57946478-0272-4c0d-af41-dd53cd7e21a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:01:28.268346 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57946478-0272-4c0d-af41-dd53cd7e21a2 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:01:28.280411 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1429/2847] 10.222.0.15 () {58 vars in 1152 bytes} [Tue May 31 15:01:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 15:01:28.284841 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d954af-795f-42b2-92cb-5bbbf9ad1abe None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:01:28.290580 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:01:28.294981 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d954af-795f-42b2-92cb-5bbbf9ad1abe None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:01:28.299883 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22346e95-49cb-4ac7-b876-b9d96138918d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:01:28.306029 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22346e95-49cb-4ac7-b876-b9d96138918d admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:28.306029 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22346e95-49cb-4ac7-b876-b9d96138918d admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:28.306029 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22346e95-49cb-4ac7-b876-b9d96138918d admin admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:28.306029 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22346e95-49cb-4ac7-b876-b9d96138918d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:01:28.306029 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22346e95-49cb-4ac7-b876-b9d96138918d admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:01:28.396914 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1419/2848] 10.222.0.15 () {60 vars in 1152 bytes} [Tue May 31 15:01:28 2022] POST /identity/v3/projects => generated 383 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 15:01:28.401345 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57946478-0272-4c0d-af41-dd53cd7e21a2 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:01:28.411843 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57946478-0272-4c0d-af41-dd53cd7e21a2 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:01:28.470503 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9bda13-2d83-4fad-87aa-3e197d81d4ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:01:28.471207 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9bda13-2d83-4fad-87aa-3e197d81d4ea admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:28.471494 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9bda13-2d83-4fad-87aa-3e197d81d4ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:28.471776 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9bda13-2d83-4fad-87aa-3e197d81d4ea admin admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:28.472540 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9bda13-2d83-4fad-87aa-3e197d81d4ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:01:28.474439 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9bda13-2d83-4fad-87aa-3e197d81d4ea admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:01:28.575255 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1430/2849] 10.222.0.15 () {60 vars in 1143 bytes} [Tue May 31 15:01:28 2022] POST /identity/v3/users => generated 292 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 15:01:28.579749 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22346e95-49cb-4ac7-b876-b9d96138918d admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:01:28.590128 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22346e95-49cb-4ac7-b876-b9d96138918d admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:01:28.594856 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dcb197-8891-419d-81b6-1eb3278221d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:01:28.595514 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dcb197-8891-419d-81b6-1eb3278221d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:28.595795 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dcb197-8891-419d-81b6-1eb3278221d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:28.596073 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dcb197-8891-419d-81b6-1eb3278221d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:28.596791 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dcb197-8891-419d-81b6-1eb3278221d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:01:28.598456 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dcb197-8891-419d-81b6-1eb3278221d9 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:01:28.608815 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1420/2850] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 15:01:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 15:01:28.612935 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9bda13-2d83-4fad-87aa-3e197d81d4ea admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:01:28.623031 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9bda13-2d83-4fad-87aa-3e197d81d4ea admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:01:28.628982 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35d0dcd-14da-492f-900d-42c44ac1f0fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:01:28.629672 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d0dcd-14da-492f-900d-42c44ac1f0fb admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:28.629956 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d0dcd-14da-492f-900d-42c44ac1f0fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:28.630234 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d0dcd-14da-492f-900d-42c44ac1f0fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:28.630985 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35d0dcd-14da-492f-900d-42c44ac1f0fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:01:28.632577 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35d0dcd-14da-492f-900d-42c44ac1f0fb admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:01:28.643054 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1431/2851] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 15:01:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 15:01:28.647311 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dcb197-8891-419d-81b6-1eb3278221d9 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:01:28.657339 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dcb197-8891-419d-81b6-1eb3278221d9 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:01:28.661937 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6b7e13-4bd1-4ed3-90b2-1fdffa4a6ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:01:28.662856 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6b7e13-4bd1-4ed3-90b2-1fdffa4a6ceb admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:28.663142 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6b7e13-4bd1-4ed3-90b2-1fdffa4a6ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:28.663420 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6b7e13-4bd1-4ed3-90b2-1fdffa4a6ceb admin admin] PATH_INFO: `/v3/projects/c219cd74d94c4e138b1fac04bf4e0952/users/3ab3ba99aa734fc89d92de6202f7d2e1/roles/317f725e26bf43648d8235bb1f7c4cb3` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:28.678703 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6b7e13-4bd1-4ed3-90b2-1fdffa4a6ceb admin admin] RBAC: Authorizing `identity:create_grant(project_id=c219cd74d94c4e138b1fac04bf4e0952, user_id=3ab3ba99aa734fc89d92de6202f7d2e1, role_id=317f725e26bf43648d8235bb1f7c4cb3)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:01:28.681763 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6b7e13-4bd1-4ed3-90b2-1fdffa4a6ceb admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:01:28.778430 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1421/2852] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 15:01:28 2022] PUT /identity/v3/projects/c219cd74d94c4e138b1fac04bf4e0952/users/3ab3ba99aa734fc89d92de6202f7d2e1/roles/317f725e26bf43648d8235bb1f7c4cb3 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 15:01:28.788797 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3054a0-14a9-4d51-922b-770808a97df5 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:28.789085 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3054a0-14a9-4d51-922b-770808a97df5 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:28.789366 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3054a0-14a9-4d51-922b-770808a97df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:28.808708 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:01:28.816484 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-7e3054a0-14a9-4d51-922b-770808a97df5 None None] MFA Rules not processed for user `3ab3ba99aa734fc89d92de6202f7d2e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 15:01:28.817694 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-7e3054a0-14a9-4d51-922b-770808a97df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 15:01:28.884465 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1432/2853] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 15:01:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 15:01:28.888961 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6b7e13-4bd1-4ed3-90b2-1fdffa4a6ceb admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:01:28.949014 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6b7e13-4bd1-4ed3-90b2-1fdffa4a6ceb admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:01:28.953993 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e1abe6-c74b-4227-ac1d-e67aa3ed2f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:01:28.954641 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e1abe6-c74b-4227-ac1d-e67aa3ed2f19 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:28.954927 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e1abe6-c74b-4227-ac1d-e67aa3ed2f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:28.955203 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e1abe6-c74b-4227-ac1d-e67aa3ed2f19 admin admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:28.956142 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e1abe6-c74b-4227-ac1d-e67aa3ed2f19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:01:28.958034 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e1abe6-c74b-4227-ac1d-e67aa3ed2f19 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:01:29.042589 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1422/2854] 10.222.0.15 () {60 vars in 1152 bytes} [Tue May 31 15:01:28 2022] POST /identity/v3/projects => generated 383 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 15:01:29.046951 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3054a0-14a9-4d51-922b-770808a97df5 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:01:29.058270 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3054a0-14a9-4d51-922b-770808a97df5 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:01:29.116314 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33d37ce-8bd2-4a5c-b7a5-6e9f0ee1056c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:01:29.116981 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d37ce-8bd2-4a5c-b7a5-6e9f0ee1056c admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:29.117263 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d37ce-8bd2-4a5c-b7a5-6e9f0ee1056c admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:29.117539 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33d37ce-8bd2-4a5c-b7a5-6e9f0ee1056c admin admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:29.118256 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33d37ce-8bd2-4a5c-b7a5-6e9f0ee1056c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:01:29.120209 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33d37ce-8bd2-4a5c-b7a5-6e9f0ee1056c admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:01:29.210529 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1433/2855] 10.222.0.15 () {60 vars in 1143 bytes} [Tue May 31 15:01:29 2022] POST /identity/v3/users => generated 292 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 15:01:29.214782 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e1abe6-c74b-4227-ac1d-e67aa3ed2f19 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:01:29.225391 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e1abe6-c74b-4227-ac1d-e67aa3ed2f19 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:01:29.229980 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b597f4d-737a-4fdb-8d0c-3ec2c70fff69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:01:29.230720 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b597f4d-737a-4fdb-8d0c-3ec2c70fff69 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:29.231014 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b597f4d-737a-4fdb-8d0c-3ec2c70fff69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:29.231299 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b597f4d-737a-4fdb-8d0c-3ec2c70fff69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:29.232017 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b597f4d-737a-4fdb-8d0c-3ec2c70fff69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:01:29.233640 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b597f4d-737a-4fdb-8d0c-3ec2c70fff69 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:01:29.244275 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1423/2856] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 15:01:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 15:01:29.248386 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33d37ce-8bd2-4a5c-b7a5-6e9f0ee1056c admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:01:29.258851 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33d37ce-8bd2-4a5c-b7a5-6e9f0ee1056c admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:01:29.263363 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd7906b-739d-4198-a7e4-6fbeee887f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:01:29.264011 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd7906b-739d-4198-a7e4-6fbeee887f9f admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:29.264936 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd7906b-739d-4198-a7e4-6fbeee887f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:29.265215 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd7906b-739d-4198-a7e4-6fbeee887f9f admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:29.265957 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd7906b-739d-4198-a7e4-6fbeee887f9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:01:29.267593 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd7906b-739d-4198-a7e4-6fbeee887f9f admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:01:29.277732 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1434/2857] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 15:01:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 15:01:29.282465 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b597f4d-737a-4fdb-8d0c-3ec2c70fff69 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:01:29.297564 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b597f4d-737a-4fdb-8d0c-3ec2c70fff69 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:01:29.302643 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc87c8b-dbea-42b5-a1ca-ee8bae78e4e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:01:29.303544 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc87c8b-dbea-42b5-a1ca-ee8bae78e4e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:29.303842 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc87c8b-dbea-42b5-a1ca-ee8bae78e4e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:29.304122 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc87c8b-dbea-42b5-a1ca-ee8bae78e4e3 admin admin] PATH_INFO: `/v3/projects/fda3c928b8b843b696139bc80e67ec51/users/7353fd4a8ef24cb182126928bfcdd4a0/roles/317f725e26bf43648d8235bb1f7c4cb3` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:29.320154 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc87c8b-dbea-42b5-a1ca-ee8bae78e4e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fda3c928b8b843b696139bc80e67ec51, user_id=7353fd4a8ef24cb182126928bfcdd4a0, role_id=317f725e26bf43648d8235bb1f7c4cb3)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:01:29.322841 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc87c8b-dbea-42b5-a1ca-ee8bae78e4e3 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:01:29.421808 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1424/2858] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 15:01:29 2022] PUT /identity/v3/projects/fda3c928b8b843b696139bc80e67ec51/users/7353fd4a8ef24cb182126928bfcdd4a0/roles/317f725e26bf43648d8235bb1f7c4cb3 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 15:01:29.432211 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4299f28c-6519-4eee-a9bc-a9a396d6761c None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:29.432507 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4299f28c-6519-4eee-a9bc-a9a396d6761c None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:29.432790 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4299f28c-6519-4eee-a9bc-a9a396d6761c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:29.460257 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-4299f28c-6519-4eee-a9bc-a9a396d6761c None None] MFA Rules not processed for user `7353fd4a8ef24cb182126928bfcdd4a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 15:01:29.461528 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-4299f28c-6519-4eee-a9bc-a9a396d6761c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 15:01:29.524298 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1435/2859] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 15:01:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 15:01:29.529771 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc87c8b-dbea-42b5-a1ca-ee8bae78e4e3 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:01:29.589259 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:01:29.593053 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc87c8b-dbea-42b5-a1ca-ee8bae78e4e3 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:01:29.597762 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f01eb33-82aa-4c65-9acc-c6de85af8592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:01:29.598423 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f01eb33-82aa-4c65-9acc-c6de85af8592 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:29.598769 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f01eb33-82aa-4c65-9acc-c6de85af8592 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:29.601981 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f01eb33-82aa-4c65-9acc-c6de85af8592 admin admin] PATH_INFO: `/v3/projects` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:29.601981 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f01eb33-82aa-4c65-9acc-c6de85af8592 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:01:29.601981 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f01eb33-82aa-4c65-9acc-c6de85af8592 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:01:29.723127 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1425/2860] 10.222.0.15 () {60 vars in 1152 bytes} [Tue May 31 15:01:29 2022] POST /identity/v3/projects => generated 385 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 15:01:29.727173 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4299f28c-6519-4eee-a9bc-a9a396d6761c None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:01:29.738529 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4299f28c-6519-4eee-a9bc-a9a396d6761c None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:01:29.743114 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:01:29.793615 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089a9117-f056-4513-b24f-40d4c52f030b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:01:29.794368 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089a9117-f056-4513-b24f-40d4c52f030b admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:29.794689 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089a9117-f056-4513-b24f-40d4c52f030b admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:29.794970 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089a9117-f056-4513-b24f-40d4c52f030b admin admin] PATH_INFO: `/v3/users` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:29.796276 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089a9117-f056-4513-b24f-40d4c52f030b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:01:29.798604 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089a9117-f056-4513-b24f-40d4c52f030b admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:01:29.883925 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1436/2861] 10.222.0.15 () {60 vars in 1143 bytes} [Tue May 31 15:01:29 2022] POST /identity/v3/users => generated 299 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 15:01:29.888069 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f01eb33-82aa-4c65-9acc-c6de85af8592 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:01:29.898517 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f01eb33-82aa-4c65-9acc-c6de85af8592 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:01:29.903297 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8e626f-97df-4142-a1e0-f7ce197cb991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:01:29.903952 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e626f-97df-4142-a1e0-f7ce197cb991 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:29.904236 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e626f-97df-4142-a1e0-f7ce197cb991 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:29.904513 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e626f-97df-4142-a1e0-f7ce197cb991 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:29.905725 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8e626f-97df-4142-a1e0-f7ce197cb991 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:01:29.907357 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8e626f-97df-4142-a1e0-f7ce197cb991 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:01:30.052290 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1426/2862] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 15:01:29 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 15:01:30.057459 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089a9117-f056-4513-b24f-40d4c52f030b admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:01:30.067727 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089a9117-f056-4513-b24f-40d4c52f030b admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:01:30.072375 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d52014-5769-479f-a68e-df49b0c49aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:01:30.073306 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d52014-5769-479f-a68e-df49b0c49aab admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:30.073539 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d52014-5769-479f-a68e-df49b0c49aab admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:30.073820 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d52014-5769-479f-a68e-df49b0c49aab admin admin] PATH_INFO: `/v3/projects/da88d726149547f09a1d976283b1c6ab/users/2d84cba256bf42059c344452221e6325/roles/76c53e2c353644f885028a0226c06146` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:30.090754 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d52014-5769-479f-a68e-df49b0c49aab admin admin] RBAC: Authorizing `identity:create_grant(project_id=da88d726149547f09a1d976283b1c6ab, user_id=2d84cba256bf42059c344452221e6325, role_id=76c53e2c353644f885028a0226c06146)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:01:30.094433 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d52014-5769-479f-a68e-df49b0c49aab admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:01:30.174326 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1437/2863] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 15:01:30 2022] PUT /identity/v3/projects/da88d726149547f09a1d976283b1c6ab/users/2d84cba256bf42059c344452221e6325/roles/76c53e2c353644f885028a0226c06146 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 15:01:30.178663 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8e626f-97df-4142-a1e0-f7ce197cb991 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:01:30.188880 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8e626f-97df-4142-a1e0-f7ce197cb991 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:01:30.244117 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576be75e-fb27-4faf-b128-49c8ba5a3bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:01:30.244780 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576be75e-fb27-4faf-b128-49c8ba5a3bdc admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:30.245061 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576be75e-fb27-4faf-b128-49c8ba5a3bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:30.245333 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576be75e-fb27-4faf-b128-49c8ba5a3bdc admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:30.246040 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576be75e-fb27-4faf-b128-49c8ba5a3bdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:01:30.247641 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576be75e-fb27-4faf-b128-49c8ba5a3bdc admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:01:30.257175 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1427/2864] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 15:01:30 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 15:01:30.261446 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d52014-5769-479f-a68e-df49b0c49aab admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:01:30.272291 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d52014-5769-479f-a68e-df49b0c49aab admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:01:30.276989 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52bb2a5-b12c-4c23-8f78-bef514cb8e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:01:30.277862 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52bb2a5-b12c-4c23-8f78-bef514cb8e61 admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:30.278147 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52bb2a5-b12c-4c23-8f78-bef514cb8e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:30.278495 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52bb2a5-b12c-4c23-8f78-bef514cb8e61 admin admin] PATH_INFO: `/v3/projects/da88d726149547f09a1d976283b1c6ab/users/2d84cba256bf42059c344452221e6325/roles/76c53e2c353644f885028a0226c06146` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:30.281045 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52bb2a5-b12c-4c23-8f78-bef514cb8e61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da88d726149547f09a1d976283b1c6ab, user_id=2d84cba256bf42059c344452221e6325, role_id=76c53e2c353644f885028a0226c06146)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:01:30.283725 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52bb2a5-b12c-4c23-8f78-bef514cb8e61 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:01:30.294799 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1438/2865] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 15:01:30 2022] PUT /identity/v3/projects/da88d726149547f09a1d976283b1c6ab/users/2d84cba256bf42059c344452221e6325/roles/76c53e2c353644f885028a0226c06146 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 15:01:30.305462 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fbc5f5-aa63-4349-96d6-676c7f2e7688 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:30.305690 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fbc5f5-aa63-4349-96d6-676c7f2e7688 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:30.305962 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fbc5f5-aa63-4349-96d6-676c7f2e7688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:30.332800 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-41fbc5f5-aa63-4349-96d6-676c7f2e7688 None None] MFA Rules not processed for user `2d84cba256bf42059c344452221e6325`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 15:01:30.333986 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-41fbc5f5-aa63-4349-96d6-676c7f2e7688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 15:01:30.401493 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1428/2866] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 15:01:30 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 15:01:30.413665 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52bb2a5-b12c-4c23-8f78-bef514cb8e61 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:01:30.415435 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-d52bb2a5-b12c-4c23-8f78-bef514cb8e61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 15:01:30.474815 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52bb2a5-b12c-4c23-8f78-bef514cb8e61 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:01:30.478443 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3af22a7-1c72-4a80-9234-08a1b1ad54b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afbf718dcd9b4741a926b0a2321bd53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:01:30.479114 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af22a7-1c72-4a80-9234-08a1b1ad54b9 service cinder] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:30.479391 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af22a7-1c72-4a80-9234-08a1b1ad54b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:30.479663 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af22a7-1c72-4a80-9234-08a1b1ad54b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:30.535084 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3af22a7-1c72-4a80-9234-08a1b1ad54b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:01:30.536557 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3af22a7-1c72-4a80-9234-08a1b1ad54b9 service cinder] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:01:30.545331 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1439/2867] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 15:01:30 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 15:01:32.525873 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fbc5f5-aa63-4349-96d6-676c7f2e7688 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:01:32.527295 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-41fbc5f5-aa63-4349-96d6-676c7f2e7688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 15:01:32.540677 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fbc5f5-aa63-4349-96d6-676c7f2e7688 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:01:32.544266 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c291430f-4af0-4db7-b6de-60df5b6d0a48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afbf718dcd9b4741a926b0a2321bd53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:01:32.544904 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c291430f-4af0-4db7-b6de-60df5b6d0a48 service cinder] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:32.545189 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c291430f-4af0-4db7-b6de-60df5b6d0a48 service cinder] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:32.545966 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c291430f-4af0-4db7-b6de-60df5b6d0a48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:32.595926 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:01:32.609823 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c291430f-4af0-4db7-b6de-60df5b6d0a48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:01:32.611364 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c291430f-4af0-4db7-b6de-60df5b6d0a48 service cinder] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:01:32.620200 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1429/2868] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 15:01:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 15:01:34.172026 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3af22a7-1c72-4a80-9234-08a1b1ad54b9 service cinder] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:01:34.181126 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3af22a7-1c72-4a80-9234-08a1b1ad54b9 service cinder] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:01:34.184906 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9368b518-7cd5-4295-9528-82028a5d132c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afbf718dcd9b4741a926b0a2321bd53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:01:34.185570 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9368b518-7cd5-4295-9528-82028a5d132c service cinder] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:34.185853 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9368b518-7cd5-4295-9528-82028a5d132c service cinder] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:34.186194 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9368b518-7cd5-4295-9528-82028a5d132c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:34.196349 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9368b518-7cd5-4295-9528-82028a5d132c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:01:34.197790 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9368b518-7cd5-4295-9528-82028a5d132c service cinder] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:01:34.207892 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1440/2869] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 15:01:34 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 15:01:39.079714 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c291430f-4af0-4db7-b6de-60df5b6d0a48 service cinder] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:01:39.142754 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c291430f-4af0-4db7-b6de-60df5b6d0a48 service cinder] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:01:39.147330 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e1db6c-17b6-43b2-8bed-0b7050c8009f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:01:39.148243 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e1db6c-17b6-43b2-8bed-0b7050c8009f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:39.148657 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e1db6c-17b6-43b2-8bed-0b7050c8009f admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:39.149010 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e1db6c-17b6-43b2-8bed-0b7050c8009f admin admin] PATH_INFO: `/v3/users/3ab3ba99aa734fc89d92de6202f7d2e1` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:39.149924 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e1db6c-17b6-43b2-8bed-0b7050c8009f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ab3ba99aa734fc89d92de6202f7d2e1)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:01:39.151970 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e1db6c-17b6-43b2-8bed-0b7050c8009f admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:01:39.349615 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-d8e1db6c-17b6-43b2-8bed-0b7050c8009f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ab3ba99aa734fc89d92de6202f7d2e1'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:39.356812 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-d8e1db6c-17b6-43b2-8bed-0b7050c8009f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ab3ba99aa734fc89d92de6202f7d2e1'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:39.357478 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-d8e1db6c-17b6-43b2-8bed-0b7050c8009f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ab3ba99aa734fc89d92de6202f7d2e1'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:39.358656 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-d8e1db6c-17b6-43b2-8bed-0b7050c8009f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ab3ba99aa734fc89d92de6202f7d2e1'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:39.370363 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-d8e1db6c-17b6-43b2-8bed-0b7050c8009f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ab3ba99aa734fc89d92de6202f7d2e1'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:39.463694 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1430/2870] 10.222.0.15 () {58 vars in 1223 bytes} [Tue May 31 15:01:39 2022] DELETE /identity/v3/users/3ab3ba99aa734fc89d92de6202f7d2e1 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 15:01:39.468771 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda9e0e9-8985-4c4e-9574-4dd97aaf7fbd None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:39.469257 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda9e0e9-8985-4c4e-9574-4dd97aaf7fbd None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:39.469356 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda9e0e9-8985-4c4e-9574-4dd97aaf7fbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:39.475327 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:01:39.488191 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-bda9e0e9-8985-4c4e-9574-4dd97aaf7fbd None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 15:01:39.489424 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-bda9e0e9-8985-4c4e-9574-4dd97aaf7fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 15:01:39.551187 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1441/2871] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 15:01:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 15:01:39.560658 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e1db6c-17b6-43b2-8bed-0b7050c8009f admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:01:39.562192 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-d8e1db6c-17b6-43b2-8bed-0b7050c8009f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 15:01:39.632969 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e1db6c-17b6-43b2-8bed-0b7050c8009f admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:01:39.636590 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67401717-357d-496b-9a34-c234da93f5a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:01:39.637283 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67401717-357d-496b-9a34-c234da93f5a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:39.637565 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67401717-357d-496b-9a34-c234da93f5a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:39.637840 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67401717-357d-496b-9a34-c234da93f5a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:39.647221 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67401717-357d-496b-9a34-c234da93f5a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:01:39.648732 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67401717-357d-496b-9a34-c234da93f5a4 service neutron] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:01:39.659206 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1431/2872] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 15:01:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 31 15:01:40.091817 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda9e0e9-8985-4c4e-9574-4dd97aaf7fbd None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:01:40.093857 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-bda9e0e9-8985-4c4e-9574-4dd97aaf7fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 15:01:40.110086 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda9e0e9-8985-4c4e-9574-4dd97aaf7fbd None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:01:40.116220 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d12efd-cd34-43b5-94dd-a2f42ca3bdf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:01:40.116716 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d12efd-cd34-43b5-94dd-a2f42ca3bdf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:40.116919 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d12efd-cd34-43b5-94dd-a2f42ca3bdf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:40.117254 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d12efd-cd34-43b5-94dd-a2f42ca3bdf6 admin admin] PATH_INFO: `/v3/projects/c219cd74d94c4e138b1fac04bf4e0952` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:40.118403 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d12efd-cd34-43b5-94dd-a2f42ca3bdf6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c219cd74d94c4e138b1fac04bf4e0952)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:01:40.120350 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d12efd-cd34-43b5-94dd-a2f42ca3bdf6 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:01:40.259341 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-96d12efd-cd34-43b5-94dd-a2f42ca3bdf6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c219cd74d94c4e138b1fac04bf4e0952', 'request_id': 'req-96d12efd-cd34-43b5-94dd-a2f42ca3bdf6'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:40.341615 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-96d12efd-cd34-43b5-94dd-a2f42ca3bdf6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c219cd74d94c4e138b1fac04bf4e0952', 'request_id': 'req-96d12efd-cd34-43b5-94dd-a2f42ca3bdf6'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:40.347827 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-96d12efd-cd34-43b5-94dd-a2f42ca3bdf6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c219cd74d94c4e138b1fac04bf4e0952', 'request_id': 'req-96d12efd-cd34-43b5-94dd-a2f42ca3bdf6'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:40.359827 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-96d12efd-cd34-43b5-94dd-a2f42ca3bdf6 admin admin] The token cache is being invalidate because project c219cd74d94c4e138b1fac04bf4e0952 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80503) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 15:01:40.360115 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-96d12efd-cd34-43b5-94dd-a2f42ca3bdf6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:40.360750 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-96d12efd-cd34-43b5-94dd-a2f42ca3bdf6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:40.362372 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1442/2873] 10.222.0.15 () {58 vars in 1232 bytes} [Tue May 31 15:01:40 2022] DELETE /identity/v3/projects/c219cd74d94c4e138b1fac04bf4e0952 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 15:01:40.366399 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67401717-357d-496b-9a34-c234da93f5a4 service neutron] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:01:40.376894 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67401717-357d-496b-9a34-c234da93f5a4 service neutron] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:01:40.385985 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:01:40.435131 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c1f3f9-41ad-43b9-8dc4-04a3a0336030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:01:40.436006 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c1f3f9-41ad-43b9-8dc4-04a3a0336030 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:40.436809 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c1f3f9-41ad-43b9-8dc4-04a3a0336030 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:40.437090 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c1f3f9-41ad-43b9-8dc4-04a3a0336030 admin admin] PATH_INFO: `/v3/users/7353fd4a8ef24cb182126928bfcdd4a0` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:40.438273 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c1f3f9-41ad-43b9-8dc4-04a3a0336030 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7353fd4a8ef24cb182126928bfcdd4a0)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:01:40.440253 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c1f3f9-41ad-43b9-8dc4-04a3a0336030 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:01:40.580295 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-d2c1f3f9-41ad-43b9-8dc4-04a3a0336030 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7353fd4a8ef24cb182126928bfcdd4a0'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:40.588898 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-d2c1f3f9-41ad-43b9-8dc4-04a3a0336030 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7353fd4a8ef24cb182126928bfcdd4a0'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:40.589617 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-d2c1f3f9-41ad-43b9-8dc4-04a3a0336030 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7353fd4a8ef24cb182126928bfcdd4a0'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:40.590235 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-d2c1f3f9-41ad-43b9-8dc4-04a3a0336030 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7353fd4a8ef24cb182126928bfcdd4a0'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:40.605934 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-d2c1f3f9-41ad-43b9-8dc4-04a3a0336030 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7353fd4a8ef24cb182126928bfcdd4a0'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:40.693132 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1432/2874] 10.222.0.15 () {58 vars in 1223 bytes} [Tue May 31 15:01:40 2022] DELETE /identity/v3/users/7353fd4a8ef24cb182126928bfcdd4a0 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 15:01:41.154453 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d12efd-cd34-43b5-94dd-a2f42ca3bdf6 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:01:41.157025 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-96d12efd-cd34-43b5-94dd-a2f42ca3bdf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 15:01:41.172140 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d12efd-cd34-43b5-94dd-a2f42ca3bdf6 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:01:41.239242 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7f468b-f9e3-40e1-90e2-5818215ee564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:01:41.240103 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7f468b-f9e3-40e1-90e2-5818215ee564 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:41.240386 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7f468b-f9e3-40e1-90e2-5818215ee564 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:41.240661 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7f468b-f9e3-40e1-90e2-5818215ee564 admin admin] PATH_INFO: `/v3/projects/fda3c928b8b843b696139bc80e67ec51` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:41.241859 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7f468b-f9e3-40e1-90e2-5818215ee564 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fda3c928b8b843b696139bc80e67ec51)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:01:41.243800 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7f468b-f9e3-40e1-90e2-5818215ee564 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:01:41.335363 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:01:41.352261 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-0e7f468b-f9e3-40e1-90e2-5818215ee564 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fda3c928b8b843b696139bc80e67ec51', 'request_id': 'req-0e7f468b-f9e3-40e1-90e2-5818215ee564'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:41.429275 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-0e7f468b-f9e3-40e1-90e2-5818215ee564 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fda3c928b8b843b696139bc80e67ec51', 'request_id': 'req-0e7f468b-f9e3-40e1-90e2-5818215ee564'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:41.435586 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-0e7f468b-f9e3-40e1-90e2-5818215ee564 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fda3c928b8b843b696139bc80e67ec51', 'request_id': 'req-0e7f468b-f9e3-40e1-90e2-5818215ee564'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:41.447739 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-0e7f468b-f9e3-40e1-90e2-5818215ee564 admin admin] The token cache is being invalidate because project fda3c928b8b843b696139bc80e67ec51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80503) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 15:01:41.448028 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-0e7f468b-f9e3-40e1-90e2-5818215ee564 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:41.448732 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-0e7f468b-f9e3-40e1-90e2-5818215ee564 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:41.450333 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1443/2875] 10.222.0.15 () {58 vars in 1232 bytes} [Tue May 31 15:01:41 2022] DELETE /identity/v3/projects/fda3c928b8b843b696139bc80e67ec51 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 15:01:41.455062 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c1f3f9-41ad-43b9-8dc4-04a3a0336030 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:01:41.456841 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-d2c1f3f9-41ad-43b9-8dc4-04a3a0336030 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 15:01:41.471190 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c1f3f9-41ad-43b9-8dc4-04a3a0336030 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:01:41.526564 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e70282-c243-491f-872b-d2a22e5baada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:01:41.527461 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e70282-c243-491f-872b-d2a22e5baada admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:41.527735 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e70282-c243-491f-872b-d2a22e5baada admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:41.528020 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e70282-c243-491f-872b-d2a22e5baada admin admin] PATH_INFO: `/v3/users/2d84cba256bf42059c344452221e6325` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:41.529196 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e70282-c243-491f-872b-d2a22e5baada admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d84cba256bf42059c344452221e6325)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:01:41.531676 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e70282-c243-491f-872b-d2a22e5baada admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:01:41.720404 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:01:41.729482 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-06e70282-c243-491f-872b-d2a22e5baada admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d84cba256bf42059c344452221e6325'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:41.736489 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-06e70282-c243-491f-872b-d2a22e5baada admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d84cba256bf42059c344452221e6325'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:41.737193 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-06e70282-c243-491f-872b-d2a22e5baada admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d84cba256bf42059c344452221e6325'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:41.737819 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-06e70282-c243-491f-872b-d2a22e5baada admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d84cba256bf42059c344452221e6325'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:41.750273 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-06e70282-c243-491f-872b-d2a22e5baada admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d84cba256bf42059c344452221e6325'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:41.838889 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1433/2876] 10.222.0.15 () {58 vars in 1223 bytes} [Tue May 31 15:01:41 2022] DELETE /identity/v3/users/2d84cba256bf42059c344452221e6325 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 15:01:42.251837 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7f468b-f9e3-40e1-90e2-5818215ee564 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:01:42.253607 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-0e7f468b-f9e3-40e1-90e2-5818215ee564 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 15:01:42.273407 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7f468b-f9e3-40e1-90e2-5818215ee564 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:01:42.344190 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d3dda0-2f90-4d8c-a837-d2382e653fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:01:42.345086 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d3dda0-2f90-4d8c-a837-d2382e653fd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:42.345380 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d3dda0-2f90-4d8c-a837-d2382e653fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:42.345653 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d3dda0-2f90-4d8c-a837-d2382e653fd2 admin admin] PATH_INFO: `/v3/projects/da88d726149547f09a1d976283b1c6ab` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:42.347118 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d3dda0-2f90-4d8c-a837-d2382e653fd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da88d726149547f09a1d976283b1c6ab)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:01:42.349169 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d3dda0-2f90-4d8c-a837-d2382e653fd2 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:01:42.451177 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-71d3dda0-2f90-4d8c-a837-d2382e653fd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da88d726149547f09a1d976283b1c6ab', 'request_id': 'req-71d3dda0-2f90-4d8c-a837-d2382e653fd2'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:42.526017 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-71d3dda0-2f90-4d8c-a837-d2382e653fd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da88d726149547f09a1d976283b1c6ab', 'request_id': 'req-71d3dda0-2f90-4d8c-a837-d2382e653fd2'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:42.533235 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-71d3dda0-2f90-4d8c-a837-d2382e653fd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da88d726149547f09a1d976283b1c6ab', 'request_id': 'req-71d3dda0-2f90-4d8c-a837-d2382e653fd2'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:42.544701 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-71d3dda0-2f90-4d8c-a837-d2382e653fd2 admin admin] The token cache is being invalidate because project da88d726149547f09a1d976283b1c6ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80503) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 15:01:42.544874 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-71d3dda0-2f90-4d8c-a837-d2382e653fd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:42.545480 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-71d3dda0-2f90-4d8c-a837-d2382e653fd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:01:42.547618 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1444/2877] 10.222.0.15 () {58 vars in 1232 bytes} [Tue May 31 15:01:42 2022] DELETE /identity/v3/projects/da88d726149547f09a1d976283b1c6ab => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 15:01:42.552622 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5366f7-2a4d-4112-8c8d-c0259ed785ec None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:42.553085 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5366f7-2a4d-4112-8c8d-c0259ed785ec None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:42.553184 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5366f7-2a4d-4112-8c8d-c0259ed785ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:42.570535 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-fd5366f7-2a4d-4112-8c8d-c0259ed785ec None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 15:01:42.571779 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-fd5366f7-2a4d-4112-8c8d-c0259ed785ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 15:01:42.631905 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1434/2878] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 15:01:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 15:01:42.639862 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9242ef13-cf28-4867-bfcd-20d2692d9fbc None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:42.640154 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9242ef13-cf28-4867-bfcd-20d2692d9fbc None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:42.640435 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9242ef13-cf28-4867-bfcd-20d2692d9fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:42.660080 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-9242ef13-cf28-4867-bfcd-20d2692d9fbc None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 15:01:42.662247 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-9242ef13-cf28-4867-bfcd-20d2692d9fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 15:01:42.670084 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1445/2879] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 15:01:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 15:01:42.674930 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5366f7-2a4d-4112-8c8d-c0259ed785ec None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:01:42.684638 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5366f7-2a4d-4112-8c8d-c0259ed785ec None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:01:42.695193 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533c864c-e977-4dc2-8ab7-b7d2ab4abced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:01:42.695193 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533c864c-e977-4dc2-8ab7-b7d2ab4abced admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:42.695193 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533c864c-e977-4dc2-8ab7-b7d2ab4abced admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:42.695193 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533c864c-e977-4dc2-8ab7-b7d2ab4abced admin admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:42.695619 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533c864c-e977-4dc2-8ab7-b7d2ab4abced admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 15:01:42.695619 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533c864c-e977-4dc2-8ab7-b7d2ab4abced admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:01:42.695619 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533c864c-e977-4dc2-8ab7-b7d2ab4abced admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:01:42.705752 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1435/2880] 10.222.0.15 () {58 vars in 1152 bytes} [Tue May 31 15:01:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 15:01:42.710467 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9242ef13-cf28-4867-bfcd-20d2692d9fbc None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:01:42.719874 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9242ef13-cf28-4867-bfcd-20d2692d9fbc None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:01:42.724531 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875e4e1b-d2f7-4ca9-923f-11badf63c787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:01:42.725178 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e4e1b-d2f7-4ca9-923f-11badf63c787 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:42.725468 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e4e1b-d2f7-4ca9-923f-11badf63c787 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:42.725747 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e4e1b-d2f7-4ca9-923f-11badf63c787 admin admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:42.726461 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875e4e1b-d2f7-4ca9-923f-11badf63c787 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:01:42.728381 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875e4e1b-d2f7-4ca9-923f-11badf63c787 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:01:42.803255 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1446/2881] 10.222.0.15 () {60 vars in 1152 bytes} [Tue May 31 15:01:42 2022] POST /identity/v3/projects => generated 369 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 15:01:42.807552 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533c864c-e977-4dc2-8ab7-b7d2ab4abced admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:01:42.818204 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533c864c-e977-4dc2-8ab7-b7d2ab4abced admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:01:42.874618 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04681dc-7495-42d3-81d2-606b86dfb87b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:01:42.875347 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04681dc-7495-42d3-81d2-606b86dfb87b admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:42.875635 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04681dc-7495-42d3-81d2-606b86dfb87b admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:42.875913 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04681dc-7495-42d3-81d2-606b86dfb87b admin admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:42.876611 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04681dc-7495-42d3-81d2-606b86dfb87b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:01:42.878737 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04681dc-7495-42d3-81d2-606b86dfb87b admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:01:43.000002 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1436/2882] 10.222.0.15 () {60 vars in 1143 bytes} [Tue May 31 15:01:42 2022] POST /identity/v3/users => generated 285 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 15:01:43.004023 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875e4e1b-d2f7-4ca9-923f-11badf63c787 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:01:43.014424 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875e4e1b-d2f7-4ca9-923f-11badf63c787 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:01:43.020048 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aac0de-e732-4c0e-9728-c0b77e84996a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:01:43.020717 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aac0de-e732-4c0e-9728-c0b77e84996a admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:43.021001 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aac0de-e732-4c0e-9728-c0b77e84996a admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:43.021280 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aac0de-e732-4c0e-9728-c0b77e84996a admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:43.022004 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aac0de-e732-4c0e-9728-c0b77e84996a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:01:43.023641 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aac0de-e732-4c0e-9728-c0b77e84996a admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:01:43.034482 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1447/2883] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 15:01:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 15:01:43.038521 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04681dc-7495-42d3-81d2-606b86dfb87b admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:01:43.049946 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04681dc-7495-42d3-81d2-606b86dfb87b admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:01:43.054810 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149a7b5c-ab17-4674-bd88-18ea5b485aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:01:43.055413 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a7b5c-ab17-4674-bd88-18ea5b485aff admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:43.055711 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a7b5c-ab17-4674-bd88-18ea5b485aff admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:43.056002 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a7b5c-ab17-4674-bd88-18ea5b485aff admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:43.057114 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149a7b5c-ab17-4674-bd88-18ea5b485aff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:01:43.058747 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149a7b5c-ab17-4674-bd88-18ea5b485aff admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:01:43.070867 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1437/2884] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 15:01:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 15:01:43.075258 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aac0de-e732-4c0e-9728-c0b77e84996a admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:01:43.087694 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aac0de-e732-4c0e-9728-c0b77e84996a admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:01:43.092610 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b300bbc2-6077-4a8c-a03e-003eaf942e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:01:43.093520 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b300bbc2-6077-4a8c-a03e-003eaf942e4e admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:43.093806 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b300bbc2-6077-4a8c-a03e-003eaf942e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:43.094100 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b300bbc2-6077-4a8c-a03e-003eaf942e4e admin admin] PATH_INFO: `/v3/projects/0e9d75a900184f14b174f72368b26e32/users/c5a3ab58bd624b0d8e3f0cfb3abaf954/roles/317f725e26bf43648d8235bb1f7c4cb3` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:43.096666 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:01:43.110780 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b300bbc2-6077-4a8c-a03e-003eaf942e4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e9d75a900184f14b174f72368b26e32, user_id=c5a3ab58bd624b0d8e3f0cfb3abaf954, role_id=317f725e26bf43648d8235bb1f7c4cb3)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:01:43.113493 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b300bbc2-6077-4a8c-a03e-003eaf942e4e admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:01:43.179127 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1448/2885] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 15:01:43 2022] PUT /identity/v3/projects/0e9d75a900184f14b174f72368b26e32/users/c5a3ab58bd624b0d8e3f0cfb3abaf954/roles/317f725e26bf43648d8235bb1f7c4cb3 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 15:01:43.190882 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e958f0-27b2-4c28-ac2c-998a0f81d16a None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:43.191259 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e958f0-27b2-4c28-ac2c-998a0f81d16a None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:43.191531 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e958f0-27b2-4c28-ac2c-998a0f81d16a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:43.219013 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-20e958f0-27b2-4c28-ac2c-998a0f81d16a None None] MFA Rules not processed for user `c5a3ab58bd624b0d8e3f0cfb3abaf954`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 15:01:43.220247 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-20e958f0-27b2-4c28-ac2c-998a0f81d16a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 15:01:43.225460 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:01:43.283328 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1438/2886] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 15:01:43 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 15:01:43.296797 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b300bbc2-6077-4a8c-a03e-003eaf942e4e admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:01:43.298795 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-b300bbc2-6077-4a8c-a03e-003eaf942e4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 15:01:43.361271 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b300bbc2-6077-4a8c-a03e-003eaf942e4e admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:01:43.364940 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81744b7b-f574-4663-9282-65e06da1328d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14ba98b007cc4ae1b20e7f261824b77c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:01:43.365660 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81744b7b-f574-4663-9282-65e06da1328d service glance] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:01:43.365988 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81744b7b-f574-4663-9282-65e06da1328d service glance] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:01:43.366267 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81744b7b-f574-4663-9282-65e06da1328d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:01:43.375430 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81744b7b-f574-4663-9282-65e06da1328d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:01:43.385026 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81744b7b-f574-4663-9282-65e06da1328d service glance] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:01:43.386579 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1449/2887] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 15:01:43 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 15:01:53.382123 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=33,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:01:53.405637 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=24 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:02:08.538713 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e958f0-27b2-4c28-ac2c-998a0f81d16a None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:02:08.600824 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e958f0-27b2-4c28-ac2c-998a0f81d16a None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:02:08.606869 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04f2eee-ff26-43c0-b451-bad7917c02bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:02:08.607881 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f2eee-ff26-43c0-b451-bad7917c02bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:02:08.608028 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f2eee-ff26-43c0-b451-bad7917c02bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:02:08.608303 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f2eee-ff26-43c0-b451-bad7917c02bb admin admin] PATH_INFO: `/v3/users/c5a3ab58bd624b0d8e3f0cfb3abaf954` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:02:08.609615 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04f2eee-ff26-43c0-b451-bad7917c02bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5a3ab58bd624b0d8e3f0cfb3abaf954)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:02:08.611598 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04f2eee-ff26-43c0-b451-bad7917c02bb admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:02:08.833899 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-e04f2eee-ff26-43c0-b451-bad7917c02bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5a3ab58bd624b0d8e3f0cfb3abaf954'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:02:08.841775 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-e04f2eee-ff26-43c0-b451-bad7917c02bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5a3ab58bd624b0d8e3f0cfb3abaf954'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:02:08.842517 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-e04f2eee-ff26-43c0-b451-bad7917c02bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5a3ab58bd624b0d8e3f0cfb3abaf954'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:02:08.843165 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-e04f2eee-ff26-43c0-b451-bad7917c02bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5a3ab58bd624b0d8e3f0cfb3abaf954'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:02:08.856993 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-e04f2eee-ff26-43c0-b451-bad7917c02bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5a3ab58bd624b0d8e3f0cfb3abaf954'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:02:08.957464 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1439/2888] 10.222.0.15 () {58 vars in 1223 bytes} [Tue May 31 15:02:08 2022] DELETE /identity/v3/users/c5a3ab58bd624b0d8e3f0cfb3abaf954 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 15:02:08.962612 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2871bb-a808-4b86-a5b7-a6886d38c664 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:02:08.964054 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2871bb-a808-4b86-a5b7-a6886d38c664 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:02:08.964054 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2871bb-a808-4b86-a5b7-a6886d38c664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:02:08.982532 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-9c2871bb-a808-4b86-a5b7-a6886d38c664 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 15:02:08.983796 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-9c2871bb-a808-4b86-a5b7-a6886d38c664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 15:02:09.045384 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1450/2889] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 15:02:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 15:02:09.055292 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04f2eee-ff26-43c0-b451-bad7917c02bb admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:02:09.056710 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-e04f2eee-ff26-43c0-b451-bad7917c02bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 15:02:09.117390 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04f2eee-ff26-43c0-b451-bad7917c02bb admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:02:09.121037 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e086287-601d-481e-9e98-a579e91156a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:02:09.121684 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e086287-601d-481e-9e98-a579e91156a2 service neutron] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:02:09.121975 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e086287-601d-481e-9e98-a579e91156a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:02:09.122255 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e086287-601d-481e-9e98-a579e91156a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:02:09.131214 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e086287-601d-481e-9e98-a579e91156a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:02:09.132646 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e086287-601d-481e-9e98-a579e91156a2 service neutron] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:02:09.142492 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1440/2890] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 15:02:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 15:02:09.569018 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2871bb-a808-4b86-a5b7-a6886d38c664 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:02:09.570460 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-9c2871bb-a808-4b86-a5b7-a6886d38c664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 15:02:09.585862 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2871bb-a808-4b86-a5b7-a6886d38c664 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:02:09.587583 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b7f570-8542-4884-bb25-c68b1beef36f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:02:09.588438 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b7f570-8542-4884-bb25-c68b1beef36f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:02:09.589599 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b7f570-8542-4884-bb25-c68b1beef36f admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:02:09.589884 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b7f570-8542-4884-bb25-c68b1beef36f admin admin] PATH_INFO: `/v3/projects/0e9d75a900184f14b174f72368b26e32` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:02:09.591342 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b7f570-8542-4884-bb25-c68b1beef36f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e9d75a900184f14b174f72368b26e32)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:02:09.593252 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b7f570-8542-4884-bb25-c68b1beef36f admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:02:09.737804 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-00b7f570-8542-4884-bb25-c68b1beef36f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e9d75a900184f14b174f72368b26e32', 'request_id': 'req-00b7f570-8542-4884-bb25-c68b1beef36f'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:02:09.816590 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-00b7f570-8542-4884-bb25-c68b1beef36f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e9d75a900184f14b174f72368b26e32', 'request_id': 'req-00b7f570-8542-4884-bb25-c68b1beef36f'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:02:09.822965 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-00b7f570-8542-4884-bb25-c68b1beef36f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e9d75a900184f14b174f72368b26e32', 'request_id': 'req-00b7f570-8542-4884-bb25-c68b1beef36f'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:02:09.835296 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-00b7f570-8542-4884-bb25-c68b1beef36f admin admin] The token cache is being invalidate because project 0e9d75a900184f14b174f72368b26e32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80503) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 15:02:09.835585 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-00b7f570-8542-4884-bb25-c68b1beef36f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:02:09.836231 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-00b7f570-8542-4884-bb25-c68b1beef36f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:02:09.837840 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1451/2891] 10.222.0.15 () {58 vars in 1232 bytes} [Tue May 31 15:02:09 2022] DELETE /identity/v3/projects/0e9d75a900184f14b174f72368b26e32 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 15:02:09.842727 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b25d25f-eb59-491e-a708-40084610795e None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:02:09.843186 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b25d25f-eb59-491e-a708-40084610795e None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:02:09.843284 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b25d25f-eb59-491e-a708-40084610795e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:02:09.861419 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-7b25d25f-eb59-491e-a708-40084610795e None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 15:02:09.862708 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-7b25d25f-eb59-491e-a708-40084610795e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 15:02:09.880439 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:02:09.921461 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1441/2892] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 15:02:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 15:02:09.929413 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9530e9-5ab4-48f0-a2b5-c0aae11bcb5a None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:02:09.929704 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9530e9-5ab4-48f0-a2b5-c0aae11bcb5a None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:02:09.929989 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9530e9-5ab4-48f0-a2b5-c0aae11bcb5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:02:09.949900 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-9e9530e9-5ab4-48f0-a2b5-c0aae11bcb5a None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 15:02:09.951164 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-9e9530e9-5ab4-48f0-a2b5-c0aae11bcb5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 15:02:09.959442 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1452/2893] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 15:02:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 15:02:09.963898 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b25d25f-eb59-491e-a708-40084610795e None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:02:09.974410 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b25d25f-eb59-491e-a708-40084610795e None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:02:09.979386 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65513d59-7a4d-4002-abd6-f3d2c20fd1af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:02:09.980886 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65513d59-7a4d-4002-abd6-f3d2c20fd1af admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:02:09.981246 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65513d59-7a4d-4002-abd6-f3d2c20fd1af admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:02:09.981521 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65513d59-7a4d-4002-abd6-f3d2c20fd1af admin admin] PATH_INFO: `/v3/domains` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:02:09.982242 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65513d59-7a4d-4002-abd6-f3d2c20fd1af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80502) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 31 15:02:09.982562 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65513d59-7a4d-4002-abd6-f3d2c20fd1af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:02:09.984172 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65513d59-7a4d-4002-abd6-f3d2c20fd1af admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:02:09.995587 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1442/2894] 10.222.0.15 () {58 vars in 1152 bytes} [Tue May 31 15:02:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 31 15:02:10.000638 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9530e9-5ab4-48f0-a2b5-c0aae11bcb5a None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:02:10.009973 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9530e9-5ab4-48f0-a2b5-c0aae11bcb5a None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:02:10.014915 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b435e9-50a2-4d2c-a824-3687a0be9b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:02:10.015571 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b435e9-50a2-4d2c-a824-3687a0be9b28 admin admin] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:02:10.015859 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b435e9-50a2-4d2c-a824-3687a0be9b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:02:10.016140 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b435e9-50a2-4d2c-a824-3687a0be9b28 admin admin] PATH_INFO: `/v3/projects` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:02:10.016860 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b435e9-50a2-4d2c-a824-3687a0be9b28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:02:10.018895 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b435e9-50a2-4d2c-a824-3687a0be9b28 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:02:10.117518 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1453/2895] 10.222.0.15 () {60 vars in 1152 bytes} [Tue May 31 15:02:09 2022] POST /identity/v3/projects => generated 381 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 31 15:02:10.122483 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65513d59-7a4d-4002-abd6-f3d2c20fd1af admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:02:10.132940 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65513d59-7a4d-4002-abd6-f3d2c20fd1af admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:02:10.188628 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed849c2-c24c-412d-9107-80cfc52206f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:02:10.189315 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed849c2-c24c-412d-9107-80cfc52206f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:02:10.189606 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed849c2-c24c-412d-9107-80cfc52206f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:02:10.189885 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed849c2-c24c-412d-9107-80cfc52206f9 admin admin] PATH_INFO: `/v3/users` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:02:10.190624 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed849c2-c24c-412d-9107-80cfc52206f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:02:10.192542 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed849c2-c24c-412d-9107-80cfc52206f9 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:02:10.270272 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1443/2896] 10.222.0.15 () {60 vars in 1143 bytes} [Tue May 31 15:02:10 2022] POST /identity/v3/users => generated 291 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 31 15:02:10.274260 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b435e9-50a2-4d2c-a824-3687a0be9b28 admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:02:10.285209 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b435e9-50a2-4d2c-a824-3687a0be9b28 admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:02:10.289908 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c2ffb3-37fd-4a7b-8248-3a44daed45fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:02:10.290610 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c2ffb3-37fd-4a7b-8248-3a44daed45fa admin admin] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:02:10.296114 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c2ffb3-37fd-4a7b-8248-3a44daed45fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:02:10.296114 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c2ffb3-37fd-4a7b-8248-3a44daed45fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:02:10.296114 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c2ffb3-37fd-4a7b-8248-3a44daed45fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:02:10.296114 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c2ffb3-37fd-4a7b-8248-3a44daed45fa admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:02:10.305591 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1454/2897] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 15:02:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 15:02:10.312711 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed849c2-c24c-412d-9107-80cfc52206f9 admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:02:10.322810 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed849c2-c24c-412d-9107-80cfc52206f9 admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:02:10.327424 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9b1c56-1d96-4bd7-a276-147dfc4979a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:02:10.328079 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b1c56-1d96-4bd7-a276-147dfc4979a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:02:10.328366 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b1c56-1d96-4bd7-a276-147dfc4979a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:02:10.328661 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b1c56-1d96-4bd7-a276-147dfc4979a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:02:10.329363 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9b1c56-1d96-4bd7-a276-147dfc4979a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:02:10.330990 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9b1c56-1d96-4bd7-a276-147dfc4979a3 admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:02:10.343465 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1444/2898] 10.222.0.15 () {58 vars in 1121 bytes} [Tue May 31 15:02:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 31 15:02:10.347549 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c2ffb3-37fd-4a7b-8248-3a44daed45fa admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:02:10.358156 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c2ffb3-37fd-4a7b-8248-3a44daed45fa admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:02:10.362742 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8c87bc-39a8-483c-992f-4d6e0162324f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:02:10.363634 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8c87bc-39a8-483c-992f-4d6e0162324f admin admin] REQUEST_METHOD: `PUT` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:02:10.363909 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8c87bc-39a8-483c-992f-4d6e0162324f admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:02:10.364190 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8c87bc-39a8-483c-992f-4d6e0162324f admin admin] PATH_INFO: `/v3/projects/52e47438cc1a4c3e86aa310ba18afe6f/users/2ef3ec487c99451999ab4ddbf7c838fe/roles/317f725e26bf43648d8235bb1f7c4cb3` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:02:10.378622 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8c87bc-39a8-483c-992f-4d6e0162324f admin admin] RBAC: Authorizing `identity:create_grant(project_id=52e47438cc1a4c3e86aa310ba18afe6f, user_id=2ef3ec487c99451999ab4ddbf7c838fe, role_id=317f725e26bf43648d8235bb1f7c4cb3)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:02:10.381269 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8c87bc-39a8-483c-992f-4d6e0162324f admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:02:10.471013 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1455/2899] 10.222.0.15 () {60 vars in 1482 bytes} [Tue May 31 15:02:10 2022] PUT /identity/v3/projects/52e47438cc1a4c3e86aa310ba18afe6f/users/2ef3ec487c99451999ab4ddbf7c838fe/roles/317f725e26bf43648d8235bb1f7c4cb3 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 15:02:10.482814 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b0fef-cbff-4049-83b3-a1975e96bae5 None None] REQUEST_METHOD: `POST` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:02:10.483110 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b0fef-cbff-4049-83b3-a1975e96bae5 None None] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:02:10.483415 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b0fef-cbff-4049-83b3-a1975e96bae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:02:10.509008 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.auth.core [None req-c35b0fef-cbff-4049-83b3-a1975e96bae5 None None] MFA Rules not processed for user `2ef3ec487c99451999ab4ddbf7c838fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80502) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 15:02:10.510250 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-c35b0fef-cbff-4049-83b3-a1975e96bae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 15:02:10.572181 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1445/2900] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 15:02:10 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 15:02:10.583495 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8c87bc-39a8-483c-992f-4d6e0162324f admin admin] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:02:10.585170 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-1c8c87bc-39a8-483c-992f-4d6e0162324f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 15:02:10.607866 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:02:10.646423 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8c87bc-39a8-483c-992f-4d6e0162324f admin admin] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:02:10.650907 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5b41c2-9a40-4093-b6cb-f13005cedc6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'afbf718dcd9b4741a926b0a2321bd53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:02:10.651645 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b41c2-9a40-4093-b6cb-f13005cedc6b service cinder] REQUEST_METHOD: `GET` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:02:10.651932 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b41c2-9a40-4093-b6cb-f13005cedc6b service cinder] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:02:10.652812 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5b41c2-9a40-4093-b6cb-f13005cedc6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:02:10.661394 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5b41c2-9a40-4093-b6cb-f13005cedc6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:02:10.662930 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5b41c2-9a40-4093-b6cb-f13005cedc6b service cinder] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:02:10.671854 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1456/2901] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 15:02:10 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 15:02:13.690409 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35b0fef-cbff-4049-83b3-a1975e96bae5 None None] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:02:13.710312 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:02:13.755529 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35b0fef-cbff-4049-83b3-a1975e96bae5 None None] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:02:13.760269 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34a486b-9b94-41a1-b473-6d57aeef4d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:02:13.761149 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a486b-9b94-41a1-b473-6d57aeef4d5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:02:13.761481 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a486b-9b94-41a1-b473-6d57aeef4d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:02:13.761768 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a486b-9b94-41a1-b473-6d57aeef4d5b admin admin] PATH_INFO: `/v3/users/2ef3ec487c99451999ab4ddbf7c838fe` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:02:13.763027 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34a486b-9b94-41a1-b473-6d57aeef4d5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ef3ec487c99451999ab4ddbf7c838fe)` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:02:13.765165 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34a486b-9b94-41a1-b473-6d57aeef4d5b admin admin] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:02:14.000813 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-a34a486b-9b94-41a1-b473-6d57aeef4d5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ef3ec487c99451999ab4ddbf7c838fe'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:02:14.009702 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-a34a486b-9b94-41a1-b473-6d57aeef4d5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ef3ec487c99451999ab4ddbf7c838fe'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:02:14.010494 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-a34a486b-9b94-41a1-b473-6d57aeef4d5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ef3ec487c99451999ab4ddbf7c838fe'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:02:14.011128 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-a34a486b-9b94-41a1-b473-6d57aeef4d5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ef3ec487c99451999ab4ddbf7c838fe'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:02:14.024259 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.notifications [None req-a34a486b-9b94-41a1-b473-6d57aeef4d5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ef3ec487c99451999ab4ddbf7c838fe'} {{(pid=80502) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:02:14.122412 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1446/2902] 10.222.0.15 () {58 vars in 1223 bytes} [Tue May 31 15:02:13 2022] DELETE /identity/v3/users/2ef3ec487c99451999ab4ddbf7c838fe => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 15:02:14.127129 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77016ba4-7fad-4bfc-9958-c3cec47fe411 None None] REQUEST_METHOD: `POST` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:02:14.127694 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77016ba4-7fad-4bfc-9958-c3cec47fe411 None None] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:02:14.127694 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77016ba4-7fad-4bfc-9958-c3cec47fe411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:02:14.145547 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.auth.core [None req-77016ba4-7fad-4bfc-9958-c3cec47fe411 None None] MFA Rules not processed for user `98fe85f6eb3a42f89b20a9a8c17c5432`. Rule list: `[]` (Enabled: `True`). {{(pid=80503) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 31 15:02:14.146852 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-77016ba4-7fad-4bfc-9958-c3cec47fe411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 15:02:14.210460 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1457/2903] 10.222.0.15 () {58 vars in 957 bytes} [Tue May 31 15:02:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 31 15:02:14.220811 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34a486b-9b94-41a1-b473-6d57aeef4d5b admin admin] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:02:14.222290 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-a34a486b-9b94-41a1-b473-6d57aeef4d5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 15:02:14.284918 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34a486b-9b94-41a1-b473-6d57aeef4d5b admin admin] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:02:14.291096 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1181e3a6-ad2c-420b-8d16-5262096823e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5262f4b9b2948fdb3b4ab504311453b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:02:14.291096 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1181e3a6-ad2c-420b-8d16-5262096823e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:02:14.291096 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1181e3a6-ad2c-420b-8d16-5262096823e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:02:14.291511 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1181e3a6-ad2c-420b-8d16-5262096823e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:02:14.302934 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1181e3a6-ad2c-420b-8d16-5262096823e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:02:14.304541 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1181e3a6-ad2c-420b-8d16-5262096823e6 service neutron] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:02:14.314841 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1447/2904] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 15:02:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 15:02:14.784240 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77016ba4-7fad-4bfc-9958-c3cec47fe411 None None] Authenticating user token {{(pid=80503) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:02:14.785720 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.fernet_utils [None req-77016ba4-7fad-4bfc-9958-c3cec47fe411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80503) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 15:02:14.802332 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77016ba4-7fad-4bfc-9958-c3cec47fe411 None None] Validating token access rules against request {{(pid=80503) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:02:14.810737 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38753d1-be56-443f-941e-b4e4458fa538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98fe85f6eb3a42f89b20a9a8c17c5432', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b38704b3ca584f7ab2bbb66117ff153b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80503) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:02:14.811659 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38753d1-be56-443f-941e-b4e4458fa538 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:02:14.811949 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38753d1-be56-443f-941e-b4e4458fa538 admin admin] SCRIPT_NAME: `/identity` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:02:14.812241 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38753d1-be56-443f-941e-b4e4458fa538 admin admin] PATH_INFO: `/v3/projects/52e47438cc1a4c3e86aa310ba18afe6f` {{(pid=80503) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:02:14.813590 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38753d1-be56-443f-941e-b4e4458fa538 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52e47438cc1a4c3e86aa310ba18afe6f)` {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:02:14.817116 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38753d1-be56-443f-941e-b4e4458fa538 admin admin] RBAC: Authorization granted {{(pid=80503) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:02:14.959635 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-a38753d1-be56-443f-941e-b4e4458fa538 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52e47438cc1a4c3e86aa310ba18afe6f', 'request_id': 'req-a38753d1-be56-443f-941e-b4e4458fa538'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:02:15.036189 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-a38753d1-be56-443f-941e-b4e4458fa538 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52e47438cc1a4c3e86aa310ba18afe6f', 'request_id': 'req-a38753d1-be56-443f-941e-b4e4458fa538'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:02:15.043735 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-a38753d1-be56-443f-941e-b4e4458fa538 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52e47438cc1a4c3e86aa310ba18afe6f', 'request_id': 'req-a38753d1-be56-443f-941e-b4e4458fa538'} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:02:15.058305 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-a38753d1-be56-443f-941e-b4e4458fa538 admin admin] The token cache is being invalidate because project 52e47438cc1a4c3e86aa310ba18afe6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80503) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 31 15:02:15.059392 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-a38753d1-be56-443f-941e-b4e4458fa538 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:02:15.060563 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG keystone.notifications [None req-a38753d1-be56-443f-941e-b4e4458fa538 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80503) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 31 15:02:15.067596 dv-cinder-839793-14-smb devstack@keystone.service[80503]: [pid: 80503|app: 0|req: 1458/2905] 10.222.0.15 () {58 vars in 1232 bytes} [Tue May 31 15:02:14 2022] DELETE /identity/v3/projects/52e47438cc1a4c3e86aa310ba18afe6f => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 31 15:02:24.310183 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=71,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:02:25.053820 dv-cinder-839793-14-smb devstack@keystone.service[80503]: DEBUG dbcounter [-] [80503] Writing DB stats keystone:SELECT=71,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 15:03:29.760801 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1181e3a6-ad2c-420b-8d16-5262096823e6 service neutron] Authenticating user token {{(pid=80502) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 31 15:03:29.762240 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-1181e3a6-ad2c-420b-8d16-5262096823e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 15:03:29.851444 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1181e3a6-ad2c-420b-8d16-5262096823e6 service neutron] Validating token access rules against request {{(pid=80502) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 31 15:03:29.910255 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42bf245-2a31-432e-94d4-a6466d1e87fb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efc959ca520c4816b5ff7f95655e53e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ffff4334538649fdba1beb80cad207fa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80502) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 31 15:03:29.910932 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42bf245-2a31-432e-94d4-a6466d1e87fb service placement] REQUEST_METHOD: `GET` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 31 15:03:29.911225 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42bf245-2a31-432e-94d4-a6466d1e87fb service placement] SCRIPT_NAME: `/identity` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 31 15:03:29.911507 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42bf245-2a31-432e-94d4-a6466d1e87fb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80502) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 31 15:03:29.913280 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.fernet_utils [None req-e42bf245-2a31-432e-94d4-a6466d1e87fb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80502) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 31 15:03:29.924649 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42bf245-2a31-432e-94d4-a6466d1e87fb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 31 15:03:29.926225 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42bf245-2a31-432e-94d4-a6466d1e87fb service placement] RBAC: Authorization granted {{(pid=80502) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 31 15:03:29.936659 dv-cinder-839793-14-smb devstack@keystone.service[80502]: [pid: 80502|app: 0|req: 1448/2906] 10.222.0.15 () {60 vars in 1365 bytes} [Tue May 31 15:03:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 31 15:03:39.931856 dv-cinder-839793-14-smb devstack@keystone.service[80502]: DEBUG dbcounter [-] [80502] Writing DB stats keystone:SELECT=67 {{(pid=80502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}